2024-08-17T02:13:15.290 INFO:root:teuthology version: 1.2.0 2024-08-17T02:13:15.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:13:15.390 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858270 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858270' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: enable_coprs: - ceph/el9 flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCW8pqtU2UjfzsRRoSEGRjhurzziBClP92HSW0K2fP3ZegV1AaIhuLqT9YQTLM4BJaAuknq77yfHrwbPSFP6+f4= smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG37T+nao+9g/Yr1ilf47PEd6idCHG/u7OEG3zOJKjuQmaU4LaQYZYATK9KX7qREH1GrNm3G6GMAHlWBvc3PiW0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:02:08 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:13:15.390 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:13:15.391 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:13:15.391 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:13:15.392 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:13:15.413 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:13:15.414 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:13:15.414 INFO:teuthology.packaging:ref: None 2024-08-17T02:13:15.414 INFO:teuthology.packaging:tag: None 2024-08-17T02:13:15.414 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:13:15.414 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:13:15.414 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:13:15.562 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375.g2577e813 2024-08-17T02:13:15.564 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:13:15.571 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:13:15.571 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:13:15.590 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:13:15.609 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:13:15.615 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:13:15.640 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:56.155580', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCW8pqtU2UjfzsRRoSEGRjhurzziBClP92HSW0K2fP3ZegV1AaIhuLqT9YQTLM4BJaAuknq77yfHrwbPSFP6+f4='} 2024-08-17T02:13:15.662 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:56.154194', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG37T+nao+9g/Yr1ilf47PEd6idCHG/u7OEG3zOJKjuQmaU4LaQYZYATK9KX7qREH1GrNm3G6GMAHlWBvc3PiW0='} 2024-08-17T02:13:15.662 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:13:15.668 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:13:15.668 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:13:15.668 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:13:15.730 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f632e97bac0>, signals=[15]) 2024-08-17T02:13:15.730 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:13:15.736 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:13:15.736 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2024-08-17T02:13:15.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:13:15.815 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2024-08-17T02:13:15.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:13:15.889 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:13:15.896 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2024-08-17T02:13:15.914 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2024-08-17T02:13:15.914 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-08-17T02:13:15.972 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-08-17T02:13:15.972 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-08-17T02:13:15.972 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-08-17T02:13:15.973 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:13:15.973 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-08-17T02:13:15.973 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:13:15.973 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:13:15.973 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-08-17T02:13:15.973 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:13:15.973 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:13:15.973 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:13:15.973 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:13:15.973 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:13:15.973 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:13:15.974 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-08-17T02:13:15.993 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-08-17T02:13:16.011 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-08-17T02:13:16.011 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-08-17T02:13:16.068 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-08-17T02:13:16.068 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-08-17T02:13:16.068 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-08-17T02:13:16.068 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:13:16.068 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-08-17T02:13:16.069 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:13:16.069 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:13:16.069 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-08-17T02:13:16.069 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:13:16.069 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:13:16.069 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:13:16.069 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:13:16.069 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:13:16.069 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:13:16.069 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-08-17T02:13:16.094 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:13:16.105 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:13:16.111 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:13:16.111 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:13:16.113 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:13:16.129 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:13:16.135 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:13:16.135 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:13:16.171 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:13:16.239 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:13:16.290 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:13:16.304 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:13:16.305 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-08-17T02:13:16.305 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-08-17T02:13:16.305 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:13:16.305 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:13:16.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:13:16.322 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:13:16.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:13:16.326 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:13:16.486 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:13:16.487 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:13:16.487 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-08-17T02:13:16.488 DEBUG:teuthology.task.kernel:sha1 for client.1 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:13:16.488 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:13:16.488 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-08-17T02:13:16.505 INFO:teuthology.orchestra.run.smithi136.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:13:16.505 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:13:16.506 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:13:16.506 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum upgrade -y linux-firmware 2024-08-17T02:13:16.507 INFO:teuthology.orchestra.run.smithi006.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:13:16.507 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:13:16.507 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:13:16.508 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum upgrade -y linux-firmware 2024-08-17T02:13:18.715 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-08-17T02:13:20.513 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.2 MB 00:02 2024-08-17T02:13:21.665 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-08-17T02:13:22.239 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-08-17T02:13:26.382 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 6.6 MB 00:00 2024-08-17T02:13:27.072 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 6.0 MB/s | 6.6 MB 00:01 2024-08-17T02:13:27.975 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 18 kB 00:00 2024-08-17T02:13:28.806 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 18 kB 00:00 2024-08-17T02:13:29.120 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 22 MB/s | 22 MB 00:01 2024-08-17T02:13:30.069 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 20 MB/s | 22 MB 00:01 2024-08-17T02:13:34.751 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-17T02:13:35.616 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-08-17T02:13:36.917 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-08-17T02:13:36.927 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-08-17T02:13:36.927 INFO:teuthology.orchestra.run.smithi006.stdout: Package Architecture Version Repository Size 2024-08-17T02:13:36.928 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-08-17T02:13:36.928 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2024-08-17T02:13:36.928 INFO:teuthology.orchestra.run.smithi006.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:13:36.928 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:13:36.928 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-08-17T02:13:36.928 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-08-17T02:13:36.928 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 1 Package 2024-08-17T02:13:36.928 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:13:36.928 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 383 M 2024-08-17T02:13:36.928 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-08-17T02:13:37.684 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-08-17T02:13:37.694 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-08-17T02:13:37.694 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-08-17T02:13:37.694 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-08-17T02:13:37.694 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2024-08-17T02:13:37.695 INFO:teuthology.orchestra.run.smithi136.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:13:37.695 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:13:37.695 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-08-17T02:13:37.695 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-08-17T02:13:37.695 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 1 Package 2024-08-17T02:13:37.695 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:13:37.695 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 383 M 2024-08-17T02:13:37.695 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-08-17T02:13:48.486 INFO:teuthology.orchestra.run.smithi006.stdout:linux-firmware-20240716-145.el9.noarch.rpm 34 MB/s | 383 MB 00:11 2024-08-17T02:13:48.486 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:13:48.486 INFO:teuthology.orchestra.run.smithi006.stdout:Total 33 MB/s | 383 MB 00:11 2024-08-17T02:13:49.041 INFO:teuthology.orchestra.run.smithi136.stdout:linux-firmware-20240716-145.el9.noarch.rpm 34 MB/s | 383 MB 00:11 2024-08-17T02:13:49.041 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:13:49.041 INFO:teuthology.orchestra.run.smithi136.stdout:Total 34 MB/s | 383 MB 00:11 2024-08-17T02:13:51.720 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-08-17T02:13:51.805 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-08-17T02:13:51.805 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-08-17T02:13:52.129 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-08-17T02:13:52.228 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-08-17T02:13:52.228 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-08-17T02:13:55.210 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-08-17T02:13:55.210 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-08-17T02:13:55.442 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-08-17T02:13:55.443 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-08-17T02:14:04.484 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-08-17T02:14:04.527 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-08-17T02:14:05.142 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:14:05.232 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:14:05.246 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:14:05.329 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:14:05.961 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:14:05.961 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:14:06.108 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:14:06.108 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:14:06.701 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:14:06.701 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:14:06.701 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2024-08-17T02:14:06.701 INFO:teuthology.orchestra.run.smithi006.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:14:06.701 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:14:06.701 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-08-17T02:14:06.834 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:14:06.834 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:14:06.834 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2024-08-17T02:14:06.834 INFO:teuthology.orchestra.run.smithi136.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:14:06.834 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:14:06.835 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-08-17T02:14:07.014 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:14:07.015 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:14:07.161 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:14:07.161 DEBUG:teuthology.orchestra.run.smithi006:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:14:07.164 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi006.front.sepia.ceph.com to complete... 2024-08-17T02:14:07.170 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:14:07.170 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:14:07.311 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:14:07.311 DEBUG:teuthology.orchestra.run.smithi136:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:14:07.314 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi136.front.sepia.ceph.com to complete... 2024-08-17T02:14:51.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17 02:14:51 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:14:51.428 INFO:teuthology.orchestra.run.smithi006.stderr:FINISHED --2024-08-17 02:14:51-- 2024-08-17T02:14:51.428 INFO:teuthology.orchestra.run.smithi006.stderr:Total wall clock time: 44s 2024-08-17T02:14:51.428 INFO:teuthology.orchestra.run.smithi006.stderr:Downloaded: 1 files, 344M in 44s (7.87 MB/s) 2024-08-17T02:14:51.431 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:14:51.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:14:53.600 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying... ######################################## 2024-08-17T02:14:53.646 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing... ######################################## 2024-08-17T02:14:53.700 INFO:teuthology.orchestra.run.smithi006.stdout:Updating / installing... 2024-08-17T02:15:02.045 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:15:31.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17 02:15:31 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:15:31.570 INFO:teuthology.orchestra.run.smithi136.stderr:FINISHED --2024-08-17 02:15:31-- 2024-08-17T02:15:31.570 INFO:teuthology.orchestra.run.smithi136.stderr:Total wall clock time: 1m 24s 2024-08-17T02:15:31.570 INFO:teuthology.orchestra.run.smithi136.stderr:Downloaded: 1 files, 344M in 1m 24s (4.11 MB/s) 2024-08-17T02:15:31.574 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:15:31.575 DEBUG:teuthology.orchestra.run.smithi136:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:15:33.654 INFO:teuthology.orchestra.run.smithi136.stdout:Verifying... ######################################## 2024-08-17T02:15:33.723 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing... ######################################## 2024-08-17T02:15:33.773 INFO:teuthology.orchestra.run.smithi136.stdout:Updating / installing... 2024-08-17T02:15:41.337 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi006.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:15:41.338 DEBUG:teuthology.orchestra.run.smithi006:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:15:41.421 INFO:teuthology.orchestra.run.smithi006.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:41.421 INFO:teuthology.orchestra.run.smithi006.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:41.421 INFO:teuthology.orchestra.run.smithi006.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:41.421 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:41.422 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:15:41.422 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:15:41.422 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:15:41.422 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:15:41.422 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:15:41.422 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:15:41.422 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:15:41.422 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:15:41.422 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:15:41.422 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:15:41.422 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:15:41.422 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:15:41.422 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:15:41.423 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:15:41.423 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:15:41.423 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:15:41.423 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:15:41.423 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:15:41.423 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:15:41.423 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:15:41.423 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:15:41.423 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:15:41.423 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:15:41.423 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:15:41.423 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:15:41.423 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:15:41.424 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:15:41.424 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:15:41.424 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:15:41.424 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:15:41.424 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:15:41.424 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:15:41.424 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:15:41.424 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:15:41.424 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:15:41.424 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:15:41.424 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:15:41.424 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:15:41.424 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:15:41.425 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:15:41.425 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:15:41.425 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:15:41.425 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:15:41.425 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:15:41.425 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:15:41.425 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:15:41.425 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:15:41.425 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:15:41.425 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:15:41.425 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:15:41.425 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:15:41.425 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:15:41.426 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:15:41.426 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:15:41.426 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:15:41.426 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:15:41.426 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:15:41.426 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:15:41.426 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:15:41.426 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:15:41.426 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:15:41.426 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:15:41.426 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:15:41.426 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:15:41.426 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:15:41.427 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:15:41.427 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:15:41.427 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:15:41.427 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:15:41.427 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:15:41.427 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:15:41.428 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:15:41.428 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:15:41.428 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:15:41.428 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:15:41.428 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:15:41.428 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:15:41.428 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:15:41.428 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:15:41.428 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:15:41.428 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:15:41.428 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:15:41.428 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:15:41.428 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:15:41.428 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:15:41.429 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:15:41.429 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:15:41.429 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:15:41.429 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:15:41.429 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:15:41.429 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:15:41.429 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:15:41.429 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:15:41.429 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:15:41.429 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:15:41.429 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:15:41.429 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:15:41.429 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:15:41.430 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:15:41.430 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:15:41.430 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:15:41.430 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:15:41.430 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:15:41.430 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:15:41.430 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:15:41.430 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:15:41.430 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:15:41.430 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:15:41.430 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:15:41.430 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:15:41.430 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:15:41.430 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:15:41.431 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:15:41.431 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:15:41.431 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:15:41.431 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:15:41.431 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:15:41.431 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:15:41.431 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:15:41.431 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:15:41.431 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:15:41.431 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:15:41.431 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:15:41.431 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:15:41.431 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:15:41.432 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:15:41.432 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:15:41.432 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:15:41.432 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:15:41.432 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:15:41.432 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:15:41.432 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:15:41.432 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:15:41.432 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:15:41.432 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:15:41.432 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:15:41.432 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:15:41.432 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:15:41.433 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:15:41.433 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:15:41.433 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:15:41.433 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:15:41.433 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:15:41.433 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:15:41.433 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:15:41.433 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:15:41.433 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:15:41.433 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:15:41.433 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:15:41.433 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:15:41.433 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:15:41.433 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:15:41.434 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:15:41.434 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:15:41.434 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:15:41.434 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:15:41.434 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:15:41.434 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:15:41.434 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:15:41.434 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:15:41.434 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:15:41.434 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:15:41.434 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:15:41.434 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:15:41.434 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:15:41.435 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:15:41.435 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:15:41.435 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:15:41.435 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:15:41.435 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:15:41.435 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:15:41.435 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:15:41.435 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:15:41.435 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:15:41.435 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:15:41.435 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:15:41.435 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:15:41.435 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:15:41.435 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:15:41.436 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:15:41.436 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:15:41.436 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:15:41.436 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:15:41.436 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:15:41.436 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:15:41.436 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:15:41.436 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:15:41.436 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:15:41.436 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:15:41.436 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:15:41.436 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:15:41.436 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:15:41.436 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:15:41.437 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:15:41.437 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:15:41.437 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:15:41.437 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:15:41.437 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:15:41.437 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:15:41.437 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:15:41.437 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:15:41.437 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:15:41.437 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:15:41.437 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:15:41.437 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:15:41.437 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:15:41.437 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:15:41.438 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:15:41.438 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:15:41.438 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:15:41.438 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:15:41.438 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:15:41.438 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:15:41.438 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:15:41.438 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:15:41.438 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:15:41.438 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:15:41.438 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:15:41.438 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:15:41.438 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:15:41.438 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:15:41.439 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:15:41.439 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:15:41.439 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:15:41.439 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:15:41.439 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:15:41.439 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:15:41.439 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:15:41.439 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:15:41.439 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:15:41.439 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:15:41.439 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:15:41.439 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:15:41.440 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:15:41.440 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:15:41.440 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:15:41.440 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:15:41.440 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:15:41.440 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:15:41.440 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:15:41.440 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:15:41.440 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:15:41.440 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:15:41.440 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:15:41.440 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:15:41.440 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:15:41.441 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:15:41.441 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:15:41.441 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:15:41.441 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:15:41.441 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:15:41.441 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:15:41.441 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:15:41.441 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:15:41.441 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:15:41.441 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:15:41.441 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:15:41.441 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:15:41.442 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:15:41.442 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:15:41.442 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:15:41.442 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:15:41.442 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:15:41.442 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:15:41.442 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:15:41.442 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:15:41.442 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:15:41.442 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:15:41.442 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:15:41.442 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:15:41.442 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:15:41.443 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:15:41.443 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:15:41.443 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:15:41.443 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:15:41.443 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:15:41.443 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:15:41.443 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:15:41.443 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:15:41.443 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:15:41.443 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:15:41.443 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:15:41.443 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:15:41.444 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:15:41.444 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:15:41.444 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:15:41.444 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:15:41.444 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:15:41.444 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:15:41.444 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:15:41.444 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:15:41.444 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:15:41.444 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:15:41.444 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:15:41.444 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:15:41.444 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:15:41.445 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:15:41.445 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:15:41.445 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:15:41.445 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:15:41.445 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:15:41.445 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:15:41.445 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:15:41.445 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:15:41.445 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:15:41.445 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:15:41.445 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:15:41.445 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:15:41.445 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:15:41.445 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:15:41.446 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:15:41.446 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:15:41.446 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:15:41.446 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:15:41.446 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:15:41.446 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:15:41.446 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:15:41.446 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:15:41.446 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:15:41.446 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:15:41.446 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:15:41.446 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:15:41.446 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:15:41.447 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:15:41.447 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:15:41.447 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:15:41.447 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:15:41.447 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:15:41.447 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:15:41.447 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:15:41.447 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:15:41.447 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:15:41.447 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:15:41.447 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:15:41.447 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:15:41.447 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:15:41.447 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:15:41.448 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:15:41.448 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:15:41.448 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:15:41.448 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:15:41.448 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:15:41.448 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:15:41.448 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:15:41.448 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:15:41.448 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:15:41.448 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:15:41.448 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:15:41.448 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:15:41.449 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:15:41.449 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:15:41.449 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:15:41.449 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:15:41.449 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:15:41.449 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:15:41.449 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:15:41.449 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:15:41.449 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:15:41.449 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:15:41.449 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:15:41.449 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:15:41.449 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:15:41.449 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:15:41.450 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:15:41.450 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:15:41.450 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:15:41.450 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:15:41.450 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:15:41.450 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:15:41.450 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:15:41.450 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:15:41.450 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:15:41.450 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:15:41.450 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:15:41.450 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:15:41.450 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:15:41.451 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:15:41.451 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:15:41.451 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:15:41.451 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:15:41.451 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:15:41.451 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:15:41.451 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:15:41.451 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:15:41.451 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:15:41.452 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:15:41.453 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:15:41.453 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:15:41.453 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:15:41.453 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:15:41.453 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:15:41.453 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:15:41.453 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:15:41.453 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:15:41.453 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:15:41.454 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:15:41.454 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:15:41.454 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:15:41.454 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:15:41.454 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:15:41.454 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:15:41.454 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:15:41.454 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:15:41.454 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:15:41.454 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:15:41.454 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:15:41.454 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:15:41.454 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:15:41.455 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:15:41.455 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:15:41.455 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:15:41.455 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:15:41.455 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:15:41.455 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:15:41.455 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:15:41.455 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:15:41.455 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:15:41.455 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:15:41.456 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:15:41.456 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:15:41.456 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:15:41.456 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:15:41.456 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:15:41.456 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:15:41.456 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:15:41.456 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:15:41.456 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:15:41.456 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:15:41.456 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:15:41.456 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:15:41.456 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:15:41.457 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:15:41.457 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:15:41.457 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:15:41.457 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:15:41.457 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:15:41.457 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:15:41.457 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:15:41.457 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:15:41.457 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:15:41.457 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:15:41.457 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:15:41.457 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:15:41.457 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:15:41.457 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:15:41.458 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:15:41.458 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:15:41.458 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:15:41.458 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:15:41.458 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:15:41.458 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:15:41.458 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:15:41.458 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:15:41.458 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:15:41.458 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:15:41.458 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:15:41.458 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:15:41.458 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:15:41.458 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:15:41.459 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:15:41.459 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:15:41.459 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:15:41.459 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:15:41.459 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:15:41.459 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:15:41.459 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:15:41.459 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:15:41.459 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:15:41.460 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:15:41.460 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:15:41.460 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:15:41.460 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:15:41.460 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:15:41.460 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:15:41.460 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:15:41.460 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:15:41.460 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:15:41.461 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:15:41.461 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:15:41.461 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:15:41.461 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:15:41.461 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:15:41.461 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:15:41.461 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:15:41.461 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:15:41.462 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:15:41.462 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:15:41.462 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:15:41.462 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:15:41.462 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:15:41.462 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:15:41.462 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:15:41.462 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:15:41.462 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:15:41.462 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:15:41.462 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:15:41.462 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:15:41.462 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:15:41.463 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:15:41.463 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:15:41.463 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:15:41.463 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:15:41.463 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:15:41.463 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:15:41.463 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:15:41.463 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:15:41.463 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:15:41.463 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:15:41.463 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:15:41.463 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:15:41.463 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:15:41.463 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:15:41.464 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:15:41.464 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:15:41.464 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:15:41.464 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:15:41.464 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:15:41.464 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:15:41.464 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:15:41.464 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:15:41.464 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:15:41.464 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:15:41.464 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:15:41.464 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:15:41.464 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:15:41.464 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:15:41.465 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:15:41.465 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:15:41.465 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:15:41.465 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:15:41.465 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:15:41.465 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:15:41.465 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:15:41.465 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:15:41.465 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:15:41.465 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:15:41.465 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:15:41.465 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:15:41.465 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:15:41.466 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:15:41.466 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:15:41.466 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:15:41.466 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:15:41.466 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:15:41.466 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:15:41.466 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:15:41.466 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:15:41.466 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:15:41.466 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:15:41.466 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:15:41.466 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:15:41.466 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:15:41.467 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:15:41.467 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:15:41.467 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:15:41.467 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:15:41.467 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:15:41.467 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:15:41.467 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:15:41.467 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:15:41.467 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:15:41.467 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:15:41.467 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:15:41.467 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:15:41.467 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:15:41.468 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:15:41.468 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:15:41.468 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:15:41.468 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:15:41.468 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:15:41.468 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:15:41.468 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:15:41.468 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:15:41.468 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:15:41.468 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:15:41.468 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:15:41.468 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:15:41.468 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:15:41.469 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:15:41.469 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:15:41.469 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:15:41.469 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:15:41.469 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:15:41.469 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:15:41.469 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:15:41.469 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:15:41.469 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:15:41.469 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:15:41.469 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:15:41.470 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:15:41.470 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:15:41.470 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:15:41.470 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:15:41.470 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:15:41.470 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:15:41.470 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:15:41.470 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:15:41.470 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:15:41.470 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:15:41.470 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:15:41.470 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:15:41.470 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:15:41.471 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:15:41.471 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:15:41.471 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:15:41.471 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:15:41.471 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:15:41.471 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:15:41.471 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:15:41.471 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:15:41.471 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:15:41.472 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:15:41.472 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:15:41.472 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:15:41.472 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:15:41.472 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:15:41.472 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:15:41.472 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:15:41.472 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:15:41.472 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:15:41.472 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:15:41.472 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:15:41.472 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:15:41.472 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:15:41.473 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:15:41.473 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:15:41.473 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:15:41.473 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:15:41.473 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:15:41.473 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:15:41.473 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:15:41.473 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:15:41.473 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:15:41.473 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:15:41.473 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:15:41.473 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:15:41.473 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:15:41.473 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:15:41.474 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:15:41.474 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:15:41.474 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:15:41.474 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:15:41.474 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:15:41.474 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:15:41.474 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:15:41.474 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:15:41.474 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:15:41.475 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:15:41.475 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:15:41.475 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:15:41.475 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:15:41.475 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:15:41.475 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:15:41.475 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:15:41.475 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:15:41.475 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:15:41.475 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:15:41.475 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:15:41.475 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:15:41.475 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:15:41.475 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:15:41.476 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:15:41.476 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:15:41.476 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:15:41.476 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:15:41.476 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:15:41.476 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:15:41.476 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:15:41.476 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:15:41.476 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:15:41.476 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:15:41.476 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:15:41.476 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:15:41.476 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:15:41.476 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:15:41.477 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:15:41.477 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:15:41.477 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:15:41.477 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:15:41.477 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:15:41.477 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:15:41.477 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:15:41.477 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:15:41.477 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:15:41.477 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:15:41.477 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:15:41.477 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:15:41.477 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:15:41.478 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:15:41.478 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:15:41.478 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:15:41.478 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:15:41.478 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:15:41.478 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:15:41.478 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:15:41.478 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:15:41.478 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:15:41.478 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:15:41.478 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:15:41.478 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:15:41.478 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:15:41.478 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:15:41.479 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:15:41.479 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:15:41.479 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:15:41.479 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:15:41.479 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:15:41.479 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:15:41.479 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:15:41.479 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:15:41.479 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:15:41.479 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:15:41.479 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:15:41.479 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:15:41.479 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:15:41.479 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:15:41.479 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:15:41.480 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:15:41.480 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:15:41.480 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:15:41.480 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:15:41.480 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:15:41.480 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:15:41.480 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:15:41.480 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:15:41.480 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:15:41.480 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:15:41.480 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:15:41.480 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:15:41.480 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:15:41.481 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:15:41.481 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:15:41.481 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:15:41.481 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:15:41.481 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:15:41.481 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:15:41.481 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:15:41.481 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:15:41.481 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:15:41.481 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:15:41.481 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:15:41.481 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:15:41.481 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:15:41.481 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:15:41.482 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:15:41.482 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:15:41.482 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:15:41.482 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:15:41.482 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:15:41.482 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:15:41.482 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:15:41.482 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:15:41.482 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:15:41.482 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:15:41.482 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:15:41.482 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:15:41.482 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:15:41.483 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:15:41.483 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:15:41.483 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:15:41.483 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:15:41.483 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:15:41.483 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:15:41.483 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:15:41.483 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:15:41.483 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:15:41.483 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:15:41.483 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:15:41.483 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:15:41.483 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:15:41.483 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:15:41.484 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:15:41.484 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:15:41.484 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:15:41.484 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:15:41.484 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:15:41.484 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:15:41.484 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:15:41.484 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:15:41.484 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:15:41.484 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:15:41.484 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:15:41.484 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:15:41.484 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:15:41.485 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:15:41.485 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:15:41.485 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:15:41.485 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:15:41.485 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:15:41.485 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:15:41.485 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:15:41.485 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:15:41.485 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:15:41.485 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:15:41.485 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:15:41.485 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:15:41.485 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:15:41.485 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:15:41.486 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:15:41.486 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:15:41.486 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:15:41.486 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:15:41.486 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:15:41.486 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:15:41.486 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:15:41.486 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:15:41.486 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:15:41.486 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:15:41.486 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:15:41.486 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:15:41.486 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:15:41.487 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:15:41.487 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:15:41.487 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:15:41.487 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:15:41.487 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:15:41.487 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:15:41.487 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:15:41.487 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:15:41.487 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:15:41.487 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:15:41.487 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:15:41.487 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:15:41.487 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:15:41.487 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:15:41.487 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:15:41.488 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:15:41.488 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:15:41.488 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:15:41.488 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:15:41.488 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:15:41.488 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:15:41.488 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:15:41.488 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:15:41.488 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:15:41.488 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:15:41.488 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:15:41.488 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:15:41.488 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:15:41.488 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:15:41.489 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:15:41.489 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:15:41.489 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:15:41.489 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:15:41.489 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:15:41.489 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:15:41.489 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:15:41.489 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:15:41.489 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:15:41.489 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:15:41.489 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:15:41.489 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:15:41.489 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:15:41.489 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:15:41.490 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:15:41.490 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:15:41.490 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:15:41.490 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:15:41.490 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:15:41.490 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:15:41.490 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:15:41.490 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:15:41.490 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:15:41.490 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:15:41.490 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:15:41.491 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:15:41.491 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:15:41.491 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:15:41.491 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:15:41.491 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:15:41.491 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:15:41.491 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:15:41.491 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:15:41.491 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:15:41.491 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:15:41.491 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:15:41.492 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:15:41.492 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:15:41.492 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:15:41.492 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:15:41.492 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:15:41.492 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:15:41.492 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:15:41.492 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:15:41.492 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:15:41.492 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:15:41.492 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:15:41.492 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:15:41.492 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:15:41.492 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:15:41.493 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:15:41.493 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:15:41.493 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:15:41.493 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:15:41.493 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:15:41.493 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:15:41.493 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:15:41.493 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:15:41.493 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:15:41.493 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:15:41.493 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:15:41.493 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:15:41.493 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:15:41.493 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:15:41.494 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:15:41.494 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:15:41.494 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:15:41.494 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:15:41.494 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:15:41.494 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:15:41.494 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:15:41.494 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:15:41.494 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:15:41.494 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:15:41.494 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:15:41.494 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:15:41.494 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:15:41.495 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:15:41.495 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:15:41.495 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:15:41.495 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:15:41.495 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:15:41.495 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:15:41.495 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:15:41.495 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:15:41.495 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:15:41.495 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:15:41.495 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:15:41.495 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:15:41.495 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:15:41.495 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:15:41.496 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:15:41.496 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:15:41.496 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:15:41.496 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:15:41.496 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:15:41.496 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:15:41.496 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:15:41.496 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:15:41.496 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:15:41.496 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:15:41.496 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:15:41.496 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:15:41.496 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:15:41.496 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:15:41.497 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:15:41.497 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:15:41.497 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:15:41.497 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:15:41.497 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:15:41.497 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:15:41.497 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:15:41.497 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:15:41.497 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:15:41.497 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:15:41.497 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:15:41.497 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:15:41.497 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:15:41.497 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:15:41.498 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:15:41.498 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:15:41.498 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:15:41.498 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:15:41.498 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:15:41.498 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:15:41.498 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:15:41.498 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:15:41.498 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:15:41.498 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:15:41.498 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:15:41.498 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:15:41.498 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:15:41.498 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:15:41.499 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:15:41.499 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:15:41.499 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:15:41.499 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:15:41.499 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:15:41.499 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:15:41.499 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:15:41.499 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:15:41.499 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:15:41.499 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:15:41.499 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:15:41.499 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:15:41.499 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:15:41.499 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:15:41.499 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:15:41.500 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:15:41.500 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:15:41.500 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:15:41.500 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:15:41.500 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:15:41.500 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:15:41.500 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:15:41.500 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:15:41.500 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:15:41.500 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:15:41.500 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:15:41.500 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:15:41.500 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:15:41.501 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:15:41.501 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:15:41.501 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:15:41.501 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:15:41.501 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:15:41.501 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:15:41.501 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:15:41.501 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:15:41.501 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:15:41.501 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:15:41.501 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:15:41.501 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:15:41.501 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:15:41.502 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:15:41.502 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:15:41.502 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:15:41.502 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:15:41.502 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:15:41.502 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:15:41.502 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:15:41.502 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:15:41.502 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:15:41.502 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:15:41.502 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:15:41.502 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:15:41.502 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:15:41.502 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:15:41.503 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:15:41.503 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:15:41.503 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:15:41.503 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:15:41.503 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:15:41.503 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:15:41.503 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:15:41.503 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:15:41.503 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:15:41.503 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:15:41.503 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:15:41.503 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:15:41.503 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:15:41.503 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:15:41.504 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:15:41.504 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:15:41.504 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:15:41.504 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:15:41.504 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:15:41.504 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:15:41.504 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:15:41.504 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:15:41.504 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:15:41.504 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:15:41.504 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:15:41.504 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:15:41.504 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:15:41.505 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:15:41.505 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:15:41.505 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:15:41.505 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:15:41.505 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:15:41.505 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:15:41.505 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:15:41.505 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:15:41.505 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:15:41.505 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:15:41.505 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:15:41.505 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:15:41.505 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:15:41.505 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:15:41.506 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:15:41.506 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:15:41.506 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:15:41.506 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:15:41.506 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:15:41.506 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:15:41.506 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:15:41.506 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:15:41.506 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:15:41.506 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:15:41.506 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:15:41.506 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:15:41.506 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:15:41.506 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:15:41.507 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:15:41.507 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:15:41.507 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:15:41.507 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:15:41.507 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:15:41.507 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:15:41.507 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:15:41.507 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:15:41.507 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:15:41.507 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:15:41.507 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:15:41.507 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:15:41.507 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:15:41.507 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:15:41.508 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:15:41.508 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:15:41.508 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:15:41.508 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:15:41.508 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:15:41.508 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:15:41.508 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:15:41.508 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:15:41.508 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:15:41.508 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:15:41.508 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:15:41.508 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:15:41.508 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:15:41.508 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:15:41.509 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:15:41.509 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:15:41.509 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:15:41.509 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:15:41.509 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:15:41.509 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:15:41.509 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:15:41.509 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:15:41.509 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:15:41.509 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:15:41.509 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:15:41.509 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:15:41.509 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:15:41.509 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:15:41.510 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:15:41.510 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:15:41.510 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:15:41.510 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:15:41.510 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:15:41.510 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:15:41.510 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:15:41.510 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:15:41.510 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:15:41.510 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:15:41.510 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:15:41.510 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:15:41.510 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:15:41.511 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:15:41.511 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:15:41.511 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:15:41.511 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:15:41.511 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:15:41.511 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:15:41.511 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:15:41.511 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:15:41.511 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:15:41.511 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:15:41.511 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:15:41.511 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:15:41.511 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:15:41.511 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:15:41.512 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:15:41.512 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:15:41.512 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:15:41.512 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:15:41.512 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:15:41.512 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:15:41.512 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:15:41.512 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:15:41.512 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:15:41.512 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:15:41.512 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:15:41.512 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:15:41.512 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:15:41.512 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:15:41.513 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:15:41.513 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:15:41.513 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:15:41.513 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:15:41.513 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:15:41.513 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:15:41.513 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:15:41.513 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:15:41.513 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:15:41.513 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:15:41.513 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:15:41.513 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:15:41.513 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:15:41.513 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:15:41.514 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:15:41.514 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:15:41.514 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:15:41.514 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:15:41.514 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:15:41.514 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:15:41.514 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:15:41.514 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:15:41.514 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:15:41.514 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:15:41.514 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:15:41.514 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:15:41.514 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:15:41.514 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:15:41.514 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:15:41.515 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:15:41.515 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:15:41.515 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:15:41.515 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:15:41.515 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:15:41.515 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:15:41.515 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:15:41.515 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:15:41.515 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:15:41.515 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:15:41.515 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:15:41.515 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:15:41.515 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:15:41.516 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:15:41.516 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:15:41.516 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:15:41.516 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:15:41.516 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:15:41.516 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:15:41.516 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:15:41.516 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:15:41.516 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:15:41.516 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:15:41.516 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:15:41.516 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:15:41.516 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:15:41.516 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:15:41.516 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:15:41.517 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:15:41.517 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:15:41.517 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:15:41.517 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:15:41.517 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:15:41.517 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:15:41.517 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:15:41.517 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:15:41.517 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:15:41.517 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:15:41.517 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:15:41.517 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:15:41.517 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:15:41.518 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:15:41.518 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:15:41.518 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:15:41.518 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:15:41.518 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:15:41.518 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:15:41.518 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:15:41.518 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:15:41.518 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:15:41.518 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:15:41.518 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:15:41.518 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:15:41.518 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:15:41.519 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:15:41.519 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:15:41.519 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:15:41.519 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:15:41.519 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:15:41.519 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:15:41.519 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:15:41.519 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:15:41.519 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:15:41.519 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:15:41.519 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:15:41.519 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:15:41.519 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:15:41.519 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:15:41.520 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:15:41.522 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:15:41.522 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:15:41.522 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:15:41.522 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:15:41.522 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:15:41.522 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:15:41.522 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:15:41.522 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:15:41.522 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:15:41.522 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:15:41.522 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:15:41.523 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:15:41.523 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:15:41.523 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:15:41.523 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:15:41.523 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:15:41.523 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:15:41.523 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:15:41.523 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:15:41.523 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:15:41.523 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:15:41.523 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:15:41.523 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:15:41.523 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:15:41.524 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:15:41.524 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:15:41.524 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:15:41.524 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:15:41.524 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:15:41.524 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:15:41.524 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:15:41.524 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:15:41.524 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:15:41.524 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:15:41.524 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:15:41.524 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:15:41.524 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:15:41.524 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:15:41.524 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:15:41.525 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:15:41.525 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:15:41.525 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:15:41.525 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:15:41.525 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:15:41.525 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:15:41.525 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:15:41.525 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:15:41.525 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:15:41.525 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:15:41.525 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:15:41.525 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:15:41.525 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:15:41.525 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:15:41.526 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:15:41.526 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:15:41.526 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:15:41.526 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:15:41.526 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:15:41.526 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:15:41.526 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:15:41.526 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:15:41.526 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:15:41.526 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:15:41.526 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:15:41.526 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:15:41.526 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:15:41.526 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:15:41.527 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:15:41.527 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:15:41.527 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:15:41.527 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:15:41.527 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:15:41.527 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:15:41.527 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:15:41.527 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:15:41.527 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:15:41.527 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:15:41.527 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:15:41.527 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:15:41.527 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:15:41.527 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:15:41.528 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:15:41.528 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:15:41.528 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:15:41.528 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:15:41.528 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:15:41.528 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:15:41.528 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:15:41.528 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:15:41.528 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:15:41.528 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:15:41.528 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:15:41.528 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:15:41.528 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:15:41.528 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:15:41.529 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:15:41.529 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:15:41.529 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:15:41.529 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:15:41.529 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:15:41.529 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:15:41.529 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:15:41.529 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:15:41.529 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:15:41.529 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:15:41.529 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:15:41.529 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:15:41.529 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:15:41.529 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:15:41.530 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:15:41.530 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:15:41.530 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:15:41.530 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:15:41.530 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:15:41.530 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:15:41.530 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:15:41.530 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:15:41.530 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:15:41.530 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:15:41.530 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:15:41.530 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:15:41.530 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:15:41.531 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:15:41.531 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:15:41.531 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:15:41.531 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:15:41.531 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:15:41.531 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:15:41.531 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:15:41.531 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:15:41.531 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:15:41.531 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:15:41.531 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:15:41.531 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:15:41.531 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:15:41.531 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:15:41.531 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:15:41.532 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:15:41.532 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:15:41.532 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:15:41.532 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:15:41.532 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:15:41.532 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:15:41.532 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:15:41.532 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:15:41.532 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:15:41.532 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:15:41.532 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:15:41.532 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:15:41.532 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:15:41.532 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:15:41.533 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:15:41.533 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:15:41.533 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:15:41.533 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:15:41.533 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:15:41.533 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:15:41.533 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:15:41.533 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:15:41.533 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:15:41.533 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:15:41.533 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:15:41.533 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:15:41.533 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:15:41.533 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:15:41.534 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:15:41.534 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:15:41.534 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:15:41.534 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:15:41.534 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:15:41.534 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:15:41.534 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:15:41.534 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:15:41.534 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:15:41.534 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:15:41.534 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:15:41.534 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:15:41.534 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:15:41.534 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:15:41.535 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:15:41.535 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:15:41.535 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:15:41.535 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:15:41.535 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:15:41.535 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:15:41.535 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:15:41.535 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:15:41.535 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:15:41.535 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:15:41.535 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:15:41.535 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:15:41.535 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:15:41.535 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:15:41.536 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:15:41.536 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:15:41.536 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:15:41.536 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:15:41.536 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:15:41.536 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:15:41.536 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:15:41.536 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:15:41.536 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:15:41.536 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:15:41.536 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:15:41.536 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:15:41.536 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:15:41.536 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:15:41.537 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:15:41.537 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:15:41.537 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:15:41.537 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:15:41.537 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:15:41.537 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:15:41.537 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:15:41.537 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:15:41.537 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:15:41.537 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:15:41.537 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:15:41.537 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:15:41.537 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:15:41.538 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:15:41.538 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:15:41.538 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:15:41.538 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:15:41.538 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:15:41.538 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:15:41.538 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:15:41.538 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:15:41.538 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:15:41.538 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:15:41.538 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:15:41.538 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:15:41.539 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:15:41.539 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:15:41.539 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:15:41.539 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:15:41.539 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:15:41.539 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:15:41.539 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:15:41.539 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:15:41.539 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:15:41.539 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:15:41.539 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:15:41.539 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:15:41.539 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:15:41.539 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:15:41.540 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:15:41.540 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:15:41.540 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:15:41.540 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:15:41.540 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:15:41.540 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:15:41.540 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:15:41.540 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:15:41.540 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:15:41.540 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:15:41.540 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:15:41.540 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:15:41.540 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:15:41.540 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:15:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:15:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:15:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:15:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:15:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:15:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:15:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:15:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:15:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:15:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:15:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:15:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:15:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:15:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:15:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:15:41.542 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:15:41.542 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:15:41.542 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:15:41.542 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:15:41.542 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:15:41.542 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:15:41.542 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:15:41.542 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:15:41.542 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:15:41.542 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:15:41.542 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:15:41.542 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:15:41.542 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:15:41.543 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:15:41.543 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:15:41.543 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:15:41.543 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:15:41.543 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:15:41.543 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:15:41.543 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:15:41.543 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:15:41.543 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:15:41.543 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:15:41.543 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:15:41.543 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:15:41.543 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:15:41.543 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:15:41.543 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:15:41.544 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:15:41.544 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:15:41.544 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:15:41.544 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:15:41.544 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:15:41.544 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:15:41.544 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:15:41.544 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:15:41.544 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:15:41.544 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:15:41.544 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:15:41.544 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:15:41.544 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:15:41.544 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:15:41.545 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:15:41.545 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:15:41.545 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:15:41.545 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:15:41.545 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:15:41.545 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:15:41.545 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:15:41.545 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:15:41.545 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:15:41.545 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:15:41.545 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:15:41.545 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:15:41.545 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:15:41.545 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:15:41.546 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:15:41.546 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:15:41.546 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:15:41.546 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:15:41.546 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:15:41.546 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:15:41.546 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:15:41.546 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:15:41.546 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:15:41.546 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:15:41.546 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:15:41.546 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:15:41.546 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:15:41.547 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:15:41.547 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:15:41.547 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:15:41.547 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:15:41.547 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:15:41.547 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:15:41.547 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:15:41.547 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:15:41.547 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:15:41.547 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:15:41.547 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:15:41.547 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:15:41.547 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:15:41.547 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:15:41.548 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:15:41.548 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:15:41.548 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:15:41.548 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:15:41.548 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:15:41.548 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:15:41.548 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:15:41.548 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:15:41.548 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:15:41.548 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:15:41.548 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:15:41.548 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:15:41.548 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:15:41.548 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:15:41.548 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:15:41.549 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:15:41.549 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:15:41.549 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:15:41.549 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:15:41.549 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:15:41.549 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:15:41.549 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:15:41.549 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:15:41.549 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:15:41.549 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:15:41.549 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:15:41.549 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:15:41.549 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:15:41.549 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:15:41.550 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:15:41.550 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:15:41.550 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:15:41.550 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:15:41.550 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:15:41.550 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:15:41.550 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:15:41.550 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:15:41.550 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:15:41.550 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:15:41.550 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:15:41.550 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:15:41.550 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:15:41.550 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:15:41.550 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:15:41.551 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:15:41.551 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:15:41.551 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:15:41.551 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:15:41.551 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:15:41.551 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:15:41.551 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:15:41.551 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:15:41.551 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:15:41.551 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:15:41.551 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:15:41.551 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:15:41.551 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:15:41.551 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:15:41.552 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:15:41.552 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:15:41.552 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:15:41.552 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:15:41.552 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:15:41.552 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:15:41.552 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:15:41.552 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:15:41.552 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:15:41.552 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:15:41.552 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:15:41.552 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:15:41.552 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:15:41.553 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:15:41.553 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:15:41.553 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:15:41.553 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:15:41.553 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:15:41.553 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:15:41.553 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:15:41.553 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:15:41.553 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:15:41.553 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:15:41.553 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:15:41.553 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:15:41.553 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:15:41.554 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:15:41.554 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:15:41.554 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:15:41.554 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:15:41.554 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:15:41.554 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:15:41.554 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:15:41.554 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:15:41.554 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:15:41.554 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:15:41.554 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:15:41.554 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:15:41.554 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:15:41.555 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:15:41.555 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:15:41.555 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:15:41.555 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:15:41.555 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:15:41.555 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:15:41.555 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:15:41.555 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:15:41.555 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:15:41.555 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:15:41.555 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:15:41.555 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:15:41.555 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:15:41.555 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:15:41.556 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:15:41.556 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:15:41.556 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:15:41.556 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:15:41.556 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:15:41.556 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:15:41.556 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:15:41.556 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:15:41.556 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:15:41.556 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:15:41.556 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:15:41.556 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:15:41.557 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:15:41.557 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:15:41.557 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:15:41.557 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:15:41.557 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:15:41.557 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:15:41.557 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:15:41.557 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:15:41.557 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:15:41.557 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:15:41.557 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:15:41.557 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:15:41.557 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:15:41.557 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:15:41.558 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:15:41.558 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:15:41.558 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:15:41.558 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:15:41.558 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:15:41.558 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:15:41.558 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:15:41.558 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:15:41.558 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:15:41.558 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:15:41.558 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:15:41.558 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:15:41.558 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:15:41.559 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:15:41.559 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:15:41.559 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:15:41.559 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:15:41.559 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:15:41.559 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:15:41.559 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:15:41.559 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:15:41.559 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:15:41.559 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:15:41.559 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:15:41.559 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:15:41.559 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:15:41.560 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:15:41.560 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:15:41.560 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:15:41.560 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:15:41.560 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:15:41.560 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:15:41.560 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:15:41.560 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:15:41.560 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:15:41.560 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:15:41.561 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:15:41.561 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:15:41.561 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:15:41.561 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:15:41.561 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:15:41.561 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:15:41.561 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:15:41.561 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:15:41.561 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:15:41.561 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:15:41.561 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:15:41.561 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:15:41.561 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:15:41.561 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:15:41.562 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:15:41.562 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:15:41.562 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:15:41.562 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:15:41.562 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:15:41.562 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:15:41.562 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:15:41.562 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:15:41.562 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:15:41.562 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:15:41.562 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:15:41.562 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:15:41.562 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:15:41.563 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:15:41.563 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:15:41.563 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:15:41.563 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:15:41.563 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:15:41.563 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:15:41.563 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:15:41.563 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:15:41.563 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:15:41.563 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:15:41.563 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:15:41.563 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:15:41.563 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:15:41.563 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:15:41.564 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:15:41.564 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:15:41.564 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:15:41.564 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:15:41.564 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:15:41.564 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:15:41.564 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:15:41.564 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:15:41.564 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:15:41.564 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:15:41.564 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:15:41.564 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:15:41.564 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:15:41.564 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:15:41.565 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:15:41.565 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:15:41.565 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:15:41.565 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:15:41.565 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:15:41.565 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:15:41.565 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:15:41.565 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:15:41.565 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:15:41.565 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:15:41.565 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:15:41.565 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:15:41.565 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:15:41.565 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:15:41.565 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:15:41.566 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:15:41.566 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:15:41.566 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:15:41.566 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:15:41.566 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:15:41.566 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:15:41.566 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:15:41.566 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:15:41.566 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:15:41.566 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:15:41.566 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:15:41.566 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:15:41.566 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:15:41.566 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:15:41.567 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:15:41.567 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:15:41.567 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:15:41.567 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:15:41.567 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:15:41.567 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:15:41.567 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:15:41.567 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:15:41.567 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:15:41.567 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:15:41.567 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:15:41.567 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:15:41.567 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:15:41.567 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:15:41.567 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:15:41.568 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:15:41.568 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:15:41.568 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:15:41.568 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:15:41.568 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:15:41.568 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:15:41.568 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:15:41.568 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:15:41.568 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:15:41.568 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:15:41.568 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:15:41.568 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:15:41.569 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:15:41.569 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:15:41.569 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:15:41.569 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:15:41.569 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:15:41.569 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:15:41.569 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:15:41.569 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:15:41.569 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:15:41.569 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:15:41.569 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:15:41.569 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:15:41.569 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:15:41.570 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:15:41.570 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:15:41.570 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:15:41.570 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:15:41.570 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:15:41.570 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:15:41.570 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:15:41.570 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:15:41.570 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:15:41.570 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:15:41.570 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:15:41.570 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:15:41.570 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:15:41.571 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:15:41.571 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:15:41.571 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:15:41.571 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:15:41.571 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:15:41.571 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:15:41.571 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:15:41.571 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:15:41.571 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:15:41.571 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:15:41.571 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:15:41.571 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:15:41.571 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:15:41.571 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:15:41.571 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:15:41.572 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:15:41.572 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:15:41.572 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:15:41.572 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:15:41.576 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:41.576 DEBUG:teuthology.orchestra.run.smithi006:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:15:41.603 INFO:teuthology.orchestra.run.smithi006.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:15:41.603 INFO:teuthology.orchestra.run.smithi006.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:15:41.603 INFO:teuthology.orchestra.run.smithi006.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:15:41.603 INFO:teuthology.orchestra.run.smithi006.stdout:fi 2024-08-17T02:15:41.603 INFO:teuthology.orchestra.run.smithi006.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:15:41.603 INFO:teuthology.orchestra.run.smithi006.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:15:41.603 INFO:teuthology.orchestra.run.smithi006.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:15:41.603 INFO:teuthology.orchestra.run.smithi006.stdout: fi 2024-08-17T02:15:41.603 INFO:teuthology.orchestra.run.smithi006.stdout:done 2024-08-17T02:15:41.603 INFO:teuthology.orchestra.run.smithi006.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:15:41.604 INFO:teuthology.orchestra.run.smithi006.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:15:41.604 INFO:teuthology.orchestra.run.smithi006.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:15:41.604 INFO:teuthology.orchestra.run.smithi006.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:15:41.604 INFO:teuthology.orchestra.run.smithi006.stdout:fi 2024-08-17T02:15:41.604 INFO:teuthology.orchestra.run.smithi006.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:15:41.604 INFO:teuthology.orchestra.run.smithi006.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:41.604 INFO:teuthology.orchestra.run.smithi006.stdout:fi 2024-08-17T02:15:41.604 INFO:teuthology.orchestra.run.smithi006.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:15:41.604 INFO:teuthology.orchestra.run.smithi006.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:15:41.604 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:41.604 INFO:teuthology.orchestra.run.smithi006.stdout:fi 2024-08-17T02:15:41.605 DEBUG:teuthology.orchestra.run.smithi006:> sudo rpm -qi grub2-tools 2024-08-17T02:15:41.692 INFO:teuthology.orchestra.run.smithi006.stdout:Name : grub2-tools 2024-08-17T02:15:41.692 INFO:teuthology.orchestra.run.smithi006.stdout:Epoch : 1 2024-08-17T02:15:41.692 INFO:teuthology.orchestra.run.smithi006.stdout:Version : 2.06 2024-08-17T02:15:41.692 INFO:teuthology.orchestra.run.smithi006.stdout:Release : 68.el9 2024-08-17T02:15:41.692 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: x86_64 2024-08-17T02:15:41.692 INFO:teuthology.orchestra.run.smithi006.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:15:41.692 INFO:teuthology.orchestra.run.smithi006.stdout:Group : Unspecified 2024-08-17T02:15:41.693 INFO:teuthology.orchestra.run.smithi006.stdout:Size : 8264254 2024-08-17T02:15:41.693 INFO:teuthology.orchestra.run.smithi006.stdout:License : GPLv3+ 2024-08-17T02:15:41.693 INFO:teuthology.orchestra.run.smithi006.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:15:41.693 INFO:teuthology.orchestra.run.smithi006.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:15:41.693 INFO:teuthology.orchestra.run.smithi006.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:15:41.693 INFO:teuthology.orchestra.run.smithi006.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:15:41.693 INFO:teuthology.orchestra.run.smithi006.stdout:Packager : builder@centos.org 2024-08-17T02:15:41.693 INFO:teuthology.orchestra.run.smithi006.stdout:Vendor : CentOS 2024-08-17T02:15:41.693 INFO:teuthology.orchestra.run.smithi006.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:15:41.693 INFO:teuthology.orchestra.run.smithi006.stdout:Summary : Support tools for GRUB. 2024-08-17T02:15:41.693 INFO:teuthology.orchestra.run.smithi006.stdout:Description : 2024-08-17T02:15:41.693 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:15:41.693 INFO:teuthology.orchestra.run.smithi006.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:15:41.694 INFO:teuthology.orchestra.run.smithi006.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:15:41.694 INFO:teuthology.orchestra.run.smithi006.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:15:41.694 INFO:teuthology.orchestra.run.smithi006.stdout:hardware devices. 2024-08-17T02:15:41.694 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:15:41.694 INFO:teuthology.orchestra.run.smithi006.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:15:41.695 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:15:41.695 INFO:teuthology.task.kernel:Updating grub on smithi006 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:41.695 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:15:41.842 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:15:42.196 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2024-08-17T02:15:43.630 INFO:teuthology.orchestra.run.smithi006.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:15:43.667 INFO:teuthology.orchestra.run.smithi006.stderr:done 2024-08-17T02:15:43.669 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-08-17T02:15:43.685 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.9T6bWfZxag 2024-08-17T02:15:43.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9T6bWfZxag 2024-08-17T02:15:43.759 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.9T6bWfZxag 2024-08-17T02:15:43.898 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.9T6bWfZxag is 6KB 2024-08-17T02:15:43.948 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.9T6bWfZxag 2024-08-17T02:15:43.963 DEBUG:teuthology.orchestra.run.smithi006:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:15:44.025 INFO:teuthology.orchestra.run.smithi006.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:15:44.026 INFO:teuthology.orchestra.run.smithi006.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:15:44.026 INFO:teuthology.orchestra.run.smithi006.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:15:44.026 INFO:teuthology.orchestra.run.smithi006.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:15:44.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:44.180 DEBUG:teuthology.orchestra.run.smithi006:> sudo shutdown -r now 2024-08-17T02:16:14.184 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-17T02:16:14.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-08-17T02:16:14.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:20.821 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi136.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:16:20.821 DEBUG:teuthology.orchestra.run.smithi136:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:16:20.902 INFO:teuthology.orchestra.run.smithi136.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:20.902 INFO:teuthology.orchestra.run.smithi136.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:20.902 INFO:teuthology.orchestra.run.smithi136.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:20.902 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:20.903 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:16:20.903 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:16:20.903 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:16:20.903 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:16:20.903 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:16:20.903 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:16:20.903 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:16:20.903 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:16:20.903 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:16:20.903 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:16:20.903 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:16:20.903 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:16:20.903 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:16:20.904 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:16:20.904 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:16:20.904 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:16:20.904 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:16:20.904 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:16:20.904 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:16:20.904 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:16:20.904 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:16:20.904 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:16:20.904 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:16:20.904 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:16:20.904 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:16:20.904 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:16:20.904 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:16:20.905 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:16:20.905 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:16:20.905 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:16:20.905 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:16:20.905 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:16:20.905 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:16:20.905 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:16:20.905 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:16:20.905 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:16:20.905 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:16:20.905 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:16:20.905 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:16:20.905 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:16:20.905 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:16:20.906 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:16:20.906 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:16:20.906 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:16:20.906 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:16:20.906 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:16:20.906 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:16:20.906 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:16:20.906 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:16:20.906 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:16:20.906 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:16:20.906 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:16:20.906 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:16:20.906 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:16:20.907 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:16:20.907 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:16:20.907 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:16:20.907 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:16:20.907 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:16:20.907 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:16:20.907 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:16:20.907 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:16:20.907 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:16:20.907 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:16:20.907 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:16:20.907 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:16:20.908 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:16:20.908 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:16:20.908 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:16:20.908 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:16:20.908 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:16:20.908 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:16:20.908 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:16:20.908 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:16:20.908 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:16:20.908 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:16:20.908 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:16:20.908 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:16:20.908 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:16:20.909 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:16:20.909 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:16:20.909 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:16:20.909 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:16:20.909 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:16:20.909 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:16:20.909 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:16:20.909 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:16:20.909 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:16:20.909 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:16:20.909 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:16:20.909 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:16:20.909 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:16:20.909 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:16:20.909 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:16:20.910 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:16:20.910 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:16:20.910 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:16:20.910 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:16:20.910 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:16:20.910 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:16:20.910 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:16:20.910 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:16:20.910 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:16:20.910 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:16:20.910 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:16:20.910 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:16:20.910 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:16:20.911 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:16:20.911 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:16:20.911 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:16:20.911 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:16:20.911 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:16:20.911 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:16:20.911 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:16:20.911 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:16:20.911 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:16:20.911 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:16:20.911 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:16:20.911 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:16:20.911 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:16:20.911 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:16:20.912 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:16:20.912 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:16:20.912 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:16:20.912 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:16:20.912 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:16:20.912 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:16:20.912 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:16:20.912 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:16:20.912 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:16:20.912 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:16:20.912 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:16:20.912 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:16:20.912 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:16:20.912 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:16:20.913 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:16:20.913 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:16:20.913 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:16:20.913 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:16:20.913 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:16:20.913 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:16:20.913 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:16:20.913 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:16:20.913 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:16:20.913 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:16:20.913 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:16:20.913 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:16:20.913 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:16:20.913 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:16:20.914 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:16:20.914 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:16:20.914 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:16:20.914 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:16:20.914 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:16:20.914 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:16:20.914 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:16:20.914 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:16:20.914 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:16:20.914 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:16:20.914 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:16:20.914 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:16:20.914 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:16:20.914 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:16:20.915 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:16:20.915 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:16:20.915 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:16:20.915 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:16:20.915 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:16:20.915 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:16:20.915 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:16:20.915 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:16:20.915 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:16:20.915 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:16:20.915 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:16:20.915 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:16:20.915 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:16:20.915 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:16:20.916 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:16:20.916 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:16:20.916 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:16:20.916 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:16:20.916 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:16:20.916 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:16:20.916 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:16:20.916 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:16:20.916 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:16:20.916 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:16:20.916 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:16:20.916 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:16:20.916 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:16:20.916 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:16:20.917 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:16:20.917 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:16:20.917 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:16:20.917 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:16:20.917 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:16:20.917 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:16:20.917 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:16:20.917 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:16:20.917 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:16:20.917 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:16:20.917 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:16:20.917 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:16:20.917 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:16:20.917 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:16:20.917 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:16:20.918 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:16:20.918 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:16:20.918 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:16:20.918 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:16:20.918 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:16:20.918 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:16:20.918 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:16:20.918 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:16:20.918 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:16:20.918 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:16:20.918 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:16:20.918 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:16:20.918 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:16:20.918 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:16:20.919 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:16:20.919 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:16:20.919 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:16:20.919 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:16:20.919 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:16:20.919 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:16:20.919 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:16:20.919 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:16:20.919 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:16:20.919 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:16:20.919 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:16:20.919 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:16:20.919 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:16:20.920 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:16:20.920 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:16:20.920 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:16:20.920 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:16:20.920 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:16:20.920 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:16:20.920 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:16:20.920 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:16:20.920 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:16:20.920 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:16:20.920 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:16:20.920 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:16:20.920 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:16:20.921 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:16:20.921 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:16:20.921 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:16:20.921 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:16:20.921 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:16:20.922 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:16:20.923 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:16:20.923 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:16:20.923 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:16:20.923 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:16:20.923 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:16:20.923 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:16:20.923 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:16:20.923 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:16:20.923 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:16:20.924 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:16:20.924 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:16:20.924 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:16:20.924 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:16:20.924 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:16:20.924 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:16:20.925 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:16:20.925 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:16:20.925 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:16:20.925 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:16:20.925 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:16:20.925 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:16:20.925 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:16:20.925 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:16:20.925 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:16:20.925 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:16:20.925 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:16:20.925 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:16:20.925 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:16:20.926 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:16:20.926 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:16:20.926 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:16:20.926 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:16:20.926 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:16:20.926 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:16:20.926 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:16:20.926 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:16:20.926 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:16:20.926 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:16:20.926 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:16:20.927 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:16:20.927 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:16:20.927 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:16:20.927 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:16:20.927 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:16:20.927 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:16:20.927 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:16:20.927 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:16:20.927 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:16:20.927 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:16:20.927 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:16:20.927 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:16:20.927 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:16:20.928 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:16:20.928 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:16:20.928 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:16:20.928 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:16:20.928 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:16:20.928 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:16:20.928 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:16:20.928 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:16:20.928 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:16:20.928 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:16:20.928 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:16:20.928 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:16:20.928 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:16:20.928 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:16:20.928 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:16:20.929 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:16:20.929 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:16:20.929 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:16:20.929 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:16:20.929 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:16:20.929 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:16:20.929 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:16:20.929 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:16:20.929 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:16:20.929 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:16:20.929 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:16:20.929 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:16:20.929 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:16:20.929 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:16:20.930 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:16:20.930 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:16:20.930 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:16:20.930 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:16:20.930 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:16:20.930 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:16:20.930 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:16:20.930 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:16:20.930 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:16:20.930 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:16:20.930 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:16:20.930 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:16:20.930 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:16:20.930 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:16:20.931 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:16:20.931 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:16:20.931 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:16:20.931 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:16:20.931 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:16:20.931 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:16:20.931 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:16:20.931 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:16:20.931 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:16:20.931 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:16:20.931 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:16:20.931 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:16:20.931 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:16:20.931 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:16:20.932 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:16:20.932 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:16:20.932 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:16:20.932 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:16:20.932 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:16:20.932 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:16:20.932 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:16:20.932 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:16:20.932 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:16:20.932 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:16:20.932 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:16:20.932 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:16:20.932 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:16:20.932 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:16:20.933 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:16:20.933 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:16:20.933 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:16:20.933 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:16:20.933 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:16:20.933 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:16:20.933 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:16:20.933 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:16:20.933 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:16:20.933 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:16:20.933 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:16:20.933 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:16:20.933 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:16:20.933 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:16:20.934 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:16:20.934 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:16:20.934 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:16:20.934 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:16:20.934 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:16:20.934 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:16:20.934 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:16:20.934 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:16:20.934 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:16:20.934 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:16:20.934 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:16:20.934 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:16:20.934 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:16:20.934 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:16:20.935 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:16:20.935 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:16:20.935 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:16:20.935 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:16:20.935 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:16:20.935 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:16:20.935 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:16:20.935 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:16:20.935 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:16:20.935 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:16:20.935 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:16:20.935 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:16:20.935 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:16:20.935 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:16:20.936 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:16:20.936 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:16:20.936 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:16:20.936 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:16:20.936 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:16:20.936 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:16:20.936 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:16:20.936 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:16:20.936 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:16:20.936 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:16:20.936 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:16:20.936 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:16:20.936 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:16:20.936 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:16:20.937 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:16:20.937 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:16:20.937 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:16:20.937 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:16:20.937 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:16:20.937 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:16:20.937 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:16:20.937 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:16:20.937 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:16:20.937 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:16:20.937 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:16:20.937 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:16:20.937 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:16:20.937 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:16:20.937 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:16:20.938 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:16:20.938 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:16:20.938 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:16:20.938 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:16:20.938 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:16:20.938 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:16:20.938 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:16:20.938 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:16:20.938 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:16:20.938 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:16:20.938 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:16:20.938 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:16:20.938 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:16:20.938 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:16:20.939 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:16:20.939 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:16:20.939 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:16:20.939 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:16:20.939 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:16:20.939 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:16:20.939 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:16:20.939 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:16:20.939 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:16:20.939 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:16:20.939 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:16:20.939 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:16:20.939 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:16:20.940 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:16:20.940 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:16:20.940 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:16:20.940 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:16:20.940 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:16:20.940 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:16:20.940 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:16:20.940 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:16:20.940 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:16:20.940 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:16:20.940 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:16:20.940 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:16:20.940 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:16:20.940 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:16:20.941 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:16:20.941 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:16:20.941 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:16:20.941 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:16:20.941 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:16:20.941 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:16:20.941 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:16:20.941 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:16:20.941 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:16:20.941 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:16:20.941 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:16:20.941 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:16:20.941 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:16:20.941 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:16:20.942 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:16:20.942 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:16:20.942 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:16:20.942 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:16:20.942 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:16:20.942 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:16:20.942 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:16:20.942 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:16:20.942 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:16:20.942 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:16:20.942 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:16:20.942 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:16:20.942 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:16:20.942 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:16:20.943 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:16:20.943 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:16:20.943 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:16:20.943 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:16:20.943 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:16:20.943 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:16:20.943 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:16:20.943 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:16:20.943 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:16:20.943 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:16:20.943 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:16:20.943 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:16:20.943 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:16:20.943 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:16:20.944 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:16:20.944 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:16:20.944 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:16:20.944 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:16:20.944 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:16:20.944 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:16:20.944 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:16:20.944 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:16:20.944 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:16:20.944 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:16:20.944 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:16:20.944 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:16:20.944 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:16:20.944 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:16:20.945 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:16:20.945 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:16:20.945 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:16:20.945 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:16:20.945 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:16:20.945 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:16:20.945 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:16:20.945 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:16:20.945 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:16:20.945 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:16:20.945 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:16:20.945 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:16:20.946 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:16:20.946 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:16:20.946 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:16:20.946 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:16:20.946 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:16:20.946 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:16:20.946 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:16:20.946 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:16:20.946 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:16:20.946 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:16:20.946 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:16:20.946 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:16:20.946 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:16:20.947 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:16:20.947 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:16:20.947 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:16:20.947 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:16:20.947 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:16:20.947 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:16:20.947 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:16:20.947 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:16:20.947 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:16:20.947 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:16:20.947 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:16:20.947 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:16:20.947 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:16:20.947 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:16:20.948 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:16:20.948 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:16:20.948 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:16:20.948 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:16:20.948 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:16:20.948 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:16:20.948 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:16:20.948 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:16:20.948 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:16:20.948 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:16:20.948 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:16:20.948 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:16:20.948 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:16:20.948 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:16:20.949 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:16:20.949 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:16:20.949 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:16:20.949 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:16:20.949 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:16:20.949 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:16:20.949 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:16:20.949 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:16:20.949 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:16:20.949 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:16:20.949 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:16:20.949 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:16:20.949 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:16:20.949 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:16:20.950 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:16:20.950 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:16:20.950 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:16:20.950 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:16:20.950 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:16:20.950 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:16:20.950 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:16:20.950 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:16:20.950 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:16:20.950 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:16:20.950 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:16:20.950 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:16:20.950 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:16:20.950 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:16:20.951 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:16:20.951 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:16:20.951 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:16:20.951 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:16:20.951 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:16:20.951 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:16:20.951 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:16:20.951 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:16:20.951 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:16:20.951 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:16:20.951 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:16:20.951 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:16:20.951 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:16:20.951 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:16:20.951 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:16:20.952 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:16:20.952 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:16:20.952 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:16:20.952 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:16:20.952 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:16:20.952 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:16:20.952 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:16:20.952 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:16:20.952 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:16:20.952 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:16:20.952 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:16:20.952 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:16:20.953 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:16:20.953 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:16:20.953 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:16:20.953 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:16:20.953 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:16:20.953 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:16:20.953 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:16:20.953 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:16:20.953 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:16:20.953 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:16:20.953 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:16:20.953 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:16:20.953 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:16:20.953 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:16:20.954 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:16:20.954 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:16:20.954 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:16:20.954 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:16:20.954 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:16:20.954 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:16:20.954 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:16:20.954 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:16:20.954 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:16:20.954 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:16:20.954 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:16:20.954 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:16:20.954 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:16:20.954 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:16:20.955 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:16:20.955 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:16:20.955 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:16:20.955 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:16:20.955 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:16:20.955 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:16:20.955 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:16:20.955 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:16:20.955 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:16:20.955 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:16:20.955 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:16:20.955 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:16:20.955 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:16:20.956 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:16:20.956 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:16:20.956 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:16:20.956 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:16:20.956 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:16:20.956 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:16:20.956 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:16:20.956 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:16:20.956 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:16:20.956 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:16:20.956 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:16:20.956 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:16:20.957 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:16:20.957 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:16:20.957 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:16:20.957 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:16:20.957 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:16:20.957 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:16:20.957 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:16:20.957 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:16:20.957 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:16:20.957 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:16:20.957 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:16:20.957 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:16:20.957 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:16:20.957 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:16:20.958 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:16:20.958 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:16:20.958 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:16:20.958 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:16:20.958 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:16:20.958 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:16:20.958 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:16:20.958 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:16:20.958 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:16:20.958 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:16:20.958 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:16:20.958 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:16:20.958 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:16:20.959 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:16:20.959 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:16:20.959 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:16:20.959 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:16:20.959 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:16:20.959 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:16:20.959 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:16:20.959 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:16:20.959 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:16:20.959 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:16:20.959 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:16:20.959 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:16:20.959 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:16:20.959 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:16:20.959 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:16:20.960 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:16:20.960 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:16:20.960 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:16:20.960 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:16:20.960 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:16:20.960 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:16:20.960 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:16:20.960 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:16:20.960 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:16:20.960 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:16:20.960 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:16:20.960 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:16:20.960 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:16:20.961 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:16:20.961 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:16:20.961 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:16:20.961 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:16:20.961 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:16:20.961 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:16:20.961 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:16:20.961 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:16:20.961 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:16:20.961 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:16:20.961 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:16:20.961 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:16:20.961 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:16:20.961 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:16:20.961 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:16:20.962 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:16:20.962 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:16:20.962 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:16:20.962 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:16:20.962 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:16:20.962 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:16:20.962 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:16:20.962 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:16:20.962 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:16:20.962 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:16:20.962 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:16:20.962 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:16:20.963 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:16:20.963 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:16:20.963 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:16:20.963 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:16:20.963 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:16:20.963 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:16:20.963 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:16:20.963 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:16:20.963 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:16:20.963 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:16:20.963 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:16:20.963 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:16:20.963 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:16:20.963 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:16:20.964 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:16:20.964 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:16:20.964 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:16:20.964 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:16:20.964 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:16:20.964 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:16:20.964 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:16:20.964 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:16:20.964 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:16:20.964 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:16:20.964 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:16:20.964 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:16:20.964 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:16:20.964 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:16:20.965 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:16:20.965 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:16:20.965 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:16:20.965 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:16:20.965 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:16:20.966 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:16:20.966 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:16:20.966 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:16:20.966 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:16:20.966 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:16:20.966 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:16:20.966 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:16:20.966 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:16:20.966 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:16:20.966 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:16:20.966 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:16:20.966 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:16:20.967 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:16:20.967 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:16:20.967 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:16:20.967 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:16:20.967 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:16:20.967 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:16:20.967 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:16:20.967 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:16:20.967 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:16:20.967 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:16:20.967 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:16:20.967 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:16:20.967 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:16:20.967 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:16:20.968 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:16:20.968 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:16:20.968 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:16:20.968 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:16:20.968 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:16:20.968 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:16:20.968 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:16:20.968 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:16:20.968 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:16:20.968 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:16:20.968 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:16:20.968 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:16:20.968 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:16:20.968 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:16:20.969 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:16:20.969 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:16:20.969 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:16:20.970 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:16:20.970 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:16:20.970 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:16:20.970 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:16:20.971 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:16:20.971 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:16:20.971 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:16:20.971 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:16:20.971 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:16:20.971 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:16:20.971 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:16:20.971 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:16:20.971 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:16:20.971 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:16:20.971 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:16:20.971 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:16:20.971 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:16:20.971 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:16:20.972 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:16:20.972 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:16:20.972 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:16:20.972 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:16:20.972 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:16:20.972 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:16:20.972 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:16:20.972 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:16:20.972 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:16:20.972 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:16:20.972 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:16:20.972 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:16:20.972 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:16:20.972 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:16:20.973 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:16:20.973 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:16:20.973 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:16:20.973 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:16:20.973 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:16:20.973 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:16:20.973 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:16:20.973 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:16:20.973 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:16:20.973 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:16:20.973 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:16:20.973 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:16:20.973 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:16:20.973 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:16:20.974 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:16:20.974 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:16:20.974 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:16:20.974 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:16:20.974 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:16:20.974 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:16:20.974 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:16:20.974 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:16:20.974 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:16:20.974 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:16:20.974 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:16:20.974 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:16:20.974 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:16:20.974 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:16:20.975 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:16:20.975 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:16:20.975 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:16:20.975 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:16:20.975 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:16:20.975 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:16:20.975 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:16:20.975 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:16:20.975 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:16:20.975 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:16:20.975 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:16:20.975 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:16:20.975 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:16:20.975 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:16:20.976 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:16:20.976 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:16:20.976 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:16:20.976 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:16:20.976 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:16:20.976 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:16:20.976 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:16:20.976 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:16:20.976 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:16:20.976 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:16:20.976 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:16:20.976 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:16:20.976 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:16:20.976 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:16:20.977 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:16:20.977 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:16:20.977 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:16:20.977 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:16:20.977 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:16:20.977 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:16:20.977 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:16:20.977 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:16:20.977 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:16:20.977 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:16:20.977 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:16:20.977 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:16:20.977 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:16:20.977 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:16:20.978 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:16:20.978 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:16:20.978 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:16:20.978 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:16:20.978 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:16:20.978 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:16:20.978 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:16:20.978 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:16:20.978 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:16:20.978 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:16:20.978 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:16:20.978 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:16:20.979 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:16:20.979 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:16:20.979 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:16:20.979 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:16:20.979 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:16:20.979 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:16:20.979 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:16:20.979 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:16:20.979 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:16:20.979 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:16:20.979 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:16:20.979 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:16:20.979 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:16:20.979 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:16:20.979 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:16:20.980 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:16:20.980 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:16:20.980 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:16:20.980 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:16:20.980 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:16:20.980 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:16:20.980 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:16:20.980 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:16:20.980 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:16:20.980 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:16:20.980 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:16:20.980 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:16:20.980 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:16:20.980 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:16:20.981 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:16:20.981 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:16:20.981 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:16:20.981 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:16:20.981 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:16:20.981 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:16:20.981 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:16:20.981 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:16:20.981 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:16:20.981 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:16:20.981 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:16:20.981 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:16:20.981 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:16:20.981 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:16:20.982 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:16:20.982 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:16:20.982 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:16:20.982 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:16:20.982 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:16:20.982 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:16:20.982 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:16:20.982 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:16:20.982 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:16:20.982 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:16:20.982 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:16:20.982 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:16:20.982 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:16:20.982 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:16:20.983 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:16:20.983 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:16:20.983 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:16:20.983 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:16:20.983 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:16:20.983 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:16:20.983 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:16:20.983 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:16:20.983 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:16:20.983 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:16:20.983 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:16:20.983 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:16:20.983 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:16:20.984 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:16:20.984 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:16:20.984 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:16:20.984 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:16:20.984 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:16:20.984 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:16:20.984 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:16:20.984 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:16:20.984 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:16:20.984 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:16:20.984 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:16:20.984 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:16:20.984 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:16:20.985 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:16:20.985 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:16:20.985 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:16:20.985 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:16:20.985 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:16:20.985 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:16:20.985 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:16:20.985 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:16:20.985 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:16:20.985 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:16:20.985 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:16:20.985 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:16:20.985 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:16:20.985 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:16:20.986 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:16:20.986 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:16:20.986 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:16:20.986 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:16:20.986 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:16:20.986 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:16:20.986 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:16:20.986 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:16:20.986 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:16:20.986 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:16:20.986 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:16:20.986 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:16:20.986 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:16:20.986 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:16:20.986 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:16:20.987 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:16:20.987 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:16:20.987 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:16:20.987 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:16:20.987 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:16:20.987 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:16:20.987 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:16:20.987 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:16:20.987 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:16:20.987 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:16:20.987 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:16:20.987 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:16:20.987 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:16:20.987 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:16:20.988 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:16:20.988 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:16:20.988 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:16:20.988 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:16:20.988 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:16:20.988 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:16:20.988 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:16:20.988 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:16:20.988 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:16:20.988 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:16:20.988 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:16:20.988 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:16:20.988 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:16:20.988 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:16:20.988 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:16:20.989 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:16:20.989 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:16:20.989 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:16:20.989 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:16:20.989 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:16:20.989 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:16:20.989 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:16:20.989 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:16:20.989 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:16:20.989 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:16:20.989 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:16:20.989 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:16:20.989 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:16:20.990 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:16:20.990 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:16:20.990 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:16:20.990 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:16:20.990 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:16:20.990 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:16:20.990 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:16:20.990 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:16:20.990 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:16:20.990 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:16:20.990 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:16:20.990 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:16:20.990 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:16:20.990 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:16:20.991 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:16:20.991 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:16:20.991 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:16:20.991 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:16:20.991 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:16:20.991 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:16:20.991 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:16:20.991 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:16:20.991 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:16:20.991 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:16:20.991 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:16:20.991 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:16:20.991 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:16:20.991 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:16:20.991 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:16:20.992 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:16:20.992 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:16:20.992 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:16:20.992 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:16:20.992 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:16:20.992 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:16:20.992 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:16:20.992 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:16:20.992 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:16:20.992 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:16:20.992 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:16:20.992 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:16:20.992 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:16:20.992 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:16:20.993 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:16:20.993 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:16:20.993 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:16:20.993 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:16:20.993 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:16:20.993 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:16:20.993 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:16:20.993 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:16:20.993 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:16:20.993 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:16:20.993 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:16:20.993 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:16:20.993 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:16:20.993 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:16:20.993 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:16:20.994 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:16:20.994 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:16:20.994 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:16:20.994 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:16:20.994 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:16:20.994 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:16:20.994 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:16:20.994 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:16:20.994 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:16:20.994 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:16:20.994 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:16:20.994 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:16:20.994 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:16:20.994 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:16:20.995 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:16:20.995 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:16:20.995 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:16:20.995 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:16:20.995 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:16:20.995 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:16:20.995 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:16:20.995 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:16:20.995 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:16:20.995 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:16:20.995 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:16:20.995 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:16:20.995 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:16:20.995 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:16:20.995 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:16:20.996 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:16:20.996 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:16:20.996 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:16:20.996 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:16:20.996 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:16:20.996 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:16:20.996 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:16:20.996 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:16:20.996 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:16:20.996 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:16:20.996 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:16:20.996 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:16:20.996 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:16:20.996 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:16:20.997 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:16:20.997 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:16:20.997 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:16:20.997 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:16:20.997 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:16:20.997 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:16:20.997 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:16:20.997 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:16:20.997 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:16:20.997 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:16:20.997 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:16:20.997 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:16:20.997 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:16:20.997 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:16:20.997 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:16:20.998 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:16:20.998 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:16:20.998 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:16:20.998 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:16:20.998 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:16:20.998 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:16:20.998 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:16:20.998 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:16:20.998 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:16:20.998 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:16:20.998 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:16:20.998 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:16:20.998 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:16:20.999 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:16:20.999 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:16:20.999 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:16:20.999 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:16:20.999 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:16:20.999 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:16:20.999 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:16:20.999 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:16:20.999 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:16:20.999 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:16:20.999 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:16:20.999 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:16:20.999 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:16:20.999 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:16:20.999 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:16:21.000 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:16:21.000 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:16:21.000 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:16:21.000 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:16:21.000 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:16:21.000 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:16:21.000 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:16:21.000 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:16:21.000 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:16:21.000 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:16:21.000 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:16:21.000 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:16:21.000 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:16:21.000 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:16:21.001 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:16:21.001 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:16:21.001 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:16:21.001 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:16:21.001 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:16:21.001 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:16:21.001 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:16:21.001 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:16:21.001 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:16:21.001 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:16:21.001 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:16:21.001 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:16:21.001 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:16:21.001 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:16:21.002 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:16:21.002 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:16:21.002 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:16:21.002 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:16:21.002 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:16:21.002 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:16:21.002 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:16:21.002 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:16:21.002 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:16:21.002 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:16:21.002 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:16:21.002 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:16:21.002 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:16:21.002 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:16:21.003 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:16:21.003 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:16:21.003 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:16:21.003 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:16:21.003 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:16:21.003 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:16:21.003 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:16:21.003 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:16:21.003 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:16:21.003 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:16:21.003 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:16:21.003 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:16:21.003 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:16:21.003 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:16:21.003 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:16:21.004 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:16:21.004 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:16:21.004 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:16:21.004 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:16:21.004 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:16:21.004 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:16:21.004 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:16:21.004 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:16:21.004 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:16:21.004 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:16:21.004 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:16:21.004 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:16:21.004 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:16:21.004 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:16:21.005 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:16:21.005 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:16:21.005 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:16:21.005 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:16:21.005 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:16:21.005 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:16:21.005 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:16:21.005 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:16:21.005 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:16:21.005 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:16:21.005 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:16:21.005 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:16:21.005 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:16:21.005 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:16:21.006 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:16:21.006 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:16:21.006 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:16:21.006 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:16:21.006 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:16:21.006 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:16:21.006 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:16:21.006 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:16:21.006 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:16:21.006 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:16:21.006 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:16:21.006 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:16:21.006 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:16:21.006 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:16:21.007 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:16:21.007 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:16:21.007 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:16:21.007 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:16:21.007 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:16:21.007 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:16:21.007 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:16:21.007 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:16:21.007 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:16:21.007 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:16:21.007 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:16:21.007 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:16:21.007 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:16:21.007 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:16:21.007 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:16:21.008 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:16:21.008 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:16:21.008 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:16:21.008 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:16:21.008 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:16:21.008 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:16:21.008 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:16:21.008 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:16:21.008 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:16:21.008 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:16:21.008 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:16:21.008 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:16:21.008 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:16:21.008 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:16:21.009 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:16:21.009 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:16:21.009 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:16:21.009 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:16:21.009 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:16:21.009 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:16:21.009 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:16:21.009 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:16:21.009 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:16:21.009 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:16:21.009 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:16:21.009 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:16:21.009 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:16:21.009 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:16:21.009 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:16:21.010 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:16:21.010 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:16:21.010 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:16:21.010 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:16:21.010 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:16:21.010 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:16:21.010 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:16:21.010 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:16:21.010 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:16:21.010 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:16:21.010 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:16:21.010 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:16:21.010 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:16:21.010 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:16:21.011 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:16:21.011 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:16:21.011 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:16:21.011 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:16:21.011 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:16:21.011 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:16:21.011 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:16:21.011 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:16:21.011 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:16:21.011 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:16:21.011 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:16:21.011 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:16:21.011 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:16:21.011 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:16:21.011 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:16:21.012 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:16:21.012 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:16:21.012 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:16:21.012 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:16:21.012 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:16:21.012 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:16:21.012 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:16:21.012 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:16:21.012 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:16:21.012 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:16:21.012 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:16:21.012 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:16:21.012 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:16:21.012 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:16:21.012 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:16:21.013 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:16:21.013 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:16:21.013 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:16:21.013 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:16:21.013 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:16:21.013 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:16:21.013 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:16:21.013 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:16:21.013 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:16:21.013 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:16:21.013 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:16:21.013 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:16:21.013 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:16:21.013 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:16:21.014 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:16:21.014 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:16:21.014 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:16:21.014 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:16:21.014 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:16:21.014 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:16:21.014 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:16:21.014 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:16:21.014 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:16:21.014 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:16:21.014 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:16:21.014 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:16:21.014 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:16:21.014 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:16:21.015 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:16:21.015 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:16:21.015 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:16:21.015 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:16:21.015 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:16:21.015 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:16:21.015 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:16:21.015 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:16:21.015 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:16:21.015 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:16:21.015 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:16:21.015 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:16:21.015 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:16:21.015 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:16:21.016 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:16:21.016 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:16:21.016 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:16:21.016 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:16:21.016 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:16:21.016 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:16:21.016 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:16:21.016 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:16:21.016 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:16:21.016 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:16:21.016 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:16:21.016 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:16:21.016 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:16:21.016 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:16:21.016 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:16:21.017 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:16:21.017 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:16:21.017 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:16:21.017 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:16:21.017 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:16:21.017 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:16:21.017 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:16:21.017 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:16:21.017 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:16:21.017 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:16:21.017 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:16:21.017 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:16:21.017 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:16:21.017 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:16:21.017 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:16:21.018 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:16:21.018 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:16:21.018 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:16:21.018 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:16:21.018 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:16:21.018 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:16:21.018 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:16:21.018 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:16:21.018 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:16:21.018 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:16:21.018 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:16:21.018 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:16:21.018 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:16:21.018 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:16:21.019 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:16:21.019 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:16:21.019 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:16:21.019 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:16:21.019 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:16:21.019 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:16:21.019 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:16:21.019 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:16:21.019 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:16:21.019 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:16:21.019 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:16:21.019 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:16:21.019 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:16:21.020 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:16:21.020 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:16:21.020 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:16:21.020 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:16:21.020 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:16:21.020 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:16:21.020 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:16:21.020 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:16:21.020 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:16:21.020 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:16:21.020 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:16:21.020 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:16:21.021 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:16:21.021 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:16:21.021 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:16:21.021 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:16:21.021 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:16:21.021 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:16:21.021 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:16:21.021 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:16:21.021 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:16:21.021 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:16:21.021 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:16:21.021 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:16:21.021 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:16:21.021 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:16:21.022 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:16:21.022 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:16:21.022 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:16:21.022 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:16:21.022 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:16:21.022 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:16:21.022 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:16:21.022 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:16:21.022 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:16:21.022 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:16:21.022 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:16:21.022 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:16:21.022 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:16:21.023 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:16:21.023 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:16:21.023 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:16:21.023 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:16:21.023 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:16:21.023 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:16:21.023 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:16:21.023 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:16:21.023 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:16:21.023 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:16:21.023 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:16:21.023 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:16:21.023 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:16:21.023 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:16:21.024 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:16:21.024 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:16:21.024 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:16:21.024 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:16:21.024 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:16:21.024 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:16:21.024 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:16:21.024 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:16:21.024 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:16:21.024 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:16:21.024 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:16:21.024 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:16:21.024 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:16:21.024 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:16:21.025 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:16:21.025 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:16:21.025 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:16:21.025 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:16:21.025 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:16:21.025 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:16:21.025 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:16:21.025 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:16:21.025 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:16:21.025 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:16:21.025 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:16:21.025 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:16:21.025 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:16:21.025 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:16:21.025 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:16:21.026 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:16:21.026 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:16:21.026 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:16:21.026 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:16:21.026 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:16:21.026 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:16:21.026 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:16:21.026 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:16:21.026 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:16:21.026 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:16:21.026 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:16:21.026 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:16:21.026 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:16:21.026 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:16:21.027 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:16:21.027 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:16:21.027 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:16:21.027 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:16:21.027 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:16:21.027 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:16:21.027 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:16:21.027 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:16:21.027 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:16:21.027 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:16:21.027 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:16:21.027 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:16:21.027 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:16:21.027 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:16:21.027 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:16:21.028 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:16:21.028 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:16:21.028 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:16:21.028 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:16:21.028 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:16:21.028 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:16:21.028 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:16:21.028 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:16:21.028 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:16:21.028 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:16:21.028 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:16:21.028 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:16:21.028 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:16:21.028 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:16:21.028 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:16:21.029 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:16:21.029 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:16:21.029 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:16:21.029 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:16:21.029 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:16:21.029 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:16:21.029 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:16:21.029 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:16:21.029 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:16:21.029 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:16:21.029 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:16:21.029 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:16:21.029 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:16:21.029 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:16:21.030 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:16:21.030 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:16:21.030 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:16:21.030 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:16:21.030 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:16:21.030 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:16:21.030 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:16:21.030 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:16:21.030 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:16:21.030 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:16:21.030 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:16:21.030 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:16:21.030 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:16:21.030 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:16:21.031 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:16:21.031 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:16:21.031 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:16:21.031 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:16:21.031 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:16:21.031 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:16:21.031 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:16:21.031 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:16:21.031 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:16:21.031 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:16:21.031 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:16:21.031 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:16:21.032 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:16:21.032 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:16:21.032 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:16:21.032 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:16:21.032 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:16:21.032 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:16:21.032 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:16:21.032 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:16:21.032 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:16:21.032 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:16:21.032 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:16:21.032 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:16:21.032 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:16:21.032 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:16:21.033 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:16:21.033 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:16:21.033 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:16:21.033 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:16:21.033 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:16:21.033 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:16:21.033 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:16:21.033 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:16:21.033 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:16:21.033 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:16:21.033 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:16:21.033 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:16:21.033 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:16:21.033 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:16:21.033 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:16:21.034 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:16:21.034 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:16:21.034 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:16:21.034 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:16:21.034 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:16:21.034 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:16:21.034 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:16:21.034 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:16:21.034 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:16:21.034 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:16:21.034 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:16:21.034 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:16:21.034 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:16:21.034 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:16:21.035 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:16:21.035 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:16:21.035 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:16:21.035 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:16:21.035 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:16:21.035 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:16:21.035 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:16:21.035 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:16:21.035 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:16:21.035 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:16:21.035 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:16:21.035 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:16:21.035 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:16:21.035 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:16:21.036 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:16:21.036 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:16:21.036 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:16:21.036 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:16:21.036 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:16:21.036 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:16:21.036 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:16:21.037 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:16:21.037 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:16:21.037 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:16:21.037 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:16:21.037 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:16:21.037 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:16:21.037 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:16:21.037 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:16:21.037 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:16:21.037 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:16:21.038 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:16:21.038 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:16:21.038 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:16:21.038 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:16:21.038 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:16:21.038 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:16:21.038 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:16:21.038 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:16:21.038 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:16:21.038 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:16:21.038 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:16:21.038 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:16:21.039 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:16:21.039 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:16:21.039 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:16:21.039 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:16:21.039 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:16:21.039 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:16:21.039 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:16:21.039 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:16:21.039 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:16:21.039 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:16:21.039 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:16:21.039 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:16:21.039 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:16:21.040 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:16:21.040 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:16:21.040 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:16:21.040 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:16:21.040 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:16:21.040 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:16:21.040 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:16:21.040 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:16:21.040 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:16:21.040 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:16:21.040 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:16:21.040 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:16:21.040 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:16:21.040 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:16:21.040 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:16:21.041 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:16:21.041 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:16:21.041 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:16:21.041 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:16:21.041 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:16:21.041 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:16:21.041 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:16:21.041 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:16:21.041 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:16:21.041 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:16:21.041 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:16:21.041 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:16:21.041 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:16:21.041 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:16:21.042 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:16:21.042 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:16:21.042 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:16:21.042 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:16:21.042 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:16:21.042 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:16:21.042 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:16:21.042 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:16:21.042 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:16:21.042 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:16:21.042 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:16:21.042 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:16:21.042 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:16:21.043 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:16:21.043 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:16:21.043 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:16:21.043 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:16:21.043 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:16:21.043 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:16:21.043 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:16:21.043 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:16:21.043 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:16:21.043 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:16:21.043 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:16:21.043 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:16:21.044 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:16:21.044 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:16:21.044 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:16:21.044 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:16:21.044 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:16:21.044 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:16:21.044 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:16:21.044 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:16:21.044 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:16:21.044 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:16:21.044 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:16:21.044 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:16:21.044 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:16:21.044 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:16:21.044 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:16:21.045 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:16:21.045 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:16:21.045 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:16:21.045 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:16:21.045 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:16:21.045 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:16:21.045 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:16:21.045 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:16:21.045 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:16:21.045 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:16:21.045 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:16:21.045 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:16:21.045 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:16:21.045 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:16:21.046 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:16:21.046 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:16:21.046 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:16:21.046 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:16:21.046 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:16:21.046 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:16:21.046 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:16:21.046 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:16:21.046 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:16:21.046 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:16:21.046 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:16:21.046 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:16:21.046 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:16:21.046 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:16:21.047 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:16:21.047 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:16:21.047 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:16:21.047 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:16:21.047 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:16:21.047 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:16:21.047 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:16:21.047 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:16:21.047 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:16:21.047 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:16:21.047 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:16:21.047 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:16:21.047 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:16:21.047 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:16:21.048 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:16:21.048 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:16:21.048 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:16:21.048 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:16:21.048 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:16:21.048 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:16:21.048 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:16:21.048 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:16:21.048 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:16:21.048 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:16:21.048 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:16:21.048 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:16:21.048 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:16:21.048 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:16:21.048 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:16:21.052 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:21.052 DEBUG:teuthology.orchestra.run.smithi136:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:16:21.079 INFO:teuthology.orchestra.run.smithi136.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:16:21.079 INFO:teuthology.orchestra.run.smithi136.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:16:21.079 INFO:teuthology.orchestra.run.smithi136.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:16:21.079 INFO:teuthology.orchestra.run.smithi136.stdout:fi 2024-08-17T02:16:21.079 INFO:teuthology.orchestra.run.smithi136.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:16:21.079 INFO:teuthology.orchestra.run.smithi136.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:16:21.079 INFO:teuthology.orchestra.run.smithi136.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:21.079 INFO:teuthology.orchestra.run.smithi136.stdout: fi 2024-08-17T02:16:21.079 INFO:teuthology.orchestra.run.smithi136.stdout:done 2024-08-17T02:16:21.079 INFO:teuthology.orchestra.run.smithi136.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:16:21.079 INFO:teuthology.orchestra.run.smithi136.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:16:21.080 INFO:teuthology.orchestra.run.smithi136.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:21.080 INFO:teuthology.orchestra.run.smithi136.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:21.080 INFO:teuthology.orchestra.run.smithi136.stdout:fi 2024-08-17T02:16:21.080 INFO:teuthology.orchestra.run.smithi136.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:16:21.080 INFO:teuthology.orchestra.run.smithi136.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:21.080 INFO:teuthology.orchestra.run.smithi136.stdout:fi 2024-08-17T02:16:21.080 INFO:teuthology.orchestra.run.smithi136.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:16:21.080 INFO:teuthology.orchestra.run.smithi136.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:16:21.080 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:21.080 INFO:teuthology.orchestra.run.smithi136.stdout:fi 2024-08-17T02:16:21.081 DEBUG:teuthology.orchestra.run.smithi136:> sudo rpm -qi grub2-tools 2024-08-17T02:16:21.159 INFO:teuthology.orchestra.run.smithi136.stdout:Name : grub2-tools 2024-08-17T02:16:21.159 INFO:teuthology.orchestra.run.smithi136.stdout:Epoch : 1 2024-08-17T02:16:21.159 INFO:teuthology.orchestra.run.smithi136.stdout:Version : 2.06 2024-08-17T02:16:21.159 INFO:teuthology.orchestra.run.smithi136.stdout:Release : 68.el9 2024-08-17T02:16:21.159 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: x86_64 2024-08-17T02:16:21.159 INFO:teuthology.orchestra.run.smithi136.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:16:21.159 INFO:teuthology.orchestra.run.smithi136.stdout:Group : Unspecified 2024-08-17T02:16:21.159 INFO:teuthology.orchestra.run.smithi136.stdout:Size : 8264254 2024-08-17T02:16:21.160 INFO:teuthology.orchestra.run.smithi136.stdout:License : GPLv3+ 2024-08-17T02:16:21.160 INFO:teuthology.orchestra.run.smithi136.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:16:21.160 INFO:teuthology.orchestra.run.smithi136.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:16:21.160 INFO:teuthology.orchestra.run.smithi136.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:16:21.160 INFO:teuthology.orchestra.run.smithi136.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:16:21.160 INFO:teuthology.orchestra.run.smithi136.stdout:Packager : builder@centos.org 2024-08-17T02:16:21.160 INFO:teuthology.orchestra.run.smithi136.stdout:Vendor : CentOS 2024-08-17T02:16:21.160 INFO:teuthology.orchestra.run.smithi136.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:16:21.160 INFO:teuthology.orchestra.run.smithi136.stdout:Summary : Support tools for GRUB. 2024-08-17T02:16:21.160 INFO:teuthology.orchestra.run.smithi136.stdout:Description : 2024-08-17T02:16:21.160 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:16:21.160 INFO:teuthology.orchestra.run.smithi136.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:16:21.160 INFO:teuthology.orchestra.run.smithi136.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:16:21.160 INFO:teuthology.orchestra.run.smithi136.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:16:21.161 INFO:teuthology.orchestra.run.smithi136.stdout:hardware devices. 2024-08-17T02:16:21.161 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:16:21.161 INFO:teuthology.orchestra.run.smithi136.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:16:21.162 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:16:21.162 INFO:teuthology.task.kernel:Updating grub on smithi136 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:21.162 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:16:21.676 INFO:teuthology.orchestra.run.smithi136.stderr:Generating grub configuration file ... 2024-08-17T02:16:23.099 INFO:teuthology.orchestra.run.smithi136.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:16:23.132 INFO:teuthology.orchestra.run.smithi136.stderr:done 2024-08-17T02:16:23.134 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-08-17T02:16:23.154 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.SplOSUXV3L 2024-08-17T02:16:23.154 DEBUG:teuthology.orchestra.run.smithi136:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SplOSUXV3L 2024-08-17T02:16:23.231 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.SplOSUXV3L 2024-08-17T02:16:23.365 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.SplOSUXV3L is 6KB 2024-08-17T02:16:23.416 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.SplOSUXV3L 2024-08-17T02:16:23.430 DEBUG:teuthology.orchestra.run.smithi136:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:16:23.492 INFO:teuthology.orchestra.run.smithi136.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:16:23.492 INFO:teuthology.orchestra.run.smithi136.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:16:23.492 INFO:teuthology.orchestra.run.smithi136.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:16:23.492 INFO:teuthology.orchestra.run.smithi136.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:16:23.493 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:23.662 DEBUG:teuthology.orchestra.run.smithi136:> sudo shutdown -r now 2024-08-17T02:16:23.757 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-08-17T02:16:53.694 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-08-17T02:16:53.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-08-17T02:16:53.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:12.159 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-08-17T02:17:14.190 DEBUG:teuthology.orchestra.remote:timed out 2024-08-17T02:17:21.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-08-17T02:17:21.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:23.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-08-17T02:17:23.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:23.618 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-08-17T02:17:24.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-08-17T02:17:24.131 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:17:24.131 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-08-17T02:17:24.166 INFO:teuthology.orchestra.run.smithi006.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:17:24.166 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:17:24.166 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:17:24.166 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:17:24.222 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-08-17T02:17:25.170 DEBUG:teuthology.parallel:result is None 2024-08-17T02:17:36.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-08-17T02:17:36.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:18:08.080 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-08-17T02:18:08.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-08-17T02:18:08.606 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:18:08.606 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-08-17T02:18:08.641 INFO:teuthology.orchestra.run.smithi136.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:08.642 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:08.642 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:18:08.642 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:18:09.643 DEBUG:teuthology.parallel:result is None 2024-08-17T02:18:09.644 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:18:09.651 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:18:09.651 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:18:09.658 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:18:09.697 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:18:09.704 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:18:09.714 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:18:09.714 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:18:09.738 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:18:09.787 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:18:09.796 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:18:09.797 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:18:09.800 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:18:09.933 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:18:09.937 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:18:09.971 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:18:09.987 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:18:09.990 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:18:09.997 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:18:09.998 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:18:10.002 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:18:10.057 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:18:10.067 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:18:10.067 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:18:10.071 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:18:10.108 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:18:10.213 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:18:10.289 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:18:10.354 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:18:10.425 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:18:10.425 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:18:10.480 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:18:10.546 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:18:10.623 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:18:10.691 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:18:10.758 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:18:10.758 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:18:10.913 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2024-08-17T02:18:10.917 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2024-08-17T02:18:10.991 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:18:10.998 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:18:11.331 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:18:11.339 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:18:11.339 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:18:11.350 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:18:11.359 DEBUG:teuthology.orchestra.run.smithi006:> sudo service auditd rotate 2024-08-17T02:18:11.460 INFO:teuthology.orchestra.run.smithi006.stdout:Rotating logs: 2024-08-17T02:18:11.464 DEBUG:teuthology.orchestra.run.smithi136:> sudo service auditd rotate 2024-08-17T02:18:11.571 INFO:teuthology.orchestra.run.smithi136.stdout:Rotating logs: 2024-08-17T02:18:11.574 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:18:11.574 DEBUG:teuthology.orchestra.run.smithi006:> /usr/sbin/getenforce 2024-08-17T02:18:11.615 INFO:teuthology.orchestra.run.smithi006.stdout:Permissive 2024-08-17T02:18:11.615 DEBUG:teuthology.orchestra.run.smithi136:> /usr/sbin/getenforce 2024-08-17T02:18:11.659 INFO:teuthology.orchestra.run.smithi136.stdout:Permissive 2024-08-17T02:18:11.660 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi006.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi136.front.sepia.ceph.com': 'permissive'} 2024-08-17T02:18:11.660 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:18:11.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:18:11.719 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:18:11.778 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:18:11.778 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:18:11.778 DEBUG:teuthology.orchestra.run.smithi006:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:18:11.834 DEBUG:teuthology.orchestra.run.smithi136:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:18:11.895 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:18:11.906 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:18:11.917 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:18:11.918 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi136.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:23:49.771 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com')] 2024-08-17T02:23:49.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-08-17T02:23:49.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:23:49.864 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-08-17T02:23:49.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-08-17T02:23:49.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-08-17T02:23:49.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:23:50.061 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-08-17T02:23:50.176 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-08-17T02:23:50.176 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:23:50.186 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:23:50.186 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:23:50.187 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:23:50.191 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:23:50.191 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:23:50.249 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:23:50.276 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:23:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:23:50.307 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:23:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: ntpd: command not found 2024-08-17T02:23:50.354 INFO:teuthology.orchestra.run.smithi006.stdout:506 Cannot talk to daemon 2024-08-17T02:23:50.356 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: ntpd: command not found 2024-08-17T02:23:50.380 INFO:teuthology.orchestra.run.smithi136.stdout:506 Cannot talk to daemon 2024-08-17T02:23:50.384 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:23:50.409 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:23:50.414 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:23:50.438 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:23:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:23:50.512 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:23:50.512 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2024-08-17T02:23:50.512 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:23:50.512 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:23:50.512 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:23:50.512 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:23:50.537 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:23:50.543 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:23:50.543 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-08-17T02:23:50.543 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:23:50.543 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:23:50.543 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:23:50.543 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:23:50.544 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:23:50.553 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:23:50.554 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:23:50.554 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:23:50.554 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:23:50.562 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:23:50.562 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:23:50.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:23:50.563 DEBUG:teuthology.orchestra.run.smithi136:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:23:51.267 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:19 ago on Sat 17 Aug 2024 02:22:32 AM UTC. 2024-08-17T02:23:51.284 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:14 ago on Sat 17 Aug 2024 02:22:37 AM UTC. 2024-08-17T02:23:51.355 INFO:teuthology.orchestra.run.smithi136.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:23:51.374 INFO:teuthology.orchestra.run.smithi006.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:23:51.396 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-08-17T02:23:51.398 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-08-17T02:23:51.398 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-08-17T02:23:51.420 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-08-17T02:23:51.421 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2024-08-17T02:23:51.421 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-08-17T02:23:51.484 DEBUG:teuthology.orchestra.run.smithi136:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:23:51.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:23:51.732 INFO:teuthology.orchestra.run.smithi136.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:23:51.732 INFO:teuthology.orchestra.run.smithi136.stderr:of the main distribution, and quality may vary. 2024-08-17T02:23:51.732 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-08-17T02:23:51.732 INFO:teuthology.orchestra.run.smithi136.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:23:51.733 INFO:teuthology.orchestra.run.smithi136.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:23:51.733 INFO:teuthology.orchestra.run.smithi136.stderr:, 2024-08-17T02:23:51.733 INFO:teuthology.orchestra.run.smithi136.stderr:and packages are not held to any quality or security level. 2024-08-17T02:23:51.733 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-08-17T02:23:51.733 INFO:teuthology.orchestra.run.smithi136.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:23:51.733 INFO:teuthology.orchestra.run.smithi136.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:23:51.759 INFO:teuthology.orchestra.run.smithi006.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:23:51.759 INFO:teuthology.orchestra.run.smithi006.stderr:of the main distribution, and quality may vary. 2024-08-17T02:23:51.760 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-08-17T02:23:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:23:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:23:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:, 2024-08-17T02:23:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:and packages are not held to any quality or security level. 2024-08-17T02:23:51.760 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-08-17T02:23:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:23:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:23:51.811 INFO:teuthology.orchestra.run.smithi136.stdout:Repository successfully enabled. 2024-08-17T02:23:51.839 INFO:teuthology.orchestra.run.smithi006.stdout:Repository successfully enabled. 2024-08-17T02:23:51.854 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:23:51.855 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:23:51.886 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:23:51.887 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:23:52.012 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:23:52.012 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:23:52.027 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:23:52.028 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:23:52.123 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:23:52.123 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:23:52.123 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:23:52.135 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:23:52.135 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:23:52.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:23:52.180 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:23:52.180 DEBUG:teuthology.orchestra.run.smithi136:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:23:52.194 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:23:52.194 DEBUG:teuthology.orchestra.run.smithi006:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:23:52.279 DEBUG:teuthology.orchestra.run.smithi136:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:23:52.293 DEBUG:teuthology.orchestra.run.smithi006:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:23:52.357 DEBUG:teuthology.orchestra.run.smithi136:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:23:52.372 DEBUG:teuthology.orchestra.run.smithi006:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:23:52.412 INFO:teuthology.orchestra.run.smithi136.stdout:check_obsoletes = 1 2024-08-17T02:23:52.415 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum clean all 2024-08-17T02:23:52.428 INFO:teuthology.orchestra.run.smithi006.stdout:check_obsoletes = 1 2024-08-17T02:23:52.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum clean all 2024-08-17T02:23:52.679 INFO:teuthology.orchestra.run.smithi136.stdout:45 files removed 2024-08-17T02:23:52.713 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:23:52.714 INFO:teuthology.orchestra.run.smithi006.stdout:45 files removed 2024-08-17T02:23:52.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:23:53.475 INFO:teuthology.orchestra.run.smithi136.stdout:ceph packages for x86_64 194 kB/s | 77 kB 00:00 2024-08-17T02:23:53.503 INFO:teuthology.orchestra.run.smithi006.stdout:ceph packages for x86_64 210 kB/s | 77 kB 00:00 2024-08-17T02:23:53.892 INFO:teuthology.orchestra.run.smithi136.stdout:ceph noarch packages 29 kB/s | 11 kB 00:00 2024-08-17T02:23:53.995 INFO:teuthology.orchestra.run.smithi006.stdout:ceph noarch packages 24 kB/s | 11 kB 00:00 2024-08-17T02:23:54.393 INFO:teuthology.orchestra.run.smithi136.stdout:ceph source packages 3.9 kB/s | 1.8 kB 00:00 2024-08-17T02:23:54.454 INFO:teuthology.orchestra.run.smithi006.stdout:ceph source packages 4.3 kB/s | 1.8 kB 00:00 2024-08-17T02:23:54.673 INFO:teuthology.orchestra.run.smithi136.stdout:Copr repo for el9 owned by ceph 31 kB/s | 7.6 kB 00:00 2024-08-17T02:23:54.679 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for el9 owned by ceph 40 kB/s | 7.6 kB 00:00 2024-08-17T02:23:55.230 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-08-17T02:23:55.685 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 8.4 MB/s | 8.2 MB 00:00 2024-08-17T02:23:57.703 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-08-17T02:23:58.064 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-08-17T02:24:02.287 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.6 MB 00:00 2024-08-17T02:24:04.079 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 18 kB 00:00 2024-08-17T02:24:04.173 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.6 MB 00:02 2024-08-17T02:24:05.067 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 26 MB/s | 22 MB 00:00 2024-08-17T02:24:05.974 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 18 kB 00:00 2024-08-17T02:24:07.204 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 20 MB/s | 22 MB 00:01 2024-08-17T02:24:11.306 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-17T02:24:13.843 INFO:teuthology.orchestra.run.smithi136.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:24:13.843 INFO:teuthology.orchestra.run.smithi136.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:24:13.854 INFO:teuthology.orchestra.run.smithi136.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:24:13.854 INFO:teuthology.orchestra.run.smithi136.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:24:13.855 INFO:teuthology.orchestra.run.smithi136.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:24:13.856 INFO:teuthology.orchestra.run.smithi136.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:24:13.858 INFO:teuthology.orchestra.run.smithi136.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:24:13.860 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:24:13.861 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:24:13.885 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-08-17T02:24:13.921 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-08-17T02:24:13.940 INFO:teuthology.orchestra.run.smithi136.stdout:======================================================================================= 2024-08-17T02:24:13.940 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-08-17T02:24:13.940 INFO:teuthology.orchestra.run.smithi136.stdout:======================================================================================= 2024-08-17T02:24:13.940 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-08-17T02:24:13.940 INFO:teuthology.orchestra.run.smithi136.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:24:13.940 INFO:teuthology.orchestra.run.smithi136.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:24:13.940 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:24:13.940 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:24:13.940 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:24:13.941 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:24:13.941 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:24:13.941 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:24:13.941 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:24:13.941 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:24:13.941 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:24:13.941 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:24:13.941 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:24:13.941 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:24:13.941 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:24:13.941 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:24:13.941 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:24:13.942 INFO:teuthology.orchestra.run.smithi136.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:24:13.942 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:24:13.942 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:24:13.942 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:24:13.942 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:24:13.942 INFO:teuthology.orchestra.run.smithi136.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:24:13.942 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:24:13.942 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:24:13.942 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:24:13.942 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:24:13.943 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:24:13.943 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:24:13.943 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:24:13.943 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:24:13.943 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:24:13.943 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:24:13.943 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2024-08-17T02:24:13.943 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:24:13.943 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:24:13.943 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:24:13.943 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:24:13.944 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:24:13.944 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:24:13.944 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:24:13.944 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:24:13.944 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:24:13.944 INFO:teuthology.orchestra.run.smithi136.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:24:13.944 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:24:13.944 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:24:13.944 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-08-17T02:24:13.944 INFO:teuthology.orchestra.run.smithi136.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:24:13.944 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:24:13.944 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:24:13.944 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:24:13.945 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:24:13.945 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:24:13.945 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:24:13.945 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:24:13.945 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:24:13.945 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:24:13.945 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:24:13.945 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:24:13.945 INFO:teuthology.orchestra.run.smithi136.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:24:13.945 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:24:13.945 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:24:13.945 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:24:13.946 INFO:teuthology.orchestra.run.smithi136.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:24:13.946 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:24:13.946 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:24:13.946 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:24:13.946 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:24:13.946 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:24:13.946 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:24:13.946 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:24:13.946 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:24:13.946 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:24:13.946 INFO:teuthology.orchestra.run.smithi136.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:24:13.946 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:24:13.947 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:24:13.947 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:24:13.947 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:24:13.947 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:24:13.947 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:24:13.947 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:24:13.947 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:24:13.947 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:24:13.947 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:24:13.947 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:24:13.947 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:24:13.947 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:24:13.948 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:24:13.948 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:24:13.948 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:24:13.948 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:24:13.948 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:24:13.948 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:24:13.948 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:24:13.948 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:24:13.948 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:24:13.948 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:24:13.948 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:24:13.948 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:24:13.948 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:24:13.949 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:24:13.949 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:24:13.949 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:24:13.949 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:24:13.949 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:24:13.949 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:24:13.949 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:24:13.949 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:24:13.949 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:24:13.949 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:24:13.949 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:24:13.949 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:24:13.949 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:24:13.950 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:24:13.950 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:24:13.950 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:24:13.950 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:24:13.950 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:24:13.950 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:24:13.950 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:24:13.950 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:24:13.950 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:24:13.950 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:24:13.950 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:24:13.950 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:24:13.950 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:24:13.951 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:24:13.951 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:24:13.951 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:24:13.951 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:24:13.951 INFO:teuthology.orchestra.run.smithi136.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:24:13.951 INFO:teuthology.orchestra.run.smithi136.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:24:13.951 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:24:13.951 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:24:13.951 INFO:teuthology.orchestra.run.smithi136.stdout:Installing weak dependencies: 2024-08-17T02:24:13.951 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:24:13.951 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:24:13.951 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-08-17T02:24:13.951 INFO:teuthology.orchestra.run.smithi136.stdout:======================================================================================= 2024-08-17T02:24:13.952 INFO:teuthology.orchestra.run.smithi136.stdout:Install 121 Packages 2024-08-17T02:24:13.952 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 12 Packages 2024-08-17T02:24:13.952 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:24:13.952 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 206 M 2024-08-17T02:24:13.952 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-08-17T02:24:14.732 INFO:teuthology.orchestra.run.smithi136.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 29 kB/s | 6.5 kB 00:00 2024-08-17T02:24:14.932 INFO:teuthology.orchestra.run.smithi136.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 4.0 MB/s | 813 kB 00:00 2024-08-17T02:24:15.357 INFO:teuthology.orchestra.run.smithi136.stdout:(3/133): ceph-immutable-object-cache-17.2.7-137 323 kB/s | 137 kB 00:00 2024-08-17T02:24:15.449 INFO:teuthology.orchestra.run.smithi136.stdout:(4/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 5.3 MB/s | 5.0 MB 00:00 2024-08-17T02:24:15.691 INFO:teuthology.orchestra.run.smithi136.stdout:(5/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 5.8 MB/s | 1.4 MB 00:00 2024-08-17T02:24:15.758 INFO:teuthology.orchestra.run.smithi136.stdout:(6/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 5.2 MB/s | 2.1 MB 00:00 2024-08-17T02:24:16.092 INFO:teuthology.orchestra.run.smithi136.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 9.8 MB/s | 3.9 MB 00:00 2024-08-17T02:24:16.475 INFO:teuthology.orchestra.run.smithi136.stdout:(8/133): ceph-common-17.2.7-1375.g2577e813.el9. 11 MB/s | 22 MB 00:01 2024-08-17T02:24:16.517 INFO:teuthology.orchestra.run.smithi136.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 612 kB/s | 25 kB 00:00 2024-08-17T02:24:16.523 INFO:teuthology.orchestra.run.smithi006.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:24:16.524 INFO:teuthology.orchestra.run.smithi006.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:24:16.534 INFO:teuthology.orchestra.run.smithi006.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:24:16.535 INFO:teuthology.orchestra.run.smithi006.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:24:16.536 INFO:teuthology.orchestra.run.smithi006.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:24:16.537 INFO:teuthology.orchestra.run.smithi006.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:24:16.539 INFO:teuthology.orchestra.run.smithi006.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:24:16.541 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:24:16.542 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:24:16.607 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-08-17T02:24:16.635 INFO:teuthology.orchestra.run.smithi006.stdout:======================================================================================= 2024-08-17T02:24:16.635 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2024-08-17T02:24:16.635 INFO:teuthology.orchestra.run.smithi006.stdout:======================================================================================= 2024-08-17T02:24:16.635 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-08-17T02:24:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:24:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:24:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:24:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:24:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:24:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:24:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:24:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:24:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:24:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:24:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:24:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:24:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:24:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:24:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:24:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:24:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:24:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:24:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:24:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:24:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:24:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:24:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:24:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:24:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:24:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:24:16.637 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:24:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:24:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:24:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:24:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:24:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:24:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:24:16.638 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2024-08-17T02:24:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:24:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:24:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:24:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:24:16.638 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-08-17T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:24:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:24:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:24:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:24:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:24:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:24:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:24:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:24:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:24:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:24:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:24:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:24:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:24:16.642 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:24:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:24:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:24:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:24:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:24:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:24:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:24:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:24:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:24:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:24:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:24:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:24:16.643 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:24:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:24:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:24:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:24:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:24:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:24:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:24:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:24:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:24:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:24:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:24:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:24:16.644 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stdout:Installing weak dependencies: 2024-08-17T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-08-17T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stdout:======================================================================================= 2024-08-17T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stdout:Install 121 Packages 2024-08-17T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 12 Packages 2024-08-17T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:24:16.647 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 206 M 2024-08-17T02:24:16.647 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-08-17T02:24:16.993 INFO:teuthology.orchestra.run.smithi136.stdout:(10/133): ceph-radosgw-17.2.7-1375.g2577e813.el 16 MB/s | 14 MB 00:00 2024-08-17T02:24:17.051 INFO:teuthology.orchestra.run.smithi136.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 3.6 MB/s | 215 kB 00:00 2024-08-17T02:24:17.118 INFO:teuthology.orchestra.run.smithi136.stdout:(12/133): libcephfs-devel-17.2.7-1375.g2577e813 376 kB/s | 25 kB 00:00 2024-08-17T02:24:17.211 INFO:teuthology.orchestra.run.smithi006.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 31 kB/s | 6.5 kB 00:00 2024-08-17T02:24:17.294 INFO:teuthology.orchestra.run.smithi136.stdout:(13/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 10 MB/s | 15 MB 00:01 2024-08-17T02:24:17.327 INFO:teuthology.orchestra.run.smithi136.stdout:(14/133): libcephfs2-17.2.7-1375.g2577e813.el9. 3.0 MB/s | 636 kB 00:00 2024-08-17T02:24:17.352 INFO:teuthology.orchestra.run.smithi136.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 2.7 MB/s | 163 kB 00:00 2024-08-17T02:24:17.400 INFO:teuthology.orchestra.run.smithi136.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 1.7 MB/s | 126 kB 00:00 2024-08-17T02:24:17.411 INFO:teuthology.orchestra.run.smithi006.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 4.0 MB/s | 813 kB 00:00 2024-08-17T02:24:17.436 INFO:teuthology.orchestra.run.smithi136.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 5.4 MB/s | 458 kB 00:00 2024-08-17T02:24:17.520 INFO:teuthology.orchestra.run.smithi006.stdout:(3/133): ceph-immutable-object-cache-17.2.7-137 1.2 MB/s | 137 kB 00:00 2024-08-17T02:24:17.545 INFO:teuthology.orchestra.run.smithi136.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 415 kB/s | 45 kB 00:00 2024-08-17T02:24:17.637 INFO:teuthology.orchestra.run.smithi136.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 1.3 MB/s | 120 kB 00:00 2024-08-17T02:24:17.737 INFO:teuthology.orchestra.run.smithi006.stdout:(4/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 6.7 MB/s | 5.0 MB 00:00 2024-08-17T02:24:17.745 INFO:teuthology.orchestra.run.smithi136.stdout:(20/133): python3-cephfs-17.2.7-1375.g2577e813. 1.6 MB/s | 182 kB 00:00 2024-08-17T02:24:17.846 INFO:teuthology.orchestra.run.smithi136.stdout:(21/133): python3-rados-17.2.7-1375.g2577e813.e 3.6 MB/s | 369 kB 00:00 2024-08-17T02:24:17.920 INFO:teuthology.orchestra.run.smithi006.stdout:(5/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 5.2 MB/s | 2.1 MB 00:00 2024-08-17T02:24:17.937 INFO:teuthology.orchestra.run.smithi136.stdout:(22/133): python3-rbd-17.2.7-1375.g2577e813.el9 3.7 MB/s | 344 kB 00:00 2024-08-17T02:24:17.988 INFO:teuthology.orchestra.run.smithi006.stdout:(6/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 5.6 MB/s | 1.4 MB 00:00 2024-08-17T02:24:18.021 INFO:teuthology.orchestra.run.smithi136.stdout:(23/133): librgw2-17.2.7-1375.g2577e813.el9.x86 7.9 MB/s | 4.9 MB 00:00 2024-08-17T02:24:18.038 INFO:teuthology.orchestra.run.smithi136.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.1 MB/s | 116 kB 00:00 2024-08-17T02:24:18.114 INFO:teuthology.orchestra.run.smithi136.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 890 kB/s | 82 kB 00:00 2024-08-17T02:24:18.206 INFO:teuthology.orchestra.run.smithi136.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 1.8 MB/s | 165 kB 00:00 2024-08-17T02:24:18.306 INFO:teuthology.orchestra.run.smithi136.stdout:(27/133): ceph-grafana-dashboards-17.2.7-1375.g 245 kB/s | 24 kB 00:00 2024-08-17T02:24:18.390 INFO:teuthology.orchestra.run.smithi136.stdout:(28/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 1.5 MB/s | 124 kB 00:00 2024-08-17T02:24:18.438 INFO:teuthology.orchestra.run.smithi006.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 7.6 MB/s | 3.9 MB 00:00 2024-08-17T02:24:18.473 INFO:teuthology.orchestra.run.smithi136.stdout:(29/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 6.8 MB/s | 2.9 MB 00:00 2024-08-17T02:24:18.688 INFO:teuthology.orchestra.run.smithi006.stdout:(8/133): ceph-common-17.2.7-1375.g2577e813.el9. 13 MB/s | 22 MB 00:01 2024-08-17T02:24:18.763 INFO:teuthology.orchestra.run.smithi006.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 337 kB/s | 25 kB 00:00 2024-08-17T02:24:18.782 INFO:teuthology.orchestra.run.smithi136.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 8.6 MB/s | 3.4 MB 00:00 2024-08-17T02:24:18.874 INFO:teuthology.orchestra.run.smithi136.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 2.6 MB/s | 240 kB 00:00 2024-08-17T02:24:18.974 INFO:teuthology.orchestra.run.smithi136.stdout:(32/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 476 kB/s | 47 kB 00:00 2024-08-17T02:24:19.074 INFO:teuthology.orchestra.run.smithi136.stdout:(33/133): ceph-prometheus-alerts-17.2.7-1375.g2 146 kB/s | 15 kB 00:00 2024-08-17T02:24:19.183 INFO:teuthology.orchestra.run.smithi136.stdout:(34/133): ceph-volume-17.2.7-1375.g2577e813.el9 2.4 MB/s | 269 kB 00:00 2024-08-17T02:24:19.292 INFO:teuthology.orchestra.run.smithi136.stdout:(35/133): ceph-mgr-diskprediction-local-17.2.7- 9.0 MB/s | 7.4 MB 00:00 2024-08-17T02:24:19.309 INFO:teuthology.orchestra.run.smithi136.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 660 kB/s | 83 kB 00:00 2024-08-17T02:24:19.384 INFO:teuthology.orchestra.run.smithi136.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 198 kB/s | 18 kB 00:00 2024-08-17T02:24:19.476 INFO:teuthology.orchestra.run.smithi136.stdout:(38/133): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-08-17T02:24:19.580 INFO:teuthology.orchestra.run.smithi006.stdout:(10/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 9.6 MB/s | 15 MB 00:01 2024-08-17T02:24:19.584 INFO:teuthology.orchestra.run.smithi136.stdout:(39/133): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-08-17T02:24:19.630 INFO:teuthology.orchestra.run.smithi006.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 4.2 MB/s | 215 kB 00:00 2024-08-17T02:24:19.677 INFO:teuthology.orchestra.run.smithi136.stdout:(40/133): libgfortran-11.4.1-3.el9.x86_64.rpm 2.7 MB/s | 803 kB 00:00 2024-08-17T02:24:19.702 INFO:teuthology.orchestra.run.smithi136.stdout:(41/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-08-17T02:24:19.705 INFO:teuthology.orchestra.run.smithi006.stdout:(12/133): libcephfs-devel-17.2.7-1375.g2577e813 334 kB/s | 25 kB 00:00 2024-08-17T02:24:19.752 INFO:teuthology.orchestra.run.smithi136.stdout:(42/133): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-08-17T02:24:19.794 INFO:teuthology.orchestra.run.smithi136.stdout:(43/133): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-08-17T02:24:19.819 INFO:teuthology.orchestra.run.smithi136.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-08-17T02:24:19.879 INFO:teuthology.orchestra.run.smithi136.stdout:(45/133): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-08-17T02:24:19.898 INFO:teuthology.orchestra.run.smithi006.stdout:(13/133): ceph-radosgw-17.2.7-1375.g2577e813.el 9.7 MB/s | 14 MB 00:01 2024-08-17T02:24:19.903 INFO:teuthology.orchestra.run.smithi136.stdout:(46/133): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-08-17T02:24:19.931 INFO:teuthology.orchestra.run.smithi006.stdout:(14/133): libcephfs2-17.2.7-1375.g2577e813.el9. 2.8 MB/s | 636 kB 00:00 2024-08-17T02:24:19.965 INFO:teuthology.orchestra.run.smithi006.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 2.4 MB/s | 163 kB 00:00 2024-08-17T02:24:19.990 INFO:teuthology.orchestra.run.smithi006.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 2.1 MB/s | 126 kB 00:00 2024-08-17T02:24:20.024 INFO:teuthology.orchestra.run.smithi006.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 7.7 MB/s | 458 kB 00:00 2024-08-17T02:24:20.066 INFO:teuthology.orchestra.run.smithi006.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 1.1 MB/s | 45 kB 00:00 2024-08-17T02:24:20.133 INFO:teuthology.orchestra.run.smithi006.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 1.8 MB/s | 120 kB 00:00 2024-08-17T02:24:20.208 INFO:teuthology.orchestra.run.smithi006.stdout:(20/133): python3-cephfs-17.2.7-1375.g2577e813. 2.4 MB/s | 182 kB 00:00 2024-08-17T02:24:20.308 INFO:teuthology.orchestra.run.smithi006.stdout:(21/133): librgw2-17.2.7-1375.g2577e813.el9.x86 15 MB/s | 4.9 MB 00:00 2024-08-17T02:24:20.342 INFO:teuthology.orchestra.run.smithi006.stdout:(22/133): python3-rados-17.2.7-1375.g2577e813.e 2.7 MB/s | 369 kB 00:00 2024-08-17T02:24:20.376 INFO:teuthology.orchestra.run.smithi006.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 5.0 MB/s | 344 kB 00:00 2024-08-17T02:24:20.401 INFO:teuthology.orchestra.run.smithi006.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.9 MB/s | 116 kB 00:00 2024-08-17T02:24:20.404 INFO:teuthology.orchestra.run.smithi136.stdout:(47/133): ceph-test-17.2.7-1375.g2577e813.el9.x 12 MB/s | 48 MB 00:03 2024-08-17T02:24:20.426 INFO:teuthology.orchestra.run.smithi006.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.6 MB/s | 82 kB 00:00 2024-08-17T02:24:20.477 INFO:teuthology.orchestra.run.smithi006.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 3.2 MB/s | 165 kB 00:00 2024-08-17T02:24:20.487 INFO:teuthology.orchestra.run.smithi136.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 262 kB/s | 22 kB 00:00 2024-08-17T02:24:20.544 INFO:teuthology.orchestra.run.smithi006.stdout:(27/133): ceph-grafana-dashboards-17.2.7-1375.g 366 kB/s | 24 kB 00:00 2024-08-17T02:24:20.596 INFO:teuthology.orchestra.run.smithi136.stdout:(49/133): automake-1.16.2-8.el9.noarch.rpm 960 kB/s | 689 kB 00:00 2024-08-17T02:24:20.621 INFO:teuthology.orchestra.run.smithi136.stdout:(50/133): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-08-17T02:24:20.627 INFO:teuthology.orchestra.run.smithi006.stdout:(28/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 13 MB/s | 2.9 MB 00:00 2024-08-17T02:24:20.652 INFO:teuthology.orchestra.run.smithi006.stdout:(29/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 1.1 MB/s | 124 kB 00:00 2024-08-17T02:24:20.655 INFO:teuthology.orchestra.run.smithi136.stdout:(51/133): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-08-17T02:24:20.681 INFO:teuthology.orchestra.run.smithi136.stdout:(52/133): flexiblas-3.0.4-8.el9.x86_64.rpm 390 kB/s | 33 kB 00:00 2024-08-17T02:24:20.706 INFO:teuthology.orchestra.run.smithi136.stdout:(53/133): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-08-17T02:24:20.731 INFO:teuthology.orchestra.run.smithi136.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-08-17T02:24:20.815 INFO:teuthology.orchestra.run.smithi136.stdout:(55/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 544 kB/s | 45 kB 00:00 2024-08-17T02:24:20.840 INFO:teuthology.orchestra.run.smithi136.stdout:(56/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-08-17T02:24:20.982 INFO:teuthology.orchestra.run.smithi136.stdout:(57/133): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-08-17T02:24:21.007 INFO:teuthology.orchestra.run.smithi136.stdout:(58/133): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-08-17T02:24:21.033 INFO:teuthology.orchestra.run.smithi136.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 507 kB/s | 25 kB 00:00 2024-08-17T02:24:21.058 INFO:teuthology.orchestra.run.smithi136.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-08-17T02:24:21.108 INFO:teuthology.orchestra.run.smithi136.stdout:(61/133): openblas-0.3.21-2.el9.x86_64.rpm 704 kB/s | 35 kB 00:00 2024-08-17T02:24:21.134 INFO:teuthology.orchestra.run.smithi136.stdout:(62/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-08-17T02:24:21.161 INFO:teuthology.orchestra.run.smithi006.stdout:(30/133): ceph-test-17.2.7-1375.g2577e813.el9.x 20 MB/s | 48 MB 00:02 2024-08-17T02:24:21.253 INFO:teuthology.orchestra.run.smithi006.stdout:(31/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 5.4 MB/s | 3.4 MB 00:00 2024-08-17T02:24:21.278 INFO:teuthology.orchestra.run.smithi006.stdout:(32/133): ceph-mgr-modules-core-17.2.7-1375.g25 2.0 MB/s | 240 kB 00:00 2024-08-17T02:24:21.304 INFO:teuthology.orchestra.run.smithi006.stdout:(33/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 954 kB/s | 47 kB 00:00 2024-08-17T02:24:21.309 INFO:teuthology.orchestra.run.smithi136.stdout:(63/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.4 MB/s | 3.0 MB 00:00 2024-08-17T02:24:21.329 INFO:teuthology.orchestra.run.smithi006.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 291 kB/s | 15 kB 00:00 2024-08-17T02:24:21.354 INFO:teuthology.orchestra.run.smithi006.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 5.3 MB/s | 269 kB 00:00 2024-08-17T02:24:21.379 INFO:teuthology.orchestra.run.smithi006.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.6 MB/s | 83 kB 00:00 2024-08-17T02:24:21.405 INFO:teuthology.orchestra.run.smithi006.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 364 kB/s | 18 kB 00:00 2024-08-17T02:24:21.530 INFO:teuthology.orchestra.run.smithi006.stdout:(38/133): ceph-mgr-diskprediction-local-17.2.7- 8.4 MB/s | 7.4 MB 00:00 2024-08-17T02:24:21.555 INFO:teuthology.orchestra.run.smithi006.stdout:(39/133): fuse-2.9.9-16.el9.x86_64.rpm 455 kB/s | 80 kB 00:00 2024-08-17T02:24:21.631 INFO:teuthology.orchestra.run.smithi006.stdout:(40/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-08-17T02:24:21.656 INFO:teuthology.orchestra.run.smithi006.stdout:(41/133): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-08-17T02:24:21.690 INFO:teuthology.orchestra.run.smithi006.stdout:(42/133): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-08-17T02:24:21.723 INFO:teuthology.orchestra.run.smithi006.stdout:(43/133): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-08-17T02:24:21.749 INFO:teuthology.orchestra.run.smithi006.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-08-17T02:24:21.774 INFO:teuthology.orchestra.run.smithi006.stdout:(45/133): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-08-17T02:24:21.800 INFO:teuthology.orchestra.run.smithi006.stdout:(46/133): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-08-17T02:24:21.833 INFO:teuthology.orchestra.run.smithi006.stdout:(47/133): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-08-17T02:24:21.925 INFO:teuthology.orchestra.run.smithi006.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 238 kB/s | 22 kB 00:00 2024-08-17T02:24:21.959 INFO:teuthology.orchestra.run.smithi136.stdout:(64/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 5.4 MB/s | 4.4 MB 00:00 2024-08-17T02:24:22.042 INFO:teuthology.orchestra.run.smithi006.stdout:(49/133): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-08-17T02:24:22.051 INFO:teuthology.orchestra.run.smithi136.stdout:(65/133): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-08-17T02:24:22.067 INFO:teuthology.orchestra.run.smithi006.stdout:(50/133): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-08-17T02:24:22.102 INFO:teuthology.orchestra.run.smithi006.stdout:(51/133): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-08-17T02:24:22.135 INFO:teuthology.orchestra.run.smithi136.stdout:(66/133): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-08-17T02:24:22.151 INFO:teuthology.orchestra.run.smithi006.stdout:(52/133): flexiblas-openblas-openmp-3.0.4-8.el9 368 kB/s | 18 kB 00:00 2024-08-17T02:24:22.176 INFO:teuthology.orchestra.run.smithi006.stdout:(53/133): flexiblas-3.0.4-8.el9.x86_64.rpm 244 kB/s | 33 kB 00:00 2024-08-17T02:24:22.185 INFO:teuthology.orchestra.run.smithi136.stdout:(67/133): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-08-17T02:24:22.202 INFO:teuthology.orchestra.run.smithi006.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-08-17T02:24:22.235 INFO:teuthology.orchestra.run.smithi136.stdout:(68/133): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-08-17T02:24:22.252 INFO:teuthology.orchestra.run.smithi006.stdout:(55/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-08-17T02:24:22.294 INFO:teuthology.orchestra.run.smithi136.stdout:(69/133): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-08-17T02:24:22.302 INFO:teuthology.orchestra.run.smithi006.stdout:(56/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-08-17T02:24:22.352 INFO:teuthology.orchestra.run.smithi136.stdout:(70/133): python3-markupsafe-1.1.1-12.el9.x86_6 599 kB/s | 35 kB 00:00 2024-08-17T02:24:22.386 INFO:teuthology.orchestra.run.smithi006.stdout:(57/133): librdkafka-1.6.1-102.el9.x86_64.rpm 4.9 MB/s | 662 kB 00:00 2024-08-17T02:24:22.453 INFO:teuthology.orchestra.run.smithi006.stdout:(58/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 382 kB/s | 25 kB 00:00 2024-08-17T02:24:22.478 INFO:teuthology.orchestra.run.smithi006.stdout:(59/133): libtool-2.4.6-46.el9.x86_64.rpm 3.2 MB/s | 581 kB 00:00 2024-08-17T02:24:22.503 INFO:teuthology.orchestra.run.smithi006.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 951 kB/s | 47 kB 00:00 2024-08-17T02:24:22.519 INFO:teuthology.orchestra.run.smithi136.stdout:(71/133): python3-babel-2.9.1-2.el9.noarch.rpm 4.9 MB/s | 6.0 MB 00:01 2024-08-17T02:24:22.553 INFO:teuthology.orchestra.run.smithi006.stdout:(61/133): openblas-0.3.21-2.el9.x86_64.rpm 704 kB/s | 35 kB 00:00 2024-08-17T02:24:22.579 INFO:teuthology.orchestra.run.smithi006.stdout:(62/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-08-17T02:24:22.595 INFO:teuthology.orchestra.run.smithi136.stdout:(72/133): openblas-openmp-0.3.21-2.el9.x86_64.r 3.2 MB/s | 4.7 MB 00:01 2024-08-17T02:24:22.645 INFO:teuthology.orchestra.run.smithi136.stdout:(73/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-08-17T02:24:22.704 INFO:teuthology.orchestra.run.smithi136.stdout:(74/133): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-08-17T02:24:22.729 INFO:teuthology.orchestra.run.smithi136.stdout:(75/133): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 222 kB 00:00 2024-08-17T02:24:22.754 INFO:teuthology.orchestra.run.smithi136.stdout:(76/133): python3-prettytable-0.7.2-27.el9.noar 847 kB/s | 42 kB 00:00 2024-08-17T02:24:22.804 INFO:teuthology.orchestra.run.smithi136.stdout:(77/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-08-17T02:24:22.847 INFO:teuthology.orchestra.run.smithi136.stdout:(78/133): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-08-17T02:24:22.874 INFO:teuthology.orchestra.run.smithi136.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 739 kB/s | 51 kB 00:00 2024-08-17T02:24:22.879 INFO:teuthology.orchestra.run.smithi006.stdout:(63/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.7 MB/s | 3.0 MB 00:00 2024-08-17T02:24:22.899 INFO:teuthology.orchestra.run.smithi136.stdout:(80/133): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-17T02:24:22.949 INFO:teuthology.orchestra.run.smithi136.stdout:(81/133): python3-toml-0.10.2-6.el9.noarch.rpm 833 kB/s | 42 kB 00:00 2024-08-17T02:24:23.033 INFO:teuthology.orchestra.run.smithi136.stdout:(82/133): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-08-17T02:24:23.091 INFO:teuthology.orchestra.run.smithi136.stdout:(83/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-08-17T02:24:23.150 INFO:teuthology.orchestra.run.smithi136.stdout:(84/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-08-17T02:24:23.280 INFO:teuthology.orchestra.run.smithi136.stdout:(85/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.5 MB/s | 5.1 MB 00:00 2024-08-17T02:24:23.300 INFO:teuthology.orchestra.run.smithi136.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 299 kB/s | 45 kB 00:00 2024-08-17T02:24:23.379 INFO:teuthology.orchestra.run.smithi006.stdout:(64/133): openblas-openmp-0.3.21-2.el9.x86_64.r 5.7 MB/s | 4.7 MB 00:00 2024-08-17T02:24:23.384 INFO:teuthology.orchestra.run.smithi136.stdout:(87/133): liboath-2.6.7-2.el9.x86_64.rpm 586 kB/s | 49 kB 00:00 2024-08-17T02:24:23.409 INFO:teuthology.orchestra.run.smithi136.stdout:(88/133): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-08-17T02:24:23.443 INFO:teuthology.orchestra.run.smithi136.stdout:(89/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.9 MB/s | 309 kB 00:00 2024-08-17T02:24:23.446 INFO:teuthology.orchestra.run.smithi006.stdout:(65/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 5.1 MB/s | 4.4 MB 00:00 2024-08-17T02:24:23.460 INFO:teuthology.orchestra.run.smithi136.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.6 MB/s | 43 kB 00:00 2024-08-17T02:24:23.477 INFO:teuthology.orchestra.run.smithi136.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.9 MB/s | 32 kB 00:00 2024-08-17T02:24:23.488 INFO:teuthology.orchestra.run.smithi006.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-08-17T02:24:23.493 INFO:teuthology.orchestra.run.smithi136.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 863 kB/s | 14 kB 00:00 2024-08-17T02:24:23.519 INFO:teuthology.orchestra.run.smithi136.stdout:(93/133): python3-asyncssh-2.13.2-5.el9.noarch. 4.9 MB/s | 548 kB 00:00 2024-08-17T02:24:23.544 INFO:teuthology.orchestra.run.smithi136.stdout:(94/133): python3-cheroot-8.6.0-4.el9.noarch.rp 3.4 MB/s | 172 kB 00:00 2024-08-17T02:24:23.546 INFO:teuthology.orchestra.run.smithi006.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-08-17T02:24:23.572 INFO:teuthology.orchestra.run.smithi006.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 307 kB/s | 26 kB 00:00 2024-08-17T02:24:23.578 INFO:teuthology.orchestra.run.smithi136.stdout:(95/133): python3-cherrypy-18.6.1-2.el9.noarch. 6.0 MB/s | 358 kB 00:00 2024-08-17T02:24:23.597 INFO:teuthology.orchestra.run.smithi006.stdout:(69/133): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-08-17T02:24:23.603 INFO:teuthology.orchestra.run.smithi136.stdout:(96/133): python3-google-auth-2.33.0-1.el9.noar 3.7 MB/s | 220 kB 00:00 2024-08-17T02:24:23.628 INFO:teuthology.orchestra.run.smithi136.stdout:(97/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 434 kB/s | 11 kB 00:00 2024-08-17T02:24:23.654 INFO:teuthology.orchestra.run.smithi136.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 353 kB/s | 18 kB 00:00 2024-08-17T02:24:23.664 INFO:teuthology.orchestra.run.smithi006.stdout:(70/133): python3-markupsafe-1.1.1-12.el9.x86_6 521 kB/s | 35 kB 00:00 2024-08-17T02:24:23.679 INFO:teuthology.orchestra.run.smithi136.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 461 kB/s | 23 kB 00:00 2024-08-17T02:24:23.689 INFO:teuthology.orchestra.run.smithi006.stdout:(71/133): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-08-17T02:24:23.704 INFO:teuthology.orchestra.run.smithi136.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-08-17T02:24:23.729 INFO:teuthology.orchestra.run.smithi136.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-08-17T02:24:23.755 INFO:teuthology.orchestra.run.smithi136.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 180 kB/s | 9.0 kB 00:00 2024-08-17T02:24:23.782 INFO:teuthology.orchestra.run.smithi136.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 815 kB/s | 41 kB 00:00 2024-08-17T02:24:23.790 INFO:teuthology.orchestra.run.smithi006.stdout:(72/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-08-17T02:24:23.805 INFO:teuthology.orchestra.run.smithi136.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:24:23.830 INFO:teuthology.orchestra.run.smithi136.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:24:23.856 INFO:teuthology.orchestra.run.smithi136.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:24:23.874 INFO:teuthology.orchestra.run.smithi006.stdout:(73/133): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-08-17T02:24:23.889 INFO:teuthology.orchestra.run.smithi136.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-17T02:24:23.914 INFO:teuthology.orchestra.run.smithi136.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 669 kB/s | 16 kB 00:00 2024-08-17T02:24:23.932 INFO:teuthology.orchestra.run.smithi006.stdout:(74/133): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-08-17T02:24:23.940 INFO:teuthology.orchestra.run.smithi136.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-17T02:24:23.965 INFO:teuthology.orchestra.run.smithi136.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-08-17T02:24:23.974 INFO:teuthology.orchestra.run.smithi006.stdout:(75/133): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-08-17T02:24:23.999 INFO:teuthology.orchestra.run.smithi136.stdout:(111/133): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-08-17T02:24:24.024 INFO:teuthology.orchestra.run.smithi136.stdout:(112/133): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2024-08-17T02:24:24.050 INFO:teuthology.orchestra.run.smithi136.stdout:(113/133): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-08-17T02:24:24.058 INFO:teuthology.orchestra.run.smithi006.stdout:(76/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-08-17T02:24:24.074 INFO:teuthology.orchestra.run.smithi136.stdout:(114/133): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-08-17T02:24:24.118 INFO:teuthology.orchestra.run.smithi136.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-08-17T02:24:24.142 INFO:teuthology.orchestra.run.smithi136.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.8 MB/s | 90 kB 00:00 2024-08-17T02:24:24.167 INFO:teuthology.orchestra.run.smithi136.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-08-17T02:24:24.193 INFO:teuthology.orchestra.run.smithi136.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 807 kB/s | 20 kB 00:00 2024-08-17T02:24:24.216 INFO:teuthology.orchestra.run.smithi006.stdout:(77/133): python3-babel-2.9.1-2.el9.noarch.rpm 4.5 MB/s | 6.0 MB 00:01 2024-08-17T02:24:24.226 INFO:teuthology.orchestra.run.smithi136.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-08-17T02:24:24.242 INFO:teuthology.orchestra.run.smithi006.stdout:(78/133): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-08-17T02:24:24.267 INFO:teuthology.orchestra.run.smithi006.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-17T02:24:24.285 INFO:teuthology.orchestra.run.smithi136.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-08-17T02:24:24.292 INFO:teuthology.orchestra.run.smithi006.stdout:(80/133): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-17T02:24:24.334 INFO:teuthology.orchestra.run.smithi006.stdout:(81/133): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-08-17T02:24:24.443 INFO:teuthology.orchestra.run.smithi006.stdout:(82/133): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-08-17T02:24:24.493 INFO:teuthology.orchestra.run.smithi006.stdout:(83/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-08-17T02:24:24.502 INFO:teuthology.orchestra.run.smithi136.stdout:(121/133): librados2-17.2.7-1375.g2577e813.el9. 11 MB/s | 3.1 MB 00:00 2024-08-17T02:24:24.543 INFO:teuthology.orchestra.run.smithi006.stdout:(84/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-17T02:24:24.594 INFO:teuthology.orchestra.run.smithi006.stdout:(85/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 900 kB/s | 45 kB 00:00 2024-08-17T02:24:24.602 INFO:teuthology.orchestra.run.smithi136.stdout:(122/133): librbd1-17.2.7-1375.g2577e813.el9.x8 9.3 MB/s | 2.9 MB 00:00 2024-08-17T02:24:24.694 INFO:teuthology.orchestra.run.smithi006.stdout:(86/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 3.0 MB/s | 309 kB 00:00 2024-08-17T02:24:24.719 INFO:teuthology.orchestra.run.smithi006.stdout:(87/133): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-17T02:24:24.753 INFO:teuthology.orchestra.run.smithi006.stdout:(88/133): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-08-17T02:24:24.828 INFO:teuthology.orchestra.run.smithi006.stdout:(89/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.4 MB/s | 5.1 MB 00:01 2024-08-17T02:24:24.904 INFO:teuthology.orchestra.run.smithi006.stdout:(90/133): python3-asyncssh-2.13.2-5.el9.noarch. 3.6 MB/s | 548 kB 00:00 2024-08-17T02:24:24.929 INFO:teuthology.orchestra.run.smithi006.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.4 MB/s | 32 kB 00:00 2024-08-17T02:24:24.936 INFO:teuthology.orchestra.run.smithi136.stdout:(123/133): NetworkManager-libnm-1.48.2-2.el9.x8 5.4 MB/s | 1.8 MB 00:00 2024-08-17T02:24:24.954 INFO:teuthology.orchestra.run.smithi006.stdout:(92/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 347 kB/s | 43 kB 00:00 2024-08-17T02:24:24.979 INFO:teuthology.orchestra.run.smithi006.stdout:(93/133): python3-certifi-2023.05.07-4.el9.noar 282 kB/s | 14 kB 00:00 2024-08-17T02:24:24.986 INFO:teuthology.orchestra.run.smithi136.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 821 kB/s | 41 kB 00:00 2024-08-17T02:24:25.013 INFO:teuthology.orchestra.run.smithi006.stdout:(94/133): python3-cheroot-8.6.0-4.el9.noarch.rp 2.9 MB/s | 172 kB 00:00 2024-08-17T02:24:25.046 INFO:teuthology.orchestra.run.smithi006.stdout:(95/133): python3-cherrypy-18.6.1-2.el9.noarch. 5.2 MB/s | 358 kB 00:00 2024-08-17T02:24:25.071 INFO:teuthology.orchestra.run.smithi006.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 430 kB/s | 11 kB 00:00 2024-08-17T02:24:25.094 INFO:teuthology.orchestra.run.smithi136.stdout:(125/133): NetworkManager-1.48.2-2.el9.x86_64.r 3.9 MB/s | 2.3 MB 00:00 2024-08-17T02:24:25.097 INFO:teuthology.orchestra.run.smithi006.stdout:(97/133): python3-google-auth-2.33.0-1.el9.noar 2.6 MB/s | 220 kB 00:00 2024-08-17T02:24:25.122 INFO:teuthology.orchestra.run.smithi006.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 353 kB/s | 18 kB 00:00 2024-08-17T02:24:25.147 INFO:teuthology.orchestra.run.smithi006.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 461 kB/s | 23 kB 00:00 2024-08-17T02:24:25.153 INFO:teuthology.orchestra.run.smithi136.stdout:(126/133): NetworkManager-tui-1.48.2-2.el9.x86_ 1.4 MB/s | 247 kB 00:00 2024-08-17T02:24:25.173 INFO:teuthology.orchestra.run.smithi006.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-08-17T02:24:25.178 INFO:teuthology.orchestra.run.smithi136.stdout:(127/133): elfutils-debuginfod-client-0.191-4.e 440 kB/s | 37 kB 00:00 2024-08-17T02:24:25.207 INFO:teuthology.orchestra.run.smithi006.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 334 kB/s | 20 kB 00:00 2024-08-17T02:24:25.232 INFO:teuthology.orchestra.run.smithi006.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 154 kB/s | 9.0 kB 00:00 2024-08-17T02:24:25.237 INFO:teuthology.orchestra.run.smithi136.stdout:(128/133): elfutils-libs-0.191-4.el9.x86_64.rpm 4.3 MB/s | 260 kB 00:00 2024-08-17T02:24:25.257 INFO:teuthology.orchestra.run.smithi006.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 818 kB/s | 41 kB 00:00 2024-08-17T02:24:25.283 INFO:teuthology.orchestra.run.smithi006.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:24:25.308 INFO:teuthology.orchestra.run.smithi006.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:24:25.320 INFO:teuthology.orchestra.run.smithi136.stdout:(129/133): elfutils-libelf-0.191-4.el9.x86_64.r 1.2 MB/s | 207 kB 00:00 2024-08-17T02:24:25.333 INFO:teuthology.orchestra.run.smithi006.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:24:25.367 INFO:teuthology.orchestra.run.smithi006.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-17T02:24:25.392 INFO:teuthology.orchestra.run.smithi006.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 666 kB/s | 16 kB 00:00 2024-08-17T02:24:25.417 INFO:teuthology.orchestra.run.smithi006.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-17T02:24:25.442 INFO:teuthology.orchestra.run.smithi006.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-08-17T02:24:25.476 INFO:teuthology.orchestra.run.smithi006.stdout:(111/133): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-08-17T02:24:25.502 INFO:teuthology.orchestra.run.smithi006.stdout:(112/133): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-08-17T02:24:25.512 INFO:teuthology.orchestra.run.smithi136.stdout:(130/133): openssl-3.2.2-2.el9.x86_64.rpm 4.9 MB/s | 1.4 MB 00:00 2024-08-17T02:24:25.527 INFO:teuthology.orchestra.run.smithi006.stdout:(113/133): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-08-17T02:24:25.552 INFO:teuthology.orchestra.run.smithi006.stdout:(114/133): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-17T02:24:25.577 INFO:teuthology.orchestra.run.smithi006.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-08-17T02:24:25.603 INFO:teuthology.orchestra.run.smithi006.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-17T02:24:25.628 INFO:teuthology.orchestra.run.smithi006.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-17T02:24:25.653 INFO:teuthology.orchestra.run.smithi006.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-08-17T02:24:25.696 INFO:teuthology.orchestra.run.smithi136.stdout:(131/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 5.9 MB/s | 1.1 MB 00:00 2024-08-17T02:24:25.712 INFO:teuthology.orchestra.run.smithi006.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-08-17T02:24:25.770 INFO:teuthology.orchestra.run.smithi006.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-08-17T02:24:26.013 INFO:teuthology.orchestra.run.smithi006.stdout:(121/133): librados2-17.2.7-1375.g2577e813.el9. 10 MB/s | 3.1 MB 00:00 2024-08-17T02:24:26.071 INFO:teuthology.orchestra.run.smithi006.stdout:(122/133): librbd1-17.2.7-1375.g2577e813.el9.x8 9.8 MB/s | 2.9 MB 00:00 2024-08-17T02:24:26.196 INFO:teuthology.orchestra.run.smithi006.stdout:(123/133): NetworkManager-1.48.2-2.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-08-17T02:24:26.238 INFO:teuthology.orchestra.run.smithi006.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 978 kB/s | 41 kB 00:00 2024-08-17T02:24:26.280 INFO:teuthology.orchestra.run.smithi006.stdout:(125/133): NetworkManager-tui-1.48.2-2.el9.x86_ 5.8 MB/s | 247 kB 00:00 2024-08-17T02:24:26.322 INFO:teuthology.orchestra.run.smithi006.stdout:(126/133): NetworkManager-libnm-1.48.2-2.el9.x8 7.2 MB/s | 1.8 MB 00:00 2024-08-17T02:24:26.347 INFO:teuthology.orchestra.run.smithi006.stdout:(127/133): elfutils-debuginfod-client-0.191-4.e 550 kB/s | 37 kB 00:00 2024-08-17T02:24:26.373 INFO:teuthology.orchestra.run.smithi006.stdout:(128/133): elfutils-libelf-0.191-4.el9.x86_64.r 4.0 MB/s | 207 kB 00:00 2024-08-17T02:24:26.398 INFO:teuthology.orchestra.run.smithi006.stdout:(129/133): elfutils-libs-0.191-4.el9.x86_64.rpm 5.1 MB/s | 260 kB 00:00 2024-08-17T02:24:26.449 INFO:teuthology.orchestra.run.smithi006.stdout:(130/133): openssl-3.2.2-2.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-08-17T02:24:26.513 INFO:teuthology.orchestra.run.smithi136.stdout:(132/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.5 MB/s | 16 MB 00:03 2024-08-17T02:24:26.516 INFO:teuthology.orchestra.run.smithi006.stdout:(131/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-08-17T02:24:26.558 INFO:teuthology.orchestra.run.smithi006.stdout:(132/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 10 MB/s | 1.1 MB 00:00 2024-08-17T02:24:26.654 INFO:teuthology.orchestra.run.smithi136.stdout:(133/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 1.8 MB/s | 2.4 MB 00:01 2024-08-17T02:24:26.660 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:24:26.660 INFO:teuthology.orchestra.run.smithi136.stdout:Total 16 MB/s | 206 MB 00:12 2024-08-17T02:24:26.950 INFO:teuthology.orchestra.run.smithi006.stdout:(133/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.1 MB/s | 16 MB 00:02 2024-08-17T02:24:26.955 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:24:26.955 INFO:teuthology.orchestra.run.smithi006.stdout:Total 20 MB/s | 206 MB 00:10 2024-08-17T02:24:28.355 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-08-17T02:24:28.563 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-08-17T02:24:28.563 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-08-17T02:24:28.693 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-08-17T02:24:28.922 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-08-17T02:24:28.922 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-08-17T02:24:30.634 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-08-17T02:24:30.634 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-08-17T02:24:31.184 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-08-17T02:24:31.185 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-08-17T02:24:36.436 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-08-17T02:24:36.542 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:24:36.598 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:24:36.675 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:24:36.719 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:24:36.751 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:24:36.815 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:24:37.018 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-08-17T02:24:37.113 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:24:37.155 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:24:37.164 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:24:37.230 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:24:37.272 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:24:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:24:37.331 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:24:37.391 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:24:37.403 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:24:37.435 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:24:37.544 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:24:37.748 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:24:37.848 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:24:37.986 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:24:38.014 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:24:38.015 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:24:38.053 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:24:38.151 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:24:38.175 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:24:38.246 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:24:38.280 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:24:38.393 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:24:38.423 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:24:38.585 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:24:38.648 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:24:38.675 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:24:38.778 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:24:38.860 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:24:38.894 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:24:38.896 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:24:39.018 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:24:39.045 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:24:39.118 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:24:39.190 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:24:39.193 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:24:39.302 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:24:39.415 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:24:39.499 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:24:39.685 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:24:39.762 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:24:39.789 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:24:39.829 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:24:39.873 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:24:39.879 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:24:39.955 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:24:39.979 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:24:40.014 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:24:40.049 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:24:40.138 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:24:40.209 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:24:40.244 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:24:40.294 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:24:40.336 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:24:40.379 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:24:40.385 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:24:40.430 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:24:40.431 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:24:40.478 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:24:40.516 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:24:40.563 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:24:40.568 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:24:40.596 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:24:40.689 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:24:40.738 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:24:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:24:40.791 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:24:40.806 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:24:40.839 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:24:40.928 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:24:40.962 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:24:41.008 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:24:41.105 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:24:41.299 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:24:41.367 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:24:41.456 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:24:41.556 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:24:41.633 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:24:41.709 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:24:41.753 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:24:41.791 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:24:41.967 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:24:42.064 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:24:42.169 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:24:42.217 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:24:42.268 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:24:42.312 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:24:42.351 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:24:42.564 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:24:42.617 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:24:42.651 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:24:42.688 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:24:42.714 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:24:42.770 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:24:42.800 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:24:42.810 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:24:42.844 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:24:42.845 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:24:42.880 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:24:42.903 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:24:42.956 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:24:43.000 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:24:43.005 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:24:43.174 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:24:43.239 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:24:43.282 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:24:43.338 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:24:43.393 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:24:43.406 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:24:43.464 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:24:43.516 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:24:43.555 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:24:43.574 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:24:43.592 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:24:43.624 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:24:43.630 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:24:43.667 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:24:43.668 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:24:43.701 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:24:43.735 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:24:43.778 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:24:43.799 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:24:43.819 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:24:43.840 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:24:43.854 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:24:43.893 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:24:43.904 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:24:43.923 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:24:43.960 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:24:43.998 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:24:44.024 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:24:44.035 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:24:44.070 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:24:44.084 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:24:44.103 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:24:44.147 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:24:44.179 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:24:44.214 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:24:44.266 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:24:44.395 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:24:44.472 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:24:44.950 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:24:45.011 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:24:45.045 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:24:45.158 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:24:45.212 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:24:45.435 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:24:45.439 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:24:45.468 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:24:45.514 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:24:45.547 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:24:45.559 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:24:45.670 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:24:45.714 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:24:45.947 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:24:45.986 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:24:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:24:46.352 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:24:46.487 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:24:46.957 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:24:47.122 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:24:48.031 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:24:48.137 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:24:48.173 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:24:48.206 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:24:48.528 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:24:48.568 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:24:48.683 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:24:48.720 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:24:48.838 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:24:48.941 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:24:48.978 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:24:49.011 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:24:49.347 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:24:49.397 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:24:49.505 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:24:49.532 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:24:51.386 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:24:51.424 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:24:52.017 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:24:52.061 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:24:52.199 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:24:52.199 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:24:52.199 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:24:52.199 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:24:52.245 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:24:52.247 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:24:52.286 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:24:52.911 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:24:52.957 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:24:53.136 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:24:53.136 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:24:53.136 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:24:53.136 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:24:53.174 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:25:04.236 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:25:04.236 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /sys 2024-08-17T02:25:04.236 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /proc 2024-08-17T02:25:04.236 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /mnt 2024-08-17T02:25:04.236 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /var/tmp 2024-08-17T02:25:04.236 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /home 2024-08-17T02:25:04.236 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /root 2024-08-17T02:25:04.236 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /tmp 2024-08-17T02:25:04.236 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:04.436 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:25:04.478 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:25:04.479 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:04.479 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:25:04.479 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:05.564 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:25:05.565 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /sys 2024-08-17T02:25:05.565 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /proc 2024-08-17T02:25:05.565 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /mnt 2024-08-17T02:25:05.565 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /var/tmp 2024-08-17T02:25:05.565 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /home 2024-08-17T02:25:05.565 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /root 2024-08-17T02:25:05.565 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /tmp 2024-08-17T02:25:05.565 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:05.769 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:25:05.806 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:25:05.806 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:05.806 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:25:05.806 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:05.932 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:25:05.989 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:25:05.989 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:05.990 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:25:05.990 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:25:05.990 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:25:05.990 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:06.215 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:25:06.266 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:25:06.266 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:06.266 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:25:06.266 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:25:06.266 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:25:06.266 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:06.674 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:25:06.725 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:25:06.725 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:06.726 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:25:06.726 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:25:06.726 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:25:06.726 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:06.850 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:25:06.909 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:25:06.974 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:25:07.204 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:25:07.262 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:25:07.314 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:25:07.347 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:25:07.373 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:25:07.373 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:07.374 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:25:07.374 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:25:07.374 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:25:07.374 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:07.472 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:25:07.614 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:25:07.641 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:25:07.666 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:25:07.666 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:07.666 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:25:07.666 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:25:07.667 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:25:07.667 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:07.700 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:25:07.726 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:25:07.762 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:25:07.810 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:25:07.836 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:25:08.100 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:25:08.152 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:25:08.152 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:08.152 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:25:08.152 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:25:08.152 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:25:08.152 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:25:08.356 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:25:08.382 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:25:08.411 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:25:08.429 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:25:08.441 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:25:08.510 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:25:08.542 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:25:08.685 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:25:08.756 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:25:08.846 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:25:08.956 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:25:09.137 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:25:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:25:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:25:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:25:09.296 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:25:09.321 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:25:09.679 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:25:09.719 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:25:09.851 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:25:09.878 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:25:09.908 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:25:09.972 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:25:10.000 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:25:10.797 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:25:10.828 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:25:10.963 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:25:11.122 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:25:11.155 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:25:11.206 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:25:11.206 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:11.206 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:25:11.207 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:25:11.207 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:25:11.207 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:11.230 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:25:11.256 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:25:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:25:11.281 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:25:11.382 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:25:11.437 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:25:12.421 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:25:12.444 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:25:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:25:12.755 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:25:12.764 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:25:12.792 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:25:12.817 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:25:12.870 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:25:12.870 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:12.870 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:25:12.870 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:25:12.870 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:25:12.870 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:12.905 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:25:12.905 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:12.905 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:25:12.905 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:25:12.906 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:25:12.906 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:12.922 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:25:12.949 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:25:12.960 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:25:13.009 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:25:13.009 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:13.009 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:25:13.010 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:13.058 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:25:13.112 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:25:13.128 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:25:13.168 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:25:13.168 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:13.168 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:25:13.169 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:25:13.169 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:25:13.169 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:13.478 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:25:13.529 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:25:13.529 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:13.529 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:25:13.529 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:25:13.529 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:25:13.529 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:14.525 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:25:14.567 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:25:14.735 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:25:14.735 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:14.735 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:25:14.735 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:25:14.735 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:25:14.735 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:14.860 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:25:14.910 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:25:14.911 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:14.911 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:25:14.911 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:14.977 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:25:15.028 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:25:15.028 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:15.028 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:25:15.028 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:25:15.028 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:25:15.028 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:15.361 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:25:15.413 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:25:15.413 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:15.413 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:25:15.413 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:25:15.413 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:25:15.413 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:18.215 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:25:18.275 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:25:18.325 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:25:18.355 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:25:18.388 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:25:18.423 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:25:18.463 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:25:18.494 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:25:18.542 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:25:19.851 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:25:20.121 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:25:20.180 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:25:20.227 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:25:20.330 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:25:20.367 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:25:20.382 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:25:20.392 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:25:20.418 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:25:20.432 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:25:20.447 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:25:20.447 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:25:20.476 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:25:20.513 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:25:20.538 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:25:20.546 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:25:20.570 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:25:20.570 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:25:20.581 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:25:20.621 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:25:20.652 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:25:20.680 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:25:20.700 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:25:20.705 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:25:20.728 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:25:20.728 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:25:20.974 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:25:20.974 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:25:21.092 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:25:21.125 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:25:21.157 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:25:21.240 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:25:21.459 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:25:21.460 INFO:teuthology.orchestra.run.smithi136.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:25:21.460 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:22.107 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:25:22.368 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:25:22.437 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:25:22.486 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:25:22.599 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:25:22.632 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:25:22.656 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:25:22.682 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:25:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:25:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:25:22.819 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:25:22.851 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:25:22.852 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:25:22.945 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:25:22.969 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:25:22.986 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:25:22.986 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:25:23.230 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:25:23.230 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:25:23.332 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:25:23.363 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:25:23.400 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:25:23.474 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:25:23.677 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:25:23.677 INFO:teuthology.orchestra.run.smithi006.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:25:23.677 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:26.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:25:26.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:25:26.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:25:26.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:25:26.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:25:26.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:25:26.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:25:26.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:25:26.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:25:26.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:25:26.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:25:26.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:25:26.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:25:26.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:25:26.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:25:26.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:25:26.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:25:26.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:25:26.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:25:26.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:25:26.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:25:26.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:25:26.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:25:26.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:25:26.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:25:26.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:25:26.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:25:26.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:25:26.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:25:26.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:25:26.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:25:26.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:25:26.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:25:26.783 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:25:26.783 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:25:26.783 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:25:26.783 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:25:26.783 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:25:26.783 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:25:26.783 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:25:26.783 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:25:26.783 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:25:26.783 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:25:26.783 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:25:26.783 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:25:26.783 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:25:26.783 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:25:26.784 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:25:26.784 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:25:26.784 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:25:26.784 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:25:26.784 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:25:26.784 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:25:26.784 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:25:26.784 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:25:26.784 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:25:26.784 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:25:26.784 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:25:26.784 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:25:26.784 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:25:26.784 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:25:26.784 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:25:26.785 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:25:26.785 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:25:26.785 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:25:26.785 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:25:26.785 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:25:26.785 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:25:26.785 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:25:26.785 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:25:26.785 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:25:26.785 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:25:26.785 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:25:26.785 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:25:26.785 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:25:26.786 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:25:26.786 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:25:26.786 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:25:26.786 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:25:26.786 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:25:26.786 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:25:26.786 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:25:26.786 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:25:26.786 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:25:26.786 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:25:26.786 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:25:26.786 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:25:26.786 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:25:26.787 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:25:26.787 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:25:26.787 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:25:26.787 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:25:26.787 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:25:26.787 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:25:26.787 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:25:26.787 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:25:26.787 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:25:26.787 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:25:26.787 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:25:26.787 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:25:26.788 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:25:26.788 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:25:26.788 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:25:26.788 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:25:26.788 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:25:26.788 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:25:26.788 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:25:26.788 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:25:26.788 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:25:26.788 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:25:26.788 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:25:26.788 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:25:26.788 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:25:26.789 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:25:26.789 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:25:26.789 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:25:26.789 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:25:26.789 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:25:26.789 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:25:26.789 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:25:26.789 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:25:26.789 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:25:26.789 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:25:26.789 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:25:26.789 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:25:26.789 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:25:26.790 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:25:26.790 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:25:26.790 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:25:26.790 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:25:26.790 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:25:26.790 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:25:26.790 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:25:26.790 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:25:26.790 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:25:26.790 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:25:26.790 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:25:26.790 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:25:26.790 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:25:26.790 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:25:26.791 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:25:26.791 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:25:26.791 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:25:26.791 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:25:28.705 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:25:28.705 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:28.705 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2024-08-17T02:25:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:25:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:25:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:25:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:25:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:25:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:25:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:25:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:25:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:25:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:25:28.707 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-08-17T02:25:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:25:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:25:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:25:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:25:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:25:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:25:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:25:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:25:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:25:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:25:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:25:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:25:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:25:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:25:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:25:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:25:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:25:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:25:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:25:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:25:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:25:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:25:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:25:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:25:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:25:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:25:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:25:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:25:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:25:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:25:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:25:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:25:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:25:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:25:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:25:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:25:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:25:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:25:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:25:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:25:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:25:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:25:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:25:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:25:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:25:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:25:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:25:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:25:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:25:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:25:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:25:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:25:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:25:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:25:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:25:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:25:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:25:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:25:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:25:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:25:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:25:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:25:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:25:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:25:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:25:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:25:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:25:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:25:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:25:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:25:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:25:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:25:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:25:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:25:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:25:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:25:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:25:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:25:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:25:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:25:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:25:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:25:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:25:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:28.716 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-08-17T02:25:28.899 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:25:28.899 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:25:28.899 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:25:28.899 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:25:28.899 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:25:28.899 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:25:28.899 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:25:28.899 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:25:28.899 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:25:28.899 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:25:28.900 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:25:28.900 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:25:28.900 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:25:28.900 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:25:28.900 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:25:28.900 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:25:28.900 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:25:28.900 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:25:28.900 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:25:28.900 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:25:28.900 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:25:28.900 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:25:28.900 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:25:28.900 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:25:28.901 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:25:28.901 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:25:28.901 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:25:28.911 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:25:28.911 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:25:28.911 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:25:28.911 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:25:28.911 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:25:28.911 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:25:28.911 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:25:28.911 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:25:28.912 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:25:28.912 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:25:28.912 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:25:28.912 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:25:28.912 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:25:28.912 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:25:28.912 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:25:28.912 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:25:28.912 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:25:28.912 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:25:28.912 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:25:28.912 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:25:28.912 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:25:28.912 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:25:28.912 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:25:28.913 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:25:28.913 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:25:28.913 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:25:28.913 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:25:28.913 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:25:28.913 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:25:28.913 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:25:28.913 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:25:28.913 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:25:28.913 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:25:28.913 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:25:28.913 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:25:28.913 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:25:28.913 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:25:28.914 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:25:28.914 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:25:28.914 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:25:28.914 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:25:28.914 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:25:28.914 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:25:28.914 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:25:28.914 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:25:28.914 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:25:28.914 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:25:28.914 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:25:28.914 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:25:28.914 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:25:28.914 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:25:28.915 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:25:28.915 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:25:28.915 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:25:28.915 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:25:28.915 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:25:28.915 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:25:28.915 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:25:28.915 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:25:28.915 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:25:28.915 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:25:28.915 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:25:28.915 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:25:28.916 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:25:28.916 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:25:28.916 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:25:28.916 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:25:28.916 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:25:28.916 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:25:28.916 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:25:28.916 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:25:28.916 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:25:28.916 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:25:28.916 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:25:28.916 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:25:28.916 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:25:28.917 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:25:28.917 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:25:28.917 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:25:28.917 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:25:28.917 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:25:28.917 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:25:28.917 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:25:28.917 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:25:28.917 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:25:28.917 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:25:28.917 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:25:28.917 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:25:28.917 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:25:28.917 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:25:28.918 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:25:28.918 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:25:28.918 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:25:28.918 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:25:28.918 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:25:28.918 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:25:28.918 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:25:28.918 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:25:28.918 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:25:28.918 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:25:28.918 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:25:28.918 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:25:28.919 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:25:28.919 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:25:28.919 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:25:28.919 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:25:28.919 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:25:28.919 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:25:28.919 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:25:28.919 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:25:28.919 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:25:28.919 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:25:28.919 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:25:28.919 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:25:28.920 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:25:28.920 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:25:28.920 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:25:29.327 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:30.953 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:25:30.953 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:30.953 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2024-08-17T02:25:30.953 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:25:30.954 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:25:30.954 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:25:30.954 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:25:30.954 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:25:30.954 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:25:30.954 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:25:30.954 INFO:teuthology.orchestra.run.smithi006.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.954 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.954 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:25:30.954 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:25:30.954 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:25:30.954 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-08-17T02:25:30.954 INFO:teuthology.orchestra.run.smithi006.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:25:30.955 INFO:teuthology.orchestra.run.smithi006.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:25:30.955 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.955 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.955 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.955 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.955 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:30.955 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.955 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.955 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.955 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:30.955 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:30.955 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:30.956 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:30.956 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:30.956 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.956 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.956 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:30.956 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.956 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.956 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.956 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:30.956 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:30.956 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.956 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:25:30.956 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:25:30.956 INFO:teuthology.orchestra.run.smithi006.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:25:30.957 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:25:30.957 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:25:30.957 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:25:30.957 INFO:teuthology.orchestra.run.smithi006.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:25:30.957 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:25:30.957 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:25:30.957 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.957 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.957 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.957 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:25:30.957 INFO:teuthology.orchestra.run.smithi006.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:25:30.957 INFO:teuthology.orchestra.run.smithi006.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:25:30.957 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:25:30.958 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:25:30.958 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.958 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.958 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:25:30.958 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.958 INFO:teuthology.orchestra.run.smithi006.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:25:30.958 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:25:30.958 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:25:30.958 INFO:teuthology.orchestra.run.smithi006.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:25:30.958 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:25:30.958 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:25:30.958 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:25:30.959 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:25:30.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:25:30.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:25:30.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:25:30.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:25:30.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:25:30.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:25:30.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:25:30.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:25:30.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:25:30.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:25:30.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:25:30.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:25:30.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:25:30.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:25:30.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:25:30.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:25:30.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:25:30.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:25:30.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:25:30.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:25:30.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:25:30.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:25:30.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:25:30.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:25:30.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:25:30.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:25:30.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:25:30.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:25:30.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:25:30.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:25:30.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:25:30.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:25:30.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:25:30.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:25:30.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:25:30.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:25:30.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:25:30.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:25:30.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:25:30.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:25:30.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:25:30.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:25:30.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:25:30.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:25:30.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:25:30.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:25:30.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:25:30.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:25:30.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:25:30.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:25:30.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:25:30.963 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:25:30.963 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:25:30.963 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:25:30.963 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.963 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.963 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:25:30.963 INFO:teuthology.orchestra.run.smithi006.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:25:30.963 INFO:teuthology.orchestra.run.smithi006.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:25:30.963 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:25:30.963 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:25:30.963 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:25:30.964 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:30.964 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-08-17T02:25:31.621 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:31.622 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:25:31.767 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:25:31.813 INFO:teuthology.orchestra.run.smithi006.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:25:31.814 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:25:31.814 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:25:31.816 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:25:31.958 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:25:32.006 INFO:teuthology.orchestra.run.smithi136.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:25:32.006 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:25:32.007 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:25:32.009 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:25:32.009 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:25:32.009 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:25:32.070 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:25:32.070 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:25:32.127 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:25:32.128 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:25:32.128 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:25:32.187 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:25:32.288 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:25:32.288 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:25:32.344 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:25:32.439 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:25:32.440 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:25:32.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:25:32.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:25:32.596 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:25:32.597 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:25:32.652 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:25:32.748 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:25:32.748 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:25:32.748 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:25:32.805 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:25:32.904 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:25:32.904 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:25:32.961 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:25:33.056 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:25:33.133 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:25:33.134 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /var/log/ceph 2024-08-17T02:25:33.139 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /var/log/ceph 2024-08-17T02:25:33.197 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:25:33.198 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:25:33.201 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:25:33.255 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:25:33.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:25:33.259 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:25:33.321 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:25:33.321 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:25:33.321 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:25:33.321 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:25:33.321 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:25:33.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:33.521 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:33.577 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:25:33.577 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:25:33.612 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:33.779 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:33.840 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:25:33.840 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:25:33.841 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858270', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858270', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi006.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCW8pqtU2UjfzsRRoSEGRjhurzziBClP92HSW0K2fP3ZegV1AaIhuLqT9YQTLM4BJaAuknq77yfHrwbPSFP6+f4=', 'smithi136.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG37T+nao+9g/Yr1ilf47PEd6idCHG/u7OEG3zOJKjuQmaU4LaQYZYATK9KX7qREH1GrNm3G6GMAHlWBvc3PiW0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:02:08', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:25:33.841 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:25:33.845 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:25:33.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:25:33.922 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:25:33.977 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:25:33.978 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:25:34.014 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:25:34.015 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2024-08-17T02:25:34.091 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:25:34.091 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:34.091 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-08-17T02:25:34.091 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:34.091 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:25:34.091 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-08-17 02:25:24.044456111 +0000 2024-08-17T02:25:34.092 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-08-17 02:23:04.456527529 +0000 2024-08-17T02:25:34.092 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-08-17 02:23:04.456527529 +0000 2024-08-17T02:25:34.092 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-08-17 02:23:04.456527529 +0000 2024-08-17T02:25:34.092 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:25:34.185 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-08-17T02:25:34.185 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-08-17T02:25:34.185 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000316305 s, 1.6 MB/s 2024-08-17T02:25:34.188 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:25:34.224 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2024-08-17T02:25:34.300 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:25:34.300 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:34.300 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-08-17T02:25:34.301 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:34.301 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:25:34.301 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-08-17 02:25:24.045456100 +0000 2024-08-17T02:25:34.301 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-08-17 02:23:04.927522526 +0000 2024-08-17T02:25:34.301 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-08-17 02:23:04.927522526 +0000 2024-08-17T02:25:34.301 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-08-17 02:23:04.927522526 +0000 2024-08-17T02:25:34.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:25:34.393 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-08-17T02:25:34.393 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-08-17T02:25:34.393 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.0002668 s, 1.9 MB/s 2024-08-17T02:25:34.396 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:25:34.433 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2024-08-17T02:25:34.508 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:25:34.508 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:34.508 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-08-17T02:25:34.508 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:34.508 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:25:34.509 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-08-17 02:25:24.045456100 +0000 2024-08-17T02:25:34.509 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-08-17 02:23:05.400517502 +0000 2024-08-17T02:25:34.509 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-08-17 02:23:05.400517502 +0000 2024-08-17T02:25:34.509 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-08-17 02:23:05.400517502 +0000 2024-08-17T02:25:34.509 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:25:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-08-17T02:25:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-08-17T02:25:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.0002708 s, 1.9 MB/s 2024-08-17T02:25:34.603 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:25:34.640 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2024-08-17T02:25:34.715 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:25:34.716 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:34.716 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-08-17T02:25:34.716 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:34.716 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:25:34.716 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-08-17 02:25:24.046456089 +0000 2024-08-17T02:25:34.716 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-08-17 02:23:05.891512287 +0000 2024-08-17T02:25:34.716 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-08-17 02:23:05.891512287 +0000 2024-08-17T02:25:34.716 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-08-17 02:23:05.891512287 +0000 2024-08-17T02:25:34.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:25:34.808 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-08-17T02:25:34.808 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-08-17T02:25:34.808 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000279045 s, 1.8 MB/s 2024-08-17T02:25:34.811 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:25:34.847 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:34.847 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:25:34.848 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:25:34.887 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:25:34.887 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2024-08-17T02:25:34.965 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:25:34.965 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:34.965 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-08-17T02:25:34.965 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:34.965 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:25:34.965 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-08-17 02:25:21.824813764 +0000 2024-08-17T02:25:34.965 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-08-17 02:23:02.030066807 +0000 2024-08-17T02:25:34.965 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-08-17 02:23:02.030066807 +0000 2024-08-17T02:25:34.965 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-08-17 02:23:02.030066807 +0000 2024-08-17T02:25:34.966 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:25:35.060 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-08-17T02:25:35.060 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-08-17T02:25:35.060 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000292823 s, 1.7 MB/s 2024-08-17T02:25:35.063 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:25:35.101 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2024-08-17T02:25:35.176 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:25:35.176 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:35.176 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-08-17T02:25:35.176 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:35.176 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:25:35.177 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-08-17 02:25:21.825813742 +0000 2024-08-17T02:25:35.177 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-08-17 02:23:02.504056442 +0000 2024-08-17T02:25:35.177 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-08-17 02:23:02.504056442 +0000 2024-08-17T02:25:35.177 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-08-17 02:23:02.504056442 +0000 2024-08-17T02:25:35.177 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:25:35.268 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-08-17T02:25:35.268 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-08-17T02:25:35.268 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000255075 s, 2.0 MB/s 2024-08-17T02:25:35.270 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:25:35.306 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2024-08-17T02:25:35.382 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:25:35.382 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:35.382 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-08-17T02:25:35.382 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:35.382 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:25:35.382 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-08-17 02:25:21.826813720 +0000 2024-08-17T02:25:35.382 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-08-17 02:23:02.989045836 +0000 2024-08-17T02:25:35.382 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-08-17 02:23:02.989045836 +0000 2024-08-17T02:25:35.382 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-08-17 02:23:02.989045836 +0000 2024-08-17T02:25:35.383 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:25:35.475 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-08-17T02:25:35.475 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-08-17T02:25:35.475 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.00031212 s, 1.6 MB/s 2024-08-17T02:25:35.478 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:25:35.514 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2024-08-17T02:25:35.589 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:25:35.589 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:35.589 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-08-17T02:25:35.589 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:35.589 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:25:35.589 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-08-17 02:25:21.826813720 +0000 2024-08-17T02:25:35.589 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-08-17 02:23:03.479035121 +0000 2024-08-17T02:25:35.590 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-08-17 02:23:03.479035121 +0000 2024-08-17T02:25:35.590 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-08-17 02:23:03.479035121 +0000 2024-08-17T02:25:35.590 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:25:35.681 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-08-17T02:25:35.681 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-08-17T02:25:35.682 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000292653 s, 1.7 MB/s 2024-08-17T02:25:35.684 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:25:35.720 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:35.825 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:25:35.825 INFO:tasks.ceph:Generating config... 2024-08-17T02:25:35.827 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:25:35.827 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:25:35.827 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:25:35.827 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:25:35.827 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:25:35.827 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:25:35.827 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-17T02:25:35.827 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:25:35.827 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:25:35.827 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:25:35.827 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:25:35.827 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:25:35.827 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:25:35.828 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:25:35.828 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:25:35.828 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:25:35.828 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:25:35.828 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:25:35.828 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:25:35.828 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:25:35.828 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:25:35.828 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:25:35.828 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:25:35.828 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:25:35.828 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:25:35.828 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:25:35.828 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:25:35.828 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:25:35.829 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:25:35.829 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:25:35.829 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:25:35.829 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:25:35.829 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:25:35.829 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:25:35.829 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:25:35.829 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:25:35.829 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:25:35.829 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:25:35.829 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:25:35.829 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:25:35.829 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:25:35.830 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:25:35.830 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:25:35.924 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:25:35.929 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:25:36.009 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:25:36.065 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.6'), ('mon.b', '172.21.15.136'), ('mon.c', '[v2:172.21.15.136:3301,v1:172.21.15.136:6790]')] 2024-08-17T02:25:36.065 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.6,172.21.15.136,[v2:172.21.15.136:3301,v1:172.21.15.136:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:25:36.066 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:25:36.066 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:25:36.101 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.6 --add b 172.21.15.136 --addv c '[v2:172.21.15.136:3301,v1:172.21.15.136:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:36.212 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:36.212 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: generated fsid 61589148-c13d-47c7-8fbb-d1646bb8e5e2 2024-08-17T02:25:36.212 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = octopus 2024-08-17T02:25:36.212 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 0 2024-08-17T02:25:36.212 INFO:teuthology.orchestra.run.smithi006.stdout:fsid 61589148-c13d-47c7-8fbb-d1646bb8e5e2 2024-08-17T02:25:36.212 INFO:teuthology.orchestra.run.smithi006.stdout:last_changed 2024-08-17T02:25:36.212146+0000 2024-08-17T02:25:36.212 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-08-17T02:25:36.212146+0000 2024-08-17T02:25:36.212 INFO:teuthology.orchestra.run.smithi006.stdout:min_mon_release 15 (octopus) 2024-08-17T02:25:36.212 INFO:teuthology.orchestra.run.smithi006.stdout:election_strategy: 1 2024-08-17T02:25:36.212 INFO:teuthology.orchestra.run.smithi006.stdout:0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-08-17T02:25:36.213 INFO:teuthology.orchestra.run.smithi006.stdout:1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-08-17T02:25:36.213 INFO:teuthology.orchestra.run.smithi006.stdout:2: [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] mon.c 2024-08-17T02:25:36.213 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:25:36.214 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:25:36.249 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 61589148-c13d-47c7-8fbb-d1646bb8e5e2... 2024-08-17T02:25:36.250 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:25:36.294 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:25:36.388 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2024-08-17T02:25:36.388 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2024-08-17T02:25:36.388 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:25:36.388 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2024-08-17T02:25:36.388 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.388 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2024-08-17T02:25:36.388 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.388 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2024-08-17T02:25:36.388 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.389 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2024-08-17T02:25:36.389 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2024-08-17T02:25:36.389 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.389 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2024-08-17T02:25:36.389 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2024-08-17T02:25:36.389 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.389 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:25:36.389 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2024-08-17T02:25:36.389 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.389 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:25:36.389 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:25:36.389 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.389 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2024-08-17T02:25:36.389 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.390 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2024-08-17T02:25:36.390 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2024-08-17T02:25:36.390 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:25:36.390 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:25:36.390 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2024-08-17T02:25:36.390 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:25:36.390 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2024-08-17T02:25:36.390 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:25:36.390 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:25:36.390 INFO:teuthology.orchestra.run.smithi006.stdout: mon_allow_pool_size_one = true 2024-08-17T02:25:36.390 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.390 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:25:36.390 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.391 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2024-08-17T02:25:36.391 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.391 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2024-08-17T02:25:36.391 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.391 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2024-08-17T02:25:36.391 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2024-08-17T02:25:36.391 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2024-08-17T02:25:36.391 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.6,172.21.15.136,[v2:172.21.15.136:3301,v1:172.21.15.136:6790]" 2024-08-17T02:25:36.391 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on skipped message = False 2024-08-17T02:25:36.391 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = 61589148-c13d-47c7-8fbb-d1646bb8e5e2 2024-08-17T02:25:36.391 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.391 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2024-08-17T02:25:36.391 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2024-08-17T02:25:36.392 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.392 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2024-08-17T02:25:36.392 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2024-08-17T02:25:36.392 INFO:teuthology.orchestra.run.smithi006.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:25:36.392 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.392 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2024-08-17T02:25:36.392 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2024-08-17T02:25:36.392 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.392 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2024-08-17T02:25:36.392 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2024-08-17T02:25:36.392 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2024-08-17T02:25:36.392 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.392 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2024-08-17T02:25:36.392 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2024-08-17T02:25:36.393 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.393 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:25:36.393 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.393 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2024-08-17T02:25:36.393 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.393 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2024-08-17T02:25:36.393 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.393 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:25:36.393 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2024-08-17T02:25:36.393 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.393 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2024-08-17T02:25:36.393 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2024-08-17T02:25:36.393 INFO:teuthology.orchestra.run.smithi006.stdout: bdev async discard = True 2024-08-17T02:25:36.393 INFO:teuthology.orchestra.run.smithi006.stdout: bdev enable discard = True 2024-08-17T02:25:36.393 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore allocator = bitmap 2024-08-17T02:25:36.394 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore block size = 96636764160 2024-08-17T02:25:36.394 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore fsck on mount = True 2024-08-17T02:25:36.394 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluefs = 1/20 2024-08-17T02:25:36.394 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluestore = 1/20 2024-08-17T02:25:36.394 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-08-17T02:25:36.394 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 20 2024-08-17T02:25:36.394 INFO:teuthology.orchestra.run.smithi006.stdout: debug rocksdb = 4/10 2024-08-17T02:25:36.394 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:25:36.394 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd full ratio = 0.9 2024-08-17T02:25:36.394 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:25:36.394 INFO:teuthology.orchestra.run.smithi006.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:25:36.394 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = bluestore 2024-08-17T02:25:36.394 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2024-08-17T02:25:36.394 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.395 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2024-08-17T02:25:36.395 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-08-17T02:25:36.395 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2024-08-17T02:25:36.395 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2024-08-17T02:25:36.395 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2024-08-17T02:25:36.395 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:36.395 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:36.395 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2024-08-17T02:25:36.395 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2024-08-17T02:25:36.395 INFO:teuthology.orchestra.run.smithi006.stdout: debug finisher = 20 2024-08-17T02:25:36.395 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.395 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2024-08-17T02:25:36.395 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-08-17T02:25:36.395 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2024-08-17T02:25:36.396 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2024-08-17T02:25:36.396 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2024-08-17T02:25:36.396 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2024-08-17T02:25:36.396 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2024-08-17T02:25:36.396 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:36.396 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2024-08-17T02:25:36.396 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2024-08-17T02:25:36.396 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:36.396 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.396 INFO:teuthology.orchestra.run.smithi006.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:25:36.396 INFO:teuthology.orchestra.run.smithi006.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:25:36.396 INFO:teuthology.orchestra.run.smithi006.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:25:36.396 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.396 INFO:teuthology.orchestra.run.smithi006.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:25:36.396 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:25:36.397 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:25:36.397 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.397 INFO:teuthology.orchestra.run.smithi006.stdout: # 1m isn't quite enough 2024-08-17T02:25:36.397 INFO:teuthology.orchestra.run.smithi006.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:25:36.397 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.397 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:25:36.397 INFO:teuthology.orchestra.run.smithi006.stdout: mon op complaint time = 120 2024-08-17T02:25:36.397 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:25:36.397 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2024-08-17T02:25:36.397 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2024-08-17T02:25:36.397 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2024-08-17T02:25:36.397 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2024-08-17T02:25:36.397 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:25:36.398 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:25:36.398 INFO:teuthology.orchestra.run.smithi006.stdout: client mount timeout = 600 2024-08-17T02:25:36.398 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2024-08-17T02:25:36.398 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-08-17T02:25:36.398 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = "" 2024-08-17T02:25:36.398 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2024-08-17T02:25:36.398 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2024-08-17T02:25:36.398 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2024-08-17T02:25:36.398 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2024-08-17T02:25:36.398 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2024-08-17T02:25:36.398 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2024-08-17T02:25:36.398 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2024-08-17T02:25:36.398 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2024-08-17T02:25:36.398 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2024-08-17T02:25:36.398 INFO:teuthology.orchestra.run.smithi006.stdout:[mds] 2024-08-17T02:25:36.399 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds = 20 2024-08-17T02:25:36.399 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds balancer = 20 2024-08-17T02:25:36.399 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-08-17T02:25:36.399 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug frag = True 2024-08-17T02:25:36.399 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug scatterstat = True 2024-08-17T02:25:36.399 INFO:teuthology.orchestra.run.smithi006.stdout: mds op complaint time = 180 2024-08-17T02:25:36.399 INFO:teuthology.orchestra.run.smithi006.stdout: mds verify scatter = True 2024-08-17T02:25:36.399 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2024-08-17T02:25:36.399 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2024-08-17T02:25:36.399 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2024-08-17T02:25:36.400 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2024-08-17T02:25:36.400 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2024-08-17T02:25:36.400 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:25:36.400 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2024-08-17T02:25:36.400 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.400 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2024-08-17T02:25:36.400 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.400 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2024-08-17T02:25:36.400 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.400 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2024-08-17T02:25:36.400 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2024-08-17T02:25:36.400 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.401 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2024-08-17T02:25:36.401 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2024-08-17T02:25:36.401 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.401 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:25:36.401 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2024-08-17T02:25:36.401 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.401 INFO:teuthology.orchestra.run.smithi136.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:25:36.401 INFO:teuthology.orchestra.run.smithi136.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:25:36.401 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.401 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2024-08-17T02:25:36.401 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.401 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2024-08-17T02:25:36.401 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2024-08-17T02:25:36.401 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:25:36.401 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:25:36.402 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2024-08-17T02:25:36.402 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:25:36.402 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2024-08-17T02:25:36.402 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:25:36.402 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:25:36.402 INFO:teuthology.orchestra.run.smithi136.stdout: mon_allow_pool_size_one = true 2024-08-17T02:25:36.402 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.402 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:25:36.402 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.402 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2024-08-17T02:25:36.402 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.402 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2024-08-17T02:25:36.402 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.403 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2024-08-17T02:25:36.403 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2024-08-17T02:25:36.403 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2024-08-17T02:25:36.403 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.6,172.21.15.136,[v2:172.21.15.136:3301,v1:172.21.15.136:6790]" 2024-08-17T02:25:36.403 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on skipped message = False 2024-08-17T02:25:36.403 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = 61589148-c13d-47c7-8fbb-d1646bb8e5e2 2024-08-17T02:25:36.403 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.403 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2024-08-17T02:25:36.403 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2024-08-17T02:25:36.403 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.404 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2024-08-17T02:25:36.404 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 600 2024-08-17T02:25:36.404 INFO:teuthology.orchestra.run.smithi136.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:25:36.404 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.404 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2024-08-17T02:25:36.404 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2024-08-17T02:25:36.404 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.404 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2024-08-17T02:25:36.404 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2024-08-17T02:25:36.404 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2024-08-17T02:25:36.404 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.404 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2024-08-17T02:25:36.404 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2024-08-17T02:25:36.404 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.405 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:25:36.405 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.405 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2024-08-17T02:25:36.405 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.405 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2024-08-17T02:25:36.405 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.405 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:25:36.405 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2024-08-17T02:25:36.405 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.405 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2024-08-17T02:25:36.405 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2024-08-17T02:25:36.405 INFO:teuthology.orchestra.run.smithi136.stdout: bdev async discard = True 2024-08-17T02:25:36.405 INFO:teuthology.orchestra.run.smithi136.stdout: bdev enable discard = True 2024-08-17T02:25:36.405 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore allocator = bitmap 2024-08-17T02:25:36.405 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2024-08-17T02:25:36.406 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2024-08-17T02:25:36.406 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 1/20 2024-08-17T02:25:36.406 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 1/20 2024-08-17T02:25:36.406 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-08-17T02:25:36.406 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2024-08-17T02:25:36.406 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 4/10 2024-08-17T02:25:36.406 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:25:36.406 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2024-08-17T02:25:36.406 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:25:36.406 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:25:36.406 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2024-08-17T02:25:36.406 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2024-08-17T02:25:36.406 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.406 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2024-08-17T02:25:36.406 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-08-17T02:25:36.407 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2024-08-17T02:25:36.407 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-08-17T02:25:36.407 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-08-17T02:25:36.407 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:36.407 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:36.407 INFO:teuthology.orchestra.run.smithi136.stdout: mgr/telemetry/nag = false 2024-08-17T02:25:36.407 INFO:teuthology.orchestra.run.smithi136.stdout: debug client = 20 2024-08-17T02:25:36.407 INFO:teuthology.orchestra.run.smithi136.stdout: debug finisher = 20 2024-08-17T02:25:36.407 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.407 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2024-08-17T02:25:36.407 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-08-17T02:25:36.407 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-08-17T02:25:36.407 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2024-08-17T02:25:36.407 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-08-17T02:25:36.408 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2024-08-17T02:25:36.408 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2024-08-17T02:25:36.408 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:36.408 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2024-08-17T02:25:36.408 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2024-08-17T02:25:36.408 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:36.408 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.408 INFO:teuthology.orchestra.run.smithi136.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:25:36.408 INFO:teuthology.orchestra.run.smithi136.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:25:36.408 INFO:teuthology.orchestra.run.smithi136.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:25:36.408 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.408 INFO:teuthology.orchestra.run.smithi136.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:25:36.408 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:25:36.408 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:25:36.408 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.409 INFO:teuthology.orchestra.run.smithi136.stdout: # 1m isn't quite enough 2024-08-17T02:25:36.409 INFO:teuthology.orchestra.run.smithi136.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:25:36.409 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.409 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:25:36.409 INFO:teuthology.orchestra.run.smithi136.stdout: mon op complaint time = 120 2024-08-17T02:25:36.409 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-08-17T02:25:36.409 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2024-08-17T02:25:36.409 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2024-08-17T02:25:36.409 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2024-08-17T02:25:36.409 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2024-08-17T02:25:36.409 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:25:36.409 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:25:36.409 INFO:teuthology.orchestra.run.smithi136.stdout: client mount timeout = 600 2024-08-17T02:25:36.409 INFO:teuthology.orchestra.run.smithi136.stdout: debug client = 20 2024-08-17T02:25:36.409 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-08-17T02:25:36.410 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = "" 2024-08-17T02:25:36.410 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 900 2024-08-17T02:25:36.410 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 900 2024-08-17T02:25:36.410 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2024-08-17T02:25:36.410 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2024-08-17T02:25:36.410 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2024-08-17T02:25:36.410 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2024-08-17T02:25:36.410 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2024-08-17T02:25:36.410 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2024-08-17T02:25:36.410 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.d] 2024-08-17T02:25:36.410 INFO:teuthology.orchestra.run.smithi136.stdout:[mds] 2024-08-17T02:25:36.410 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds = 20 2024-08-17T02:25:36.410 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds balancer = 20 2024-08-17T02:25:36.410 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-08-17T02:25:36.411 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug frag = True 2024-08-17T02:25:36.411 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug scatterstat = True 2024-08-17T02:25:36.411 INFO:teuthology.orchestra.run.smithi136.stdout: mds op complaint time = 180 2024-08-17T02:25:36.411 INFO:teuthology.orchestra.run.smithi136.stdout: mds verify scatter = True 2024-08-17T02:25:36.411 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2024-08-17T02:25:36.411 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 900 2024-08-17T02:25:36.411 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 900 2024-08-17T02:25:36.417 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:25:36.418 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:25:36.508 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:25:36.508 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:25:36.508 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:25:36.543 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:25:36.543 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:25:36.617 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi006.front.sepia.ceph.com 2024-08-17T02:25:36.618 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:25:36.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:25:36.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:25:36.736 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:25:36.736 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:36.810 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi136.front.sepia.ceph.com 2024-08-17T02:25:36.810 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:25:36.811 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:25:36.811 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:25:36.889 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:25:36.889 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:36.964 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:25:36.964 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:25:36.964 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:25:37.062 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:25:37.068 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:25:37.172 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:25:37.177 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:25:37.178 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:25:37.276 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:25:37.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:25:37.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:25:37.434 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:25:37.438 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:25:37.494 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:25:37.594 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:25:37.598 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:25:37.654 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:25:37.751 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:25:37.755 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:25:37.811 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:25:37.811 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:25:37.887 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:25:37.915 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:25:37.990 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:25:38.016 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:25:38.092 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:25:38.118 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:25:38.194 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:25:38.220 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:25:38.220 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:25:38.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:38.276 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:38.277 INFO:tasks.ceph:role: osd.0 2024-08-17T02:25:38.277 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com 2024-08-17T02:25:38.277 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:25:38.340 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:38.340 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:38.340 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:38.340 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:25:38.340 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:38.340 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:38.340 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:38.340 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:25:38.340 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:38.340 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:38.747 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-08-17T02:25:38.751 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-08-17T02:25:38.751 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:38.897 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:38.963 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:39.019 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:39.019 INFO:tasks.ceph:role: osd.1 2024-08-17T02:25:39.019 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com 2024-08-17T02:25:39.019 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:25:39.083 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:39.083 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:39.083 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:39.084 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:25:39.084 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:39.084 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:39.084 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:39.084 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:25:39.084 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:39.084 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:39.437 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-08-17T02:25:39.441 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-08-17T02:25:39.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:39.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:39.590 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:39.647 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:39.647 INFO:tasks.ceph:role: osd.2 2024-08-17T02:25:39.647 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com 2024-08-17T02:25:39.647 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:25:39.711 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:39.711 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:39.711 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:39.711 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:25:39.711 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:39.711 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:39.711 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:39.711 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:25:39.711 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:39.711 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:40.094 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-08-17T02:25:40.098 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-08-17T02:25:40.098 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:40.205 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:40.268 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:40.324 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:40.324 INFO:tasks.ceph:role: osd.3 2024-08-17T02:25:40.324 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com 2024-08-17T02:25:40.324 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:25:40.388 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:40.388 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:40.388 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:40.388 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:25:40.388 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:40.388 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:40.388 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:40.388 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:25:40.388 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:40.388 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:40.807 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-08-17T02:25:40.812 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-08-17T02:25:40.812 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:40.947 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:41.012 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:41.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:41.118+0000 7fd9d7c0c2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:25:41.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:41.123+0000 7fd9d7c0c2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:25:41.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:41.123+0000 7fd9d7c0c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:25:41.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:41.123+0000 7fd9d7c0c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:25:41.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:41.123+0000 7fd9d7c0c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:25:41.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:41.129+0000 7fd9d7c0c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:25:41.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:41.679+0000 7fd9d7c0c2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:42.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:42.449+0000 7fd9d7c0c2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:43.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:43.242+0000 7fd9d7c0c2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:44.083 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:44.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:44.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:44.234+0000 7f1f6b5272c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:25:44.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:44.235+0000 7f1f6b5272c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:25:44.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:44.235+0000 7f1f6b5272c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:25:44.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:44.235+0000 7f1f6b5272c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:25:44.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:44.235+0000 7f1f6b5272c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:25:44.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:44.236+0000 7f1f6b5272c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:25:44.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:44.783+0000 7f1f6b5272c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:45.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:45.561+0000 7f1f6b5272c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:46.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:46.331+0000 7f1f6b5272c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:47.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:47.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:47.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:47.314+0000 7f89f3c452c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:25:47.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:47.315+0000 7f89f3c452c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:25:47.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:47.315+0000 7f89f3c452c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:25:47.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:47.315+0000 7f89f3c452c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:25:47.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:47.315+0000 7f89f3c452c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:25:47.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:47.317+0000 7f89f3c452c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:25:47.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:47.863+0000 7f89f3c452c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:48.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:48.634+0000 7f89f3c452c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:49.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:49.404+0000 7f89f3c452c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:50.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:50.295 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:50.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:50.380+0000 7fac9cc162c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:25:50.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:50.381+0000 7fac9cc162c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:25:50.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:50.381+0000 7fac9cc162c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:25:50.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:50.381+0000 7fac9cc162c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:25:50.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:50.381+0000 7fac9cc162c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:25:50.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:50.382+0000 7fac9cc162c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:25:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:50.926+0000 7fac9cc162c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:51.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:51.700+0000 7fac9cc162c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:52.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:25:52.470+0000 7fac9cc162c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:53.304 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:53.364 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:53.426 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:53.426 INFO:tasks.ceph:role: osd.4 2024-08-17T02:25:53.426 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com 2024-08-17T02:25:53.427 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:25:53.492 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:53.492 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:53.492 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:53.492 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:25:53.492 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:53.492 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:53.492 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:53.493 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:25:53.493 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:53.493 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:53.926 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-08-17T02:25:53.931 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-08-17T02:25:53.931 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:54.032 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:54.096 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:54.154 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:54.154 INFO:tasks.ceph:role: osd.5 2024-08-17T02:25:54.155 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com 2024-08-17T02:25:54.155 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:25:54.218 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:54.218 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:54.218 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:54.218 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:25:54.218 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:54.218 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:54.218 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:54.219 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:25:54.219 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:54.219 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:54.598 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-08-17T02:25:54.603 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-08-17T02:25:54.603 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:54.683 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:54.745 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:54.800 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:54.801 INFO:tasks.ceph:role: osd.6 2024-08-17T02:25:54.801 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com 2024-08-17T02:25:54.801 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:25:54.864 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:54.864 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:54.864 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:54.864 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:25:54.864 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:54.864 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:54.864 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:54.865 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:25:54.865 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:54.865 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:55.301 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-08-17T02:25:55.305 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-08-17T02:25:55.305 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:55.408 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:55.470 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:55.525 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:55.525 INFO:tasks.ceph:role: osd.7 2024-08-17T02:25:55.525 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com 2024-08-17T02:25:55.525 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:25:55.588 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:55.588 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:55.588 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:55.588 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:25:55.588 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:55.588 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:55.588 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:55.588 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:25:55.588 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:55.589 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:56.031 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-08-17T02:25:56.035 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-08-17T02:25:56.035 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:56.140 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:56.204 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:56.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:25:56.367+0000 7f55294142c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:25:56.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:25:56.370+0000 7f55294142c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:25:56.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:25:56.370+0000 7f55294142c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:25:56.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:25:56.370+0000 7f55294142c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:25:56.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:25:56.370+0000 7f55294142c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:25:56.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:25:56.372+0000 7f55294142c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:25:56.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:25:56.923+0000 7f55294142c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:57.689 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:25:57.689+0000 7f55294142c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:58.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:25:58.457+0000 7f55294142c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:59.286 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:59.343 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:59.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:25:59.426+0000 7f8ab07882c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:25:59.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:25:59.426+0000 7f8ab07882c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:25:59.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:25:59.426+0000 7f8ab07882c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:25:59.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:25:59.426+0000 7f8ab07882c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:25:59.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:25:59.426+0000 7f8ab07882c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:25:59.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:25:59.429+0000 7f8ab07882c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:25:59.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:25:59.977+0000 7f8ab07882c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:00.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:00.746+0000 7f8ab07882c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:01.521 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:01.520+0000 7f8ab07882c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:02.371 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:26:02.428 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:02.512 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:02.511+0000 7fb0ddb282c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:26:02.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:02.512+0000 7fb0ddb282c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:26:02.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:02.512+0000 7fb0ddb282c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:26:02.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:02.512+0000 7fb0ddb282c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:26:02.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:02.512+0000 7fb0ddb282c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:26:02.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:02.514+0000 7fb0ddb282c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:26:03.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:03.067+0000 7fb0ddb282c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:03.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:03.838+0000 7fb0ddb282c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:03.843 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:03.847 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:04.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:04.620+0000 7fb0ddb282c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:05.449 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:26:05.504 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:05.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:05.587+0000 7f21752142c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:26:05.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:05.587+0000 7f21752142c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:26:05.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:05.587+0000 7f21752142c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:26:05.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:05.587+0000 7f21752142c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:26:05.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:05.587+0000 7f21752142c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:26:05.590 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:05.589+0000 7f21752142c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:26:06.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:06.146+0000 7f21752142c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:06.919 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:06.918+0000 7f21752142c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:07.690 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:07.688+0000 7f21752142c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:08.513 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:26:08.570 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:26:08.570 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:26:08.570 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:26:08.633 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:26:08.633 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:26:08.734 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:26:08.734 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:26:08.831 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:26:08.831 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:26:08.928 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:26:08.928 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:26:09.024 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:26:09.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:26:09.120 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:26:09.120 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:26:09.215 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:26:09.216 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:26:09.273 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:26:09.273 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:26:09.368 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:26:09.368 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:26:09.462 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:26:09.463 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:26:09.557 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:26:09.557 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:26:09.652 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:26:09.652 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:26:09.746 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:26:09.746 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:26:09.842 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:26:09.843 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:26:09.879 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:26:09.880 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:26:09.957 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:26:09.957 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:26:09.992 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:26:09.992 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:26:10.067 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:26:10.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:26:10.071 DEBUG:teuthology.orchestra.run.smithi136:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:26:10.122 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.y] 2024-08-17T02:26:10.122 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAhCsBmMoDFAxAAzRs4W1ap/lmTveg4gFqjfw== 2024-08-17T02:26:10.122 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2024-08-17T02:26:10.122 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAhCsBm/ceFEBAA5H3zY7fQkLxL7RW+jnyD0g== 2024-08-17T02:26:10.122 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2024-08-17T02:26:10.122 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAhCsBmQ6rsGRAA/ee8rJJYpKFX7xYeqKZIPQ== 2024-08-17T02:26:10.122 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.0] 2024-08-17T02:26:10.123 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAlCsBmM6YlBxAAfewdjL7d4oM24o0RcGU9lg== 2024-08-17T02:26:10.123 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.1] 2024-08-17T02:26:10.123 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAoCsBmDv8MDhAAYjLxXtuNcL7mOfaf5VzgeQ== 2024-08-17T02:26:10.123 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.2] 2024-08-17T02:26:10.123 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQArCsBmq8/NEhAAMUPa3AHafw8D4z3xZBS4WQ== 2024-08-17T02:26:10.123 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.3] 2024-08-17T02:26:10.123 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAuCsBmZw7BFhAAZWR9+cKLLSh53k2uZm6PqA== 2024-08-17T02:26:10.123 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.x] 2024-08-17T02:26:10.123 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAhCsBmCLZJChAAIdD/gUt6md7CcVlR40O3AA== 2024-08-17T02:26:10.123 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2024-08-17T02:26:10.123 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAhCsBmZlRuIxAA/uBYkzeY3rgleTJvtWU+Jw== 2024-08-17T02:26:10.123 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2024-08-17T02:26:10.123 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAhCsBm3I3QLBAAErIDgwSwKw9bVPijIzG7HQ== 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.4] 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQA0CsBmoh3vFRAAKwDKQXZW3eIslbycZase4A== 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.5] 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQA3CsBmT+5/GRAA1d755Bhog/3Nd5t2PH3Isw== 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.6] 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQA6CsBmKD2XHhAADn2Smi4OjrDwt+2dY3Gb5w== 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.7] 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQA9CsBm60MbIxAAN8HLGHuyuTtD4GRQGgf1dw== 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAhCsBmafXxNBAA+58u8+oYz1TgwUxQ+2UIyw== 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi006.stdout:[client.2] 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAhCsBmj4YLOxAAtJNZZWUdl2pBy7rlHbh+Ow== 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi006.stdout:[client.1] 2024-08-17T02:26:10.125 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAiCsBmdQOFBRAAXYq157pgoLO/hhJDjWWtyg== 2024-08-17T02:26:10.125 INFO:teuthology.orchestra.run.smithi006.stdout:[client.3] 2024-08-17T02:26:10.125 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAiCsBmYhGYCxAAcRkRSM9AP6+tubwo4UScEw== 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.y] 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAhCsBmMoDFAxAAzRs4W1ap/lmTveg4gFqjfw== 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAhCsBm/ceFEBAA5H3zY7fQkLxL7RW+jnyD0g== 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAhCsBmQ6rsGRAA/ee8rJJYpKFX7xYeqKZIPQ== 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.0] 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAlCsBmM6YlBxAAfewdjL7d4oM24o0RcGU9lg== 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.1] 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAoCsBmDv8MDhAAYjLxXtuNcL7mOfaf5VzgeQ== 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.2] 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQArCsBmq8/NEhAAMUPa3AHafw8D4z3xZBS4WQ== 2024-08-17T02:26:10.160 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.3] 2024-08-17T02:26:10.160 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAuCsBmZw7BFhAAZWR9+cKLLSh53k2uZm6PqA== 2024-08-17T02:26:10.160 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.x] 2024-08-17T02:26:10.160 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAhCsBmCLZJChAAIdD/gUt6md7CcVlR40O3AA== 2024-08-17T02:26:10.160 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2024-08-17T02:26:10.160 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAhCsBmZlRuIxAA/uBYkzeY3rgleTJvtWU+Jw== 2024-08-17T02:26:10.160 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.d] 2024-08-17T02:26:10.160 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAhCsBm3I3QLBAAErIDgwSwKw9bVPijIzG7HQ== 2024-08-17T02:26:10.160 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.4] 2024-08-17T02:26:10.160 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQA0CsBmoh3vFRAAKwDKQXZW3eIslbycZase4A== 2024-08-17T02:26:10.160 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.5] 2024-08-17T02:26:10.160 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQA3CsBmT+5/GRAA1d755Bhog/3Nd5t2PH3Isw== 2024-08-17T02:26:10.160 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.6] 2024-08-17T02:26:10.160 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQA6CsBmKD2XHhAADn2Smi4OjrDwt+2dY3Gb5w== 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.7] 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQA9CsBm60MbIxAAN8HLGHuyuTtD4GRQGgf1dw== 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi136.stdout:[client.0] 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAhCsBmafXxNBAA+58u8+oYz1TgwUxQ+2UIyw== 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi136.stdout:[client.2] 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAhCsBmj4YLOxAAtJNZZWUdl2pBy7rlHbh+Ow== 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi136.stdout:[client.1] 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAiCsBmdQOFBRAAXYq157pgoLO/hhJDjWWtyg== 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi136.stdout:[client.3] 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAiCsBmYhGYCxAAcRkRSM9AP6+tubwo4UScEw== 2024-08-17T02:26:10.162 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:26:10.169 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:26:10.289 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:26:10.293 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:26:10.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:26:10.386 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:26:10.476 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:10.481 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:10.568 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:10.572 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:10.658 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:10.662 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:10.750 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:10.754 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:10.840 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:26:10.845 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:26:10.931 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:26:10.935 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:26:11.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:26:11.029 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:26:11.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:11.122 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:11.208 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:11.213 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:11.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:11.304 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:11.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:11.394 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:11.482 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:26:11.485 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:26:11.575 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:26:11.579 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:26:11.668 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:26:11.672 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:26:11.762 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:26:11.767 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:26:11.858 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:26:11.858 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:26:11.915 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:26:12.015 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:26:12.071 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:26:12.126 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:26:12.226 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:26:12.282 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:26:12.337 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:26:12.435 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:26:12.491 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:12.495 DEBUG:teuthology.orchestra.run.smithi136:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:12.530 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:26:12.530 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:26:12.530 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:26:12.571 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:26:12.572 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:26:12.572 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:26:12.576 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:26:12.576 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:26:12.576 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:26:12.579 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:26:12.579 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:26:12.580 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:26:12.580 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:26:12.583 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:26:12.584 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:26:12.584 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:26:12.588 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:26:12.588 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:26:12.588 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:26:12.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.739+0000 7f30c4200640 1 Processor -- start 2024-08-17T02:26:12.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.739+0000 7f30c4200640 1 -- start start 2024-08-17T02:26:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.740+0000 7f30c4200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f30bc1589e0 0x7f30bc158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.740+0000 7f30c4200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f30bc0ce140 0x7f30bc0cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.740+0000 7f30c4200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30bc0af9a0 con 0x7f30bc0ca9c0 2024-08-17T02:26:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.740+0000 7f30c4200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30bc0af810 con 0x7f30bc0ce140 2024-08-17T02:26:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.740+0000 7f30c4200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30bc0cb340 con 0x7f30bc1589e0 2024-08-17T02:26:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.740+0000 7f30c2200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f30bc0ce140 0x7f30bc0cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.740+0000 7f30c2200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f30bc0ce140 0x7f30bc0cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41582/0 (socket says 172.21.15.6:41582) 2024-08-17T02:26:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.740+0000 7f30c2200640 1 -- 172.21.15.6:0/3492300336 learned_addr learned my addr 172.21.15.6:0/3492300336 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.740+0000 7f30c1800640 1 --2- 172.21.15.6:0/3492300336 >> v2:172.21.15.136:3300/0 conn(0x7f30bc1589e0 0x7f30bc158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.740+0000 7f30c2200640 1 -- 172.21.15.6:0/3492300336 >> v2:172.21.15.6:3300/0 conn(0x7f30bc0ce140 msgr2=0x7f30bc0cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:26:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.740+0000 7f30c2200640 1 -- 172.21.15.6:0/3492300336 >> v2:172.21.15.6:3300/0 conn(0x7f30bc0ce140 msgr2=0x7f30bc0cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.740+0000 7f30c2200640 1 --2- 172.21.15.6:0/3492300336 >> v2:172.21.15.6:3300/0 conn(0x7f30bc0ce140 0x7f30bc0cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.741+0000 7f30c2200640 1 --2- 172.21.15.6:0/3492300336 >> v2:172.21.15.6:3300/0 conn(0x7f30bc0ce140 0x7f30bc0cae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.741+0000 7f30c1800640 1 -- 172.21.15.6:0/3492300336 >> v2:172.21.15.136:3300/0 conn(0x7f30bc1589e0 msgr2=0x7f30bc158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:26:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.741+0000 7f30c1800640 1 -- 172.21.15.6:0/3492300336 >> v2:172.21.15.136:3300/0 conn(0x7f30bc1589e0 msgr2=0x7f30bc158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.741+0000 7f30c1800640 1 --2- 172.21.15.6:0/3492300336 >> v2:172.21.15.136:3300/0 conn(0x7f30bc1589e0 0x7f30bc158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.741+0000 7f30c1800640 1 --2- 172.21.15.6:0/3492300336 >> v2:172.21.15.136:3300/0 conn(0x7f30bc1589e0 0x7f30bc158db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:12.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.942+0000 7f30c1800640 1 --2- 172.21.15.6:0/3492300336 >> v2:172.21.15.136:3300/0 conn(0x7f30bc1589e0 0x7f30bc158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.942+0000 7f30c1800640 1 -- 172.21.15.6:0/3492300336 >> v2:172.21.15.136:3300/0 conn(0x7f30bc1589e0 msgr2=0x7f30bc158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:26:12.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.942+0000 7f30c1800640 1 -- 172.21.15.6:0/3492300336 >> v2:172.21.15.136:3300/0 conn(0x7f30bc1589e0 msgr2=0x7f30bc158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:12.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.942+0000 7f30c1800640 1 --2- 172.21.15.6:0/3492300336 >> v2:172.21.15.136:3300/0 conn(0x7f30bc1589e0 0x7f30bc158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:12.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.942+0000 7f30c1800640 1 --2- 172.21.15.6:0/3492300336 >> v2:172.21.15.136:3300/0 conn(0x7f30bc1589e0 0x7f30bc158db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:26:12.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.942+0000 7f30c2200640 1 --2- 172.21.15.6:0/3492300336 >> v2:172.21.15.6:3300/0 conn(0x7f30bc0ce140 0x7f30bc0cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.942+0000 7f30c2200640 1 -- 172.21.15.6:0/3492300336 >> v2:172.21.15.6:3300/0 conn(0x7f30bc0ce140 msgr2=0x7f30bc0cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:26:12.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.942+0000 7f30c2200640 1 -- 172.21.15.6:0/3492300336 >> v2:172.21.15.6:3300/0 conn(0x7f30bc0ce140 msgr2=0x7f30bc0cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:12.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.942+0000 7f30c2200640 1 --2- 172.21.15.6:0/3492300336 >> v2:172.21.15.6:3300/0 conn(0x7f30bc0ce140 0x7f30bc0cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:12.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.942+0000 7f30c2200640 1 --2- 172.21.15.6:0/3492300336 >> v2:172.21.15.6:3300/0 conn(0x7f30bc0ce140 0x7f30bc0cae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.944+0000 7f30bbe00640 1 -- 172.21.15.6:0/3492300336 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2061552374 0 0) 0x7f30bc0af9a0 con 0x7f30bc0ca9c0 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.944+0000 7f30bbe00640 1 -- 172.21.15.6:0/3492300336 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30a40034e0 con 0x7f30bc0ca9c0 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.944+0000 7f30bbe00640 1 -- 172.21.15.6:0/3492300336 <== mon.1 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3145425131 0 0) 0x7f30a40034e0 con 0x7f30bc0ca9c0 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.944+0000 7f30bbe00640 1 -- 172.21.15.6:0/3492300336 >> v2:172.21.15.136:3300/0 conn(0x7f30bc1589e0 msgr2=0x7f30bc158db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.944+0000 7f30bbe00640 1 --2- 172.21.15.6:0/3492300336 >> v2:172.21.15.136:3300/0 conn(0x7f30bc1589e0 0x7f30bc158db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.944+0000 7f30bbe00640 1 -- 172.21.15.6:0/3492300336 >> v2:172.21.15.6:3300/0 conn(0x7f30bc0ce140 msgr2=0x7f30bc0cae00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.944+0000 7f30bbe00640 1 --2- 172.21.15.6:0/3492300336 >> v2:172.21.15.6:3300/0 conn(0x7f30bc0ce140 0x7f30bc0cae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.944+0000 7f30bbe00640 1 -- 172.21.15.6:0/3492300336 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc0ce740 con 0x7f30bc0ca9c0 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.944+0000 7f30bbe00640 1 -- 172.21.15.6:0/3492300336 <== mon.1 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f30a8001470 con 0x7f30bc0ca9c0 2024-08-17T02:26:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.944+0000 7f30bbe00640 1 -- 172.21.15.6:0/3492300336 >> v1:172.21.15.136:6789/0 conn(0x7f30bc0ca9c0 legacy=0x7f30bc0cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.944+0000 7f30bbe00640 1 --2- 172.21.15.6:0/3492300336 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30a40039d0 0x7f30a4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.944+0000 7f30bbe00640 1 --2- 172.21.15.6:0/3492300336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30a4004780 0x7f30a4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.944+0000 7f30bbe00640 1 --2- 172.21.15.6:0/3492300336 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30a4005130 0x7f30a400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.944+0000 7f30bbe00640 1 -- 172.21.15.6:0/3492300336 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc0af810 con 0x7f30a4004780 2024-08-17T02:26:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.944+0000 7f30bbe00640 1 -- 172.21.15.6:0/3492300336 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc0cb340 con 0x7f30a40039d0 2024-08-17T02:26:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.944+0000 7f30bbe00640 1 -- 172.21.15.6:0/3492300336 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a400c0a0 con 0x7f30a4005130 2024-08-17T02:26:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.945+0000 7f30c0e00640 1 --2- 172.21.15.6:0/3492300336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30a4004780 0x7f30a4004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.945+0000 7f30c1800640 1 --2- 172.21.15.6:0/3492300336 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30a40039d0 0x7f30a4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.945+0000 7f30c2200640 1 --2- 172.21.15.6:0/3492300336 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30a4005130 0x7f30a400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.945+0000 7f30c0e00640 1 -- 172.21.15.6:0/3492300336 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30a4005130 msgr2=0x7f30a400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.945+0000 7f30c0e00640 1 --2- 172.21.15.6:0/3492300336 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30a4005130 0x7f30a400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.945+0000 7f30c0e00640 1 -- 172.21.15.6:0/3492300336 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30a40039d0 msgr2=0x7f30a4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.945+0000 7f30c0e00640 1 --2- 172.21.15.6:0/3492300336 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30a40039d0 0x7f30a4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.945+0000 7f30c0e00640 1 -- 172.21.15.6:0/3492300336 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a40034e0 con 0x7f30a4004780 2024-08-17T02:26:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.945+0000 7f30c2200640 1 -- 172.21.15.6:0/3492300336 reap_dead start 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.947+0000 7f30c0e00640 1 --2- 172.21.15.6:0/3492300336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30a4004780 0x7f30a4004bf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f30a800c1e0 tx=0x7f30a80077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a3fc1a4d6ad11f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.947+0000 7f30bbe00640 1 -- 172.21.15.6:0/3492300336 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a8031400 con 0x7f30a4004780 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.947+0000 7f30bbe00640 1 -- 172.21.15.6:0/3492300336 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a802d050 con 0x7f30a4004780 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.947+0000 7f30bbe00640 1 -- 172.21.15.6:0/3492300336 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a80317d0 con 0x7f30a4004780 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.948+0000 7f30c4200640 1 -- 172.21.15.6:0/3492300336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30a4004780 msgr2=0x7f30a4004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.948+0000 7f30c4200640 1 --2- 172.21.15.6:0/3492300336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30a4004780 0x7f30a4004bf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f30a800c1e0 tx=0x7f30a80077a0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.948+0000 7f30c4200640 1 -- 172.21.15.6:0/3492300336 shutdown_connections 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.948+0000 7f30c4200640 1 --2- 172.21.15.6:0/3492300336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30a4004780 0x7f30a4004bf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.948+0000 7f30c4200640 1 -- 172.21.15.6:0/3492300336 >> 172.21.15.6:0/3492300336 conn(0x7f30bc06e590 msgr2=0x7f30bc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.948+0000 7f30c4200640 1 -- 172.21.15.6:0/3492300336 shutdown_connections 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.948+0000 7f30c4200640 1 -- 172.21.15.6:0/3492300336 wait complete. 2024-08-17T02:26:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.950+0000 7f30c4200640 1 Processor -- start 2024-08-17T02:26:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.950+0000 7f30c4200640 1 -- start start 2024-08-17T02:26:12.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.951+0000 7f30c4200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30a4004780 0x7f30bc15b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.951+0000 7f30c4200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30bc0b2ab0 0x7f30bc0b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.951+0000 7f30c4200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30bc0c9610 0x7f30bc0b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.951+0000 7f30c4200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc0b3020 con 0x7f30bc0c9610 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.951+0000 7f30c4200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc15b260 con 0x7f30bc0b2ab0 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.951+0000 7f30c4200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc15a930 con 0x7f30a4004780 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.952+0000 7f30c1800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30a4004780 0x7f30bc15b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.952+0000 7f30c2200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30bc0c9610 0x7f30bc0b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.952+0000 7f30c1800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30a4004780 0x7f30bc15b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:36802/0 (socket says 172.21.15.6:36802) 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.952+0000 7f30c1800640 1 -- 172.21.15.6:0/1112050644 learned_addr learned my addr 172.21.15.6:0/1112050644 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.952+0000 7f30c0e00640 1 --2- 172.21.15.6:0/1112050644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30bc0b2ab0 0x7f30bc0b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.952+0000 7f30c2200640 1 -- 172.21.15.6:0/1112050644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30a4004780 msgr2=0x7f30bc15b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.952+0000 7f30c2200640 1 --2- 172.21.15.6:0/1112050644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30a4004780 0x7f30bc15b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.952+0000 7f30c2200640 1 -- 172.21.15.6:0/1112050644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30bc0b2ab0 msgr2=0x7f30bc0b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.952+0000 7f30c2200640 1 --2- 172.21.15.6:0/1112050644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30bc0b2ab0 0x7f30bc0b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.952+0000 7f30c2200640 1 -- 172.21.15.6:0/1112050644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc15ac10 con 0x7f30bc0c9610 2024-08-17T02:26:12.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.952+0000 7f30c2200640 1 --2- 172.21.15.6:0/1112050644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30bc0c9610 0x7f30bc0b0d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0cd7b0 tx=0x7f30b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.954+0000 7f30b8c00640 1 -- 172.21.15.6:0/1112050644 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b401a070 con 0x7f30bc0c9610 2024-08-17T02:26:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.954+0000 7f30b8c00640 1 -- 172.21.15.6:0/1112050644 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b400f070 con 0x7f30bc0c9610 2024-08-17T02:26:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.954+0000 7f30b8c00640 1 -- 172.21.15.6:0/1112050644 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b40158e0 con 0x7f30bc0c9610 2024-08-17T02:26:12.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.955+0000 7f30c4200640 1 -- 172.21.15.6:0/1112050644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30bc15aef0 con 0x7f30bc0c9610 2024-08-17T02:26:12.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.955+0000 7f30c4200640 1 -- 172.21.15.6:0/1112050644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30bc0c9a80 con 0x7f30bc0c9610 2024-08-17T02:26:12.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.957+0000 7f30c4200640 1 -- 172.21.15.6:0/1112050644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30bc15bc30 con 0x7f30bc0c9610 2024-08-17T02:26:12.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.957+0000 7f30b8c00640 1 -- 172.21.15.6:0/1112050644 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f30b4003020 con 0x7f30bc0c9610 2024-08-17T02:26:12.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.957+0000 7f30b8c00640 1 -- 172.21.15.6:0/1112050644 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f30b4029d50 con 0x7f30bc0c9610 2024-08-17T02:26:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:12.960+0000 7f30b8c00640 1 -- 172.21.15.6:0/1112050644 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f30b4029430 con 0x7f30bc0c9610 2024-08-17T02:26:13.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:13.029+0000 7f30c4200640 1 -- 172.21.15.6:0/1112050644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f30bc063fb0 con 0x7f30bc0c9610 2024-08-17T02:26:13.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:13.033+0000 7f30b8c00640 1 -- 172.21.15.6:0/1112050644 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f30b401f4d0 con 0x7f30bc0c9610 2024-08-17T02:26:13.033 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2024-08-17T02:26:13.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:13.034+0000 7f30c4200640 1 -- 172.21.15.6:0/1112050644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30bc0c9610 msgr2=0x7f30bc0b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:13.034+0000 7f30c4200640 1 --2- 172.21.15.6:0/1112050644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30bc0c9610 0x7f30bc0b0d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0cd7b0 tx=0x7f30b400b040 comp rx=0 tx=0).stop 2024-08-17T02:26:13.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:13.034+0000 7f30c4200640 1 -- 172.21.15.6:0/1112050644 shutdown_connections 2024-08-17T02:26:13.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:13.034+0000 7f30c4200640 1 --2- 172.21.15.6:0/1112050644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30bc0c9610 0x7f30bc0b0d00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:13.034+0000 7f30c4200640 1 --2- 172.21.15.6:0/1112050644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30bc0b2ab0 0x7f30bc0b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:13.034+0000 7f30c4200640 1 --2- 172.21.15.6:0/1112050644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f30a4004780 0x7f30bc15b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:13.034+0000 7f30c4200640 1 -- 172.21.15.6:0/1112050644 >> 172.21.15.6:0/1112050644 conn(0x7f30bc06e590 msgr2=0x7f30bc154f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:13.034+0000 7f30c4200640 1 -- 172.21.15.6:0/1112050644 shutdown_connections 2024-08-17T02:26:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:13.034+0000 7f30c4200640 1 -- 172.21.15.6:0/1112050644 wait complete. 2024-08-17T02:26:13.049 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:26:13.049 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:26:13.049 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:26:13.073 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:13.072+0000 7f7d03440ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:26:13.081 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:13.080+0000 7fac36768ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:26:13.106 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:26:13.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:26:13.202 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:26:13.202 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:26:13.233 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:13.232+0000 7f7d03440ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:26:13.235 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:13.234+0000 7fac36768ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:26:13.291 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-08-17T02:26:13.291 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:26:13.292 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:13.289+0000 7f7d03440ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:26:13.298 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:13.297+0000 7fac36768ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:26:13.353 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:26:13.353 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:26:13.412 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:26:13.412 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:26:13.511 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:26:13.512 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:26:13.577 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:13.576+0000 7f7d03440ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:26:13.587 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:13.586+0000 7fac36768ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:26:13.612 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-08-17T02:26:13.612 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:26:13.633 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:13.632+0000 7f7d03440ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:26:13.639 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:13.639+0000 7fac36768ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:26:13.688 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 6723087a-acf7-4d6c-a252-3e9ad8778e0b 0 2024-08-17T02:26:13.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.872+0000 7effc3e00640 1 Processor -- start 2024-08-17T02:26:13.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.872+0000 7effc3e00640 1 -- start start 2024-08-17T02:26:13.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.873+0000 7effc3e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7effc4158dd0 0x7effc406e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.873+0000 7effc3e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effc406ead0 0x7effc40b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.873+0000 7effc3e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc406eef0 con 0x7effc4158a00 2024-08-17T02:26:13.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.873+0000 7effc3e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc4159230 con 0x7effc4158dd0 2024-08-17T02:26:13.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.873+0000 7effc3e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc40cbc50 con 0x7effc406ead0 2024-08-17T02:26:13.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.873+0000 7effc2000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7effc4158dd0 0x7effc406e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.873+0000 7effc3400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effc406ead0 0x7effc40b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.873+0000 7effc2000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7effc4158dd0 0x7effc406e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54354/0 (socket says 172.21.15.136:54354) 2024-08-17T02:26:13.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.873+0000 7effc2000640 1 -- 172.21.15.136:0/266201168 learned_addr learned my addr 172.21.15.136:0/266201168 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-08-17T02:26:13.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.874+0000 7effc2000640 1 -- 172.21.15.136:0/266201168 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effc406ead0 msgr2=0x7effc40b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:13.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.874+0000 7effc2000640 1 --2- 172.21.15.136:0/266201168 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effc406ead0 0x7effc40b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.874+0000 7effc2000640 1 -- 172.21.15.136:0/266201168 >> v1:172.21.15.136:6789/0 conn(0x7effc4158a00 legacy=0x7effc40cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.874+0000 7effc2000640 1 -- 172.21.15.136:0/266201168 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc40cbf30 con 0x7effc4158dd0 2024-08-17T02:26:13.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.875+0000 7effc2000640 1 --2- 172.21.15.136:0/266201168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effc4158dd0 0x7effc406e590 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7effb0009910 tx=0x7effb00091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24c2e0d7d963edcc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.875+0000 7effc1600640 1 -- 172.21.15.136:0/266201168 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb002ae40 con 0x7effc4158dd0 2024-08-17T02:26:13.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.875+0000 7effc1600640 1 -- 172.21.15.136:0/266201168 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb0032440 con 0x7effc4158dd0 2024-08-17T02:26:13.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.875+0000 7effc1600640 1 -- 172.21.15.136:0/266201168 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0032820 con 0x7effc4158dd0 2024-08-17T02:26:13.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.876+0000 7effc3e00640 1 -- 172.21.15.136:0/266201168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effc4158dd0 msgr2=0x7effc406e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.876+0000 7effc3e00640 1 --2- 172.21.15.136:0/266201168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effc4158dd0 0x7effc406e590 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7effb0009910 tx=0x7effb00091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.876+0000 7effc3e00640 1 -- 172.21.15.136:0/266201168 shutdown_connections 2024-08-17T02:26:13.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.876+0000 7effc3e00640 1 --2- 172.21.15.136:0/266201168 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effc406ead0 0x7effc40b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.876+0000 7effc3e00640 1 --2- 172.21.15.136:0/266201168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effc4158dd0 0x7effc406e590 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.876+0000 7effc3e00640 1 -- 172.21.15.136:0/266201168 >> 172.21.15.136:0/266201168 conn(0x7effc40cfb80 msgr2=0x7effc40cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.876+0000 7effc3e00640 1 -- 172.21.15.136:0/266201168 shutdown_connections 2024-08-17T02:26:13.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.876+0000 7effc3e00640 1 -- 172.21.15.136:0/266201168 wait complete. 2024-08-17T02:26:13.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.877+0000 7effc3e00640 1 Processor -- start 2024-08-17T02:26:13.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.877+0000 7effc3e00640 1 -- start start 2024-08-17T02:26:13.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.878+0000 7effc3e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effc406ead0 0x7effc415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.878+0000 7effc3e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effc4158a00 0x7effc40a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.878+0000 7effc3e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effc4158dd0 0x7effc4168ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.878+0000 7effc3e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc415dff0 con 0x7effc406ead0 2024-08-17T02:26:13.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.878+0000 7effc3e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc4156160 con 0x7effc4158a00 2024-08-17T02:26:13.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.878+0000 7effc3e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc415d030 con 0x7effc4158dd0 2024-08-17T02:26:13.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.879+0000 7effc2000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effc4158a00 0x7effc40a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.879+0000 7effc3400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effc4158dd0 0x7effc4168ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.879+0000 7effc2000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effc4158a00 0x7effc40a64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54360/0 (socket says 172.21.15.136:54360) 2024-08-17T02:26:13.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.879+0000 7effc2000640 1 -- 172.21.15.136:0/1730266816 learned_addr learned my addr 172.21.15.136:0/1730266816 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-08-17T02:26:13.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.879+0000 7effc2a00640 1 --2- 172.21.15.136:0/1730266816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effc406ead0 0x7effc415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.879+0000 7effc2000640 1 -- 172.21.15.136:0/1730266816 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effc4158dd0 msgr2=0x7effc4168ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.879+0000 7effc2000640 1 --2- 172.21.15.136:0/1730266816 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effc4158dd0 0x7effc4168ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.879+0000 7effc2000640 1 -- 172.21.15.136:0/1730266816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effc406ead0 msgr2=0x7effc415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.879+0000 7effc2000640 1 --2- 172.21.15.136:0/1730266816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effc406ead0 0x7effc415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.879+0000 7effc2000640 1 -- 172.21.15.136:0/1730266816 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb0009450 con 0x7effc4158a00 2024-08-17T02:26:13.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.879+0000 7effc2a00640 1 --2- 172.21.15.136:0/1730266816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effc406ead0 0x7effc415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:13.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.879+0000 7effc2000640 1 --2- 172.21.15.136:0/1730266816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effc4158a00 0x7effc40a64d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7effb0009970 tx=0x7effb0032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.880+0000 7effba000640 1 -- 172.21.15.136:0/1730266816 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0031bb0 con 0x7effc4158a00 2024-08-17T02:26:13.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.880+0000 7effba000640 1 -- 172.21.15.136:0/1730266816 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb0031d30 con 0x7effc4158a00 2024-08-17T02:26:13.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.880+0000 7effba000640 1 -- 172.21.15.136:0/1730266816 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0031ea0 con 0x7effc4158a00 2024-08-17T02:26:13.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.880+0000 7effc3e00640 1 -- 172.21.15.136:0/1730266816 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc40c7050 con 0x7effc4158a00 2024-08-17T02:26:13.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.880+0000 7effc3e00640 1 -- 172.21.15.136:0/1730266816 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc40c9370 con 0x7effc4158a00 2024-08-17T02:26:13.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.880+0000 7effba000640 1 -- 172.21.15.136:0/1730266816 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7effb0039040 con 0x7effc4158a00 2024-08-17T02:26:13.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.880+0000 7effba000640 1 -- 172.21.15.136:0/1730266816 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7effb002ae40 con 0x7effc4158a00 2024-08-17T02:26:13.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.881+0000 7effc3e00640 1 -- 172.21.15.136:0/1730266816 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc4070720 con 0x7effc4158a00 2024-08-17T02:26:13.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.884+0000 7effba000640 1 -- 172.21.15.136:0/1730266816 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7effb0042070 con 0x7effc4158a00 2024-08-17T02:26:13.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.959+0000 7effc3e00640 1 -- 172.21.15.136:0/1730266816 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6723087a-acf7-4d6c-a252-3e9ad8778e0b", "id": 0} v 0) v1 -- 0x7effc40c9650 con 0x7effc4158a00 2024-08-17T02:26:13.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.966+0000 7effba000640 1 -- 172.21.15.136:0/1730266816 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6723087a-acf7-4d6c-a252-3e9ad8778e0b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7effb0037070 con 0x7effc4158a00 2024-08-17T02:26:13.968 INFO:teuthology.orchestra.run.smithi136.stdout:0 2024-08-17T02:26:13.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.967+0000 7effc3e00640 1 -- 172.21.15.136:0/1730266816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effc4158a00 msgr2=0x7effc40a64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.967+0000 7effc3e00640 1 --2- 172.21.15.136:0/1730266816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effc4158a00 0x7effc40a64d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7effb0009970 tx=0x7effb0032000 comp rx=0 tx=0).stop 2024-08-17T02:26:13.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.967+0000 7effc3e00640 1 -- 172.21.15.136:0/1730266816 shutdown_connections 2024-08-17T02:26:13.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.967+0000 7effc3e00640 1 --2- 172.21.15.136:0/1730266816 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effc4158dd0 0x7effc4168ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.967+0000 7effc3e00640 1 --2- 172.21.15.136:0/1730266816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effc4158a00 0x7effc40a64d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.967+0000 7effc3e00640 1 --2- 172.21.15.136:0/1730266816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effc406ead0 0x7effc415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.967+0000 7effc3e00640 1 -- 172.21.15.136:0/1730266816 >> 172.21.15.136:0/1730266816 conn(0x7effc40cfb80 msgr2=0x7effc40b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.968+0000 7effc3e00640 1 -- 172.21.15.136:0/1730266816 shutdown_connections 2024-08-17T02:26:13.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:13.968+0000 7effc3e00640 1 -- 172.21.15.136:0/1730266816 wait complete. 2024-08-17T02:26:13.983 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 770e8a42-c2ec-4989-9e72-695089f35d6d 1 2024-08-17T02:26:14.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.127+0000 7f9cb9200640 1 Processor -- start 2024-08-17T02:26:14.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.127+0000 7f9cb9200640 1 -- start start 2024-08-17T02:26:14.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.128+0000 7f9cb9200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9cb4156900 0x7f9cb40b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.128+0000 7f9cb9200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9cb40ae7d0 0x7f9cb40ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.128+0000 7f9cb9200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb40b0b10 con 0x7f9cb4156cd0 2024-08-17T02:26:14.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.128+0000 7f9cb9200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb40b0df0 con 0x7f9cb4156900 2024-08-17T02:26:14.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.128+0000 7f9cb9200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb40b10d0 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.129+0000 7f9cabe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9cb40ae7d0 0x7f9cb40ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.129+0000 7f9cabe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9cb40ae7d0 0x7f9cb40ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54362/0 (socket says 172.21.15.136:54362) 2024-08-17T02:26:14.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.129+0000 7f9cabe00640 1 -- 172.21.15.136:0/797513150 learned_addr learned my addr 172.21.15.136:0/797513150 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-08-17T02:26:14.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.129+0000 7f9cb3400640 1 --2- 172.21.15.136:0/797513150 >> v2:172.21.15.6:3300/0 conn(0x7f9cb4156900 0x7f9cb40b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.129+0000 7f9cabe00640 1 -- 172.21.15.136:0/797513150 >> v2:172.21.15.6:3300/0 conn(0x7f9cb4156900 msgr2=0x7f9cb40b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:14.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.129+0000 7f9cabe00640 1 --2- 172.21.15.136:0/797513150 >> v2:172.21.15.6:3300/0 conn(0x7f9cb4156900 0x7f9cb40b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.132 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.129+0000 7f9cabe00640 1 -- 172.21.15.136:0/797513150 >> v1:172.21.15.136:6789/0 conn(0x7f9cb4156cd0 legacy=0x7f9cb415a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.132 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.129+0000 7f9cabe00640 1 -- 172.21.15.136:0/797513150 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb40b13b0 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.130+0000 7f9cabe00640 1 --2- 172.21.15.136:0/797513150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cb40ae7d0 0x7f9cb40ada70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40b17f0 tx=0x7f9c9c0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf5ed45cd817cb5f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.130+0000 7f9cb2a00640 1 -- 172.21.15.136:0/797513150 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c02ae80 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.130+0000 7f9cb2a00640 1 -- 172.21.15.136:0/797513150 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9c032440 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.130+0000 7f9cb2a00640 1 -- 172.21.15.136:0/797513150 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c032800 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.131+0000 7f9cb9200640 1 -- 172.21.15.136:0/797513150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cb40ae7d0 msgr2=0x7f9cb40ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.131+0000 7f9cb9200640 1 --2- 172.21.15.136:0/797513150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cb40ae7d0 0x7f9cb40ada70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40b17f0 tx=0x7f9c9c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.131+0000 7f9cb9200640 1 -- 172.21.15.136:0/797513150 shutdown_connections 2024-08-17T02:26:14.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.131+0000 7f9cb9200640 1 --2- 172.21.15.136:0/797513150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cb40ae7d0 0x7f9cb40ada70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.131+0000 7f9cb9200640 1 --2- 172.21.15.136:0/797513150 >> v2:172.21.15.6:3300/0 conn(0x7f9cb4156900 0x7f9cb40b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.131+0000 7f9cb9200640 1 -- 172.21.15.136:0/797513150 >> 172.21.15.136:0/797513150 conn(0x7f9cb4067930 msgr2=0x7f9cb40cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:14.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.131+0000 7f9cb9200640 1 -- 172.21.15.136:0/797513150 shutdown_connections 2024-08-17T02:26:14.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.131+0000 7f9cb9200640 1 -- 172.21.15.136:0/797513150 wait complete. 2024-08-17T02:26:14.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.133+0000 7f9cb9200640 1 Processor -- start 2024-08-17T02:26:14.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.133+0000 7f9cb9200640 1 -- start start 2024-08-17T02:26:14.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.133+0000 7f9cb9200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9cb40ae7d0 0x7f9cb4151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.134+0000 7f9cb9200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cb4156900 0x7f9cb4069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.134+0000 7f9cb9200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cb4156cd0 0x7f9cb4069b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.134+0000 7f9cb9200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40c2230 con 0x7f9cb4156900 2024-08-17T02:26:14.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.134+0000 7f9cb9200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb415a0a0 con 0x7f9cb4156cd0 2024-08-17T02:26:14.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.134+0000 7f9cb9200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb4159490 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.134+0000 7f9cb3400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9cb40ae7d0 0x7f9cb4151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.134+0000 7f9cb3400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9cb40ae7d0 0x7f9cb4151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:34720/0 (socket says 172.21.15.136:34720) 2024-08-17T02:26:14.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.134+0000 7f9cb3400640 1 -- 172.21.15.136:0/3283016096 learned_addr learned my addr 172.21.15.136:0/3283016096 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-08-17T02:26:14.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.134+0000 7f9cb3e00640 1 --2- 172.21.15.136:0/3283016096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cb4156cd0 0x7f9cb4069b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.134+0000 7f9cabe00640 1 --2- 172.21.15.136:0/3283016096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cb4156900 0x7f9cb4069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.134+0000 7f9cb3400640 1 -- 172.21.15.136:0/3283016096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cb4156cd0 msgr2=0x7f9cb4069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.134+0000 7f9cb3400640 1 --2- 172.21.15.136:0/3283016096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cb4156cd0 0x7f9cb4069b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.134+0000 7f9cb3400640 1 -- 172.21.15.136:0/3283016096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cb4156900 msgr2=0x7f9cb4069640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.134+0000 7f9cb3400640 1 --2- 172.21.15.136:0/3283016096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cb4156900 0x7f9cb4069640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.134+0000 7f9cb3400640 1 -- 172.21.15.136:0/3283016096 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c009450 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.134+0000 7f9cb3400640 1 --2- 172.21.15.136:0/3283016096 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9cb40ae7d0 0x7f9cb4151330 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400d890 tx=0x7f9ca4008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.135+0000 7f9caaa00640 1 -- 172.21.15.136:0/3283016096 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca400de20 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.135+0000 7f9caaa00640 1 -- 172.21.15.136:0/3283016096 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca400b8d0 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.135+0000 7f9caaa00640 1 -- 172.21.15.136:0/3283016096 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca400bc70 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.135+0000 7f9cb9200640 1 -- 172.21.15.136:0/3283016096 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb4159770 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.135+0000 7f9cb9200640 1 -- 172.21.15.136:0/3283016096 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb4159d30 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.135+0000 7f9caaa00640 1 -- 172.21.15.136:0/3283016096 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9ca40148d0 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.135+0000 7f9caaa00640 1 -- 172.21.15.136:0/3283016096 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f9ca401e4a0 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.136+0000 7f9cb9200640 1 -- 172.21.15.136:0/3283016096 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb4070720 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.139+0000 7f9caaa00640 1 -- 172.21.15.136:0/3283016096 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f9ca4014d10 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.217+0000 7f9cb9200640 1 -- 172.21.15.136:0/3283016096 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "770e8a42-c2ec-4989-9e72-695089f35d6d", "id": 1} v 0) v1 -- 0x7f9cb40ad3c0 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.225+0000 7f9caaa00640 1 -- 172.21.15.136:0/3283016096 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "770e8a42-c2ec-4989-9e72-695089f35d6d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9ca401e660 con 0x7f9cb40ae7d0 2024-08-17T02:26:14.227 INFO:teuthology.orchestra.run.smithi136.stdout:1 2024-08-17T02:26:14.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.226+0000 7f9cb9200640 1 -- 172.21.15.136:0/3283016096 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9cb40ae7d0 msgr2=0x7f9cb4151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.226+0000 7f9cb9200640 1 --2- 172.21.15.136:0/3283016096 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9cb40ae7d0 0x7f9cb4151330 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400d890 tx=0x7f9ca4008040 comp rx=0 tx=0).stop 2024-08-17T02:26:14.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.227+0000 7f9cb9200640 1 -- 172.21.15.136:0/3283016096 shutdown_connections 2024-08-17T02:26:14.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.227+0000 7f9cb9200640 1 --2- 172.21.15.136:0/3283016096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cb4156cd0 0x7f9cb4069b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.227+0000 7f9cb9200640 1 --2- 172.21.15.136:0/3283016096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cb4156900 0x7f9cb4069640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.227+0000 7f9cb9200640 1 --2- 172.21.15.136:0/3283016096 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9cb40ae7d0 0x7f9cb4151330 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.227+0000 7f9cb9200640 1 -- 172.21.15.136:0/3283016096 >> 172.21.15.136:0/3283016096 conn(0x7f9cb4067930 msgr2=0x7f9cb40a9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:14.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.227+0000 7f9cb9200640 1 -- 172.21.15.136:0/3283016096 shutdown_connections 2024-08-17T02:26:14.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.227+0000 7f9cb9200640 1 -- 172.21.15.136:0/3283016096 wait complete. 2024-08-17T02:26:14.242 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb 2 2024-08-17T02:26:14.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.385+0000 7f4008000640 1 Processor -- start 2024-08-17T02:26:14.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.385+0000 7f4008000640 1 -- start start 2024-08-17T02:26:14.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.386+0000 7f4008000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40000cb0d0 0x7f4000158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.386+0000 7f4008000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f40000cda30 0x7f40000cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.386+0000 7f4008000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40000af9a0 con 0x7f40001589e0 2024-08-17T02:26:14.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.386+0000 7f4008000640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40000af810 con 0x7f40000cb0d0 2024-08-17T02:26:14.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.386+0000 7f4008000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40000ce740 con 0x7f40000cda30 2024-08-17T02:26:14.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.386+0000 7f4006000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f40000cda30 0x7f40000cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.386+0000 7f4006000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f40000cda30 0x7f40000cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54378/0 (socket says 172.21.15.136:54378) 2024-08-17T02:26:14.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.386+0000 7f4006000640 1 -- 172.21.15.136:0/2364896493 learned_addr learned my addr 172.21.15.136:0/2364896493 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-08-17T02:26:14.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.387+0000 7f4004c00640 1 --2- 172.21.15.136:0/2364896493 >> v2:172.21.15.6:3300/0 conn(0x7f40000cb0d0 0x7f4000158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.387+0000 7f4006000640 1 -- 172.21.15.136:0/2364896493 >> v2:172.21.15.6:3300/0 conn(0x7f40000cb0d0 msgr2=0x7f4000158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:14.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.387+0000 7f4006000640 1 --2- 172.21.15.136:0/2364896493 >> v2:172.21.15.6:3300/0 conn(0x7f40000cb0d0 0x7f4000158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.387+0000 7f4006000640 1 -- 172.21.15.136:0/2364896493 >> v1:172.21.15.136:6789/0 conn(0x7f40001589e0 legacy=0x7f40000ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.387+0000 7f4006000640 1 -- 172.21.15.136:0/2364896493 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40000cea00 con 0x7f40000cda30 2024-08-17T02:26:14.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.387+0000 7f4004c00640 1 --2- 172.21.15.136:0/2364896493 >> v2:172.21.15.6:3300/0 conn(0x7f40000cb0d0 0x7f4000158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:14.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.388+0000 7f4006000640 1 --2- 172.21.15.136:0/2364896493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40000cda30 0x7f40000cdeb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f40000cbe00 tx=0x7f3ff8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30c7765cab3a4192 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.388+0000 7f3fffe00640 1 -- 172.21.15.136:0/2364896493 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff802e050 con 0x7f40000cda30 2024-08-17T02:26:14.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.388+0000 7f3fffe00640 1 -- 172.21.15.136:0/2364896493 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff8007400 con 0x7f40000cda30 2024-08-17T02:26:14.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.388+0000 7f3fffe00640 1 -- 172.21.15.136:0/2364896493 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80077e0 con 0x7f40000cda30 2024-08-17T02:26:14.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.389+0000 7f4008000640 1 -- 172.21.15.136:0/2364896493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40000cda30 msgr2=0x7f40000cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.389+0000 7f4008000640 1 --2- 172.21.15.136:0/2364896493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40000cda30 0x7f40000cdeb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f40000cbe00 tx=0x7f3ff8009840 comp rx=0 tx=0).stop 2024-08-17T02:26:14.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.389+0000 7f4008000640 1 -- 172.21.15.136:0/2364896493 shutdown_connections 2024-08-17T02:26:14.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.389+0000 7f4008000640 1 --2- 172.21.15.136:0/2364896493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40000cda30 0x7f40000cdeb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.389+0000 7f4008000640 1 --2- 172.21.15.136:0/2364896493 >> v2:172.21.15.6:3300/0 conn(0x7f40000cb0d0 0x7f4000158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.389+0000 7f4008000640 1 -- 172.21.15.136:0/2364896493 >> 172.21.15.136:0/2364896493 conn(0x7f400006e590 msgr2=0x7f400006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:14.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.389+0000 7f4008000640 1 -- 172.21.15.136:0/2364896493 shutdown_connections 2024-08-17T02:26:14.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.389+0000 7f4008000640 1 -- 172.21.15.136:0/2364896493 wait complete. 2024-08-17T02:26:14.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.390+0000 7f4008000640 1 Processor -- start 2024-08-17T02:26:14.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.390+0000 7f4008000640 1 -- start start 2024-08-17T02:26:14.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.391+0000 7f4008000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40000cb0d0 0x7f40000b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.391+0000 7f4008000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40000cda30 0x7f400014e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.391+0000 7f4008000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40001589e0 0x7f400016c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.391+0000 7f4008000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40000b35f0 con 0x7f40000cda30 2024-08-17T02:26:14.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.391+0000 7f4008000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40000b3840 con 0x7f40001589e0 2024-08-17T02:26:14.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.391+0000 7f4008000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40000b3b20 con 0x7f40000cb0d0 2024-08-17T02:26:14.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.391+0000 7f4005600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40000cb0d0 0x7f40000b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.392+0000 7f4006000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40001589e0 0x7f400016c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.392+0000 7f4005600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40000cb0d0 0x7f40000b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:34732/0 (socket says 172.21.15.136:34732) 2024-08-17T02:26:14.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.392+0000 7f4006000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40001589e0 0x7f400016c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54386/0 (socket says 172.21.15.136:54386) 2024-08-17T02:26:14.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.392+0000 7f4005600640 1 -- 172.21.15.136:0/37660873 learned_addr learned my addr 172.21.15.136:0/37660873 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-08-17T02:26:14.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.392+0000 7f4004c00640 1 --2- 172.21.15.136:0/37660873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40000cda30 0x7f400014e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.392+0000 7f4006000640 1 -- 172.21.15.136:0/37660873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40000cb0d0 msgr2=0x7f40000b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.392+0000 7f4006000640 1 --2- 172.21.15.136:0/37660873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40000cb0d0 0x7f40000b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.392+0000 7f4006000640 1 -- 172.21.15.136:0/37660873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40000cda30 msgr2=0x7f400014e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.392+0000 7f4006000640 1 --2- 172.21.15.136:0/37660873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40000cda30 0x7f400014e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.392+0000 7f4006000640 1 -- 172.21.15.136:0/37660873 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff8009ae0 con 0x7f40001589e0 2024-08-17T02:26:14.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.392+0000 7f4006000640 1 --2- 172.21.15.136:0/37660873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40001589e0 0x7f400016c950 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8031000 tx=0x7f3ff8037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.392+0000 7f3ffcc00640 1 -- 172.21.15.136:0/37660873 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8033e60 con 0x7f40001589e0 2024-08-17T02:26:14.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.393+0000 7f3ffcc00640 1 -- 172.21.15.136:0/37660873 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff803c410 con 0x7f40001589e0 2024-08-17T02:26:14.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.393+0000 7f3ffcc00640 1 -- 172.21.15.136:0/37660873 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff803c7b0 con 0x7f40001589e0 2024-08-17T02:26:14.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.393+0000 7f4008000640 1 -- 172.21.15.136:0/37660873 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40000b3e00 con 0x7f40001589e0 2024-08-17T02:26:14.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.393+0000 7f4008000640 1 -- 172.21.15.136:0/37660873 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40000b10a0 con 0x7f40001589e0 2024-08-17T02:26:14.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.393+0000 7f3ffcc00640 1 -- 172.21.15.136:0/37660873 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f3ff8039050 con 0x7f40001589e0 2024-08-17T02:26:14.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.393+0000 7f3ffcc00640 1 -- 172.21.15.136:0/37660873 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f3ff803ce30 con 0x7f40001589e0 2024-08-17T02:26:14.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.394+0000 7f4008000640 1 -- 172.21.15.136:0/37660873 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40000b12c0 con 0x7f40001589e0 2024-08-17T02:26:14.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.396+0000 7f3ffcc00640 1 -- 172.21.15.136:0/37660873 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f3ff8040070 con 0x7f40001589e0 2024-08-17T02:26:14.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.469+0000 7f4008000640 1 -- 172.21.15.136:0/37660873 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb", "id": 2} v 0) v1 -- 0x7f4000063fb0 con 0x7f40001589e0 2024-08-17T02:26:14.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.477+0000 7f3ffcc00640 1 -- 172.21.15.136:0/37660873 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3ff8037070 con 0x7f40001589e0 2024-08-17T02:26:14.478 INFO:teuthology.orchestra.run.smithi136.stdout:2 2024-08-17T02:26:14.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.478+0000 7f4008000640 1 -- 172.21.15.136:0/37660873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40001589e0 msgr2=0x7f400016c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.478+0000 7f4008000640 1 --2- 172.21.15.136:0/37660873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40001589e0 0x7f400016c950 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8031000 tx=0x7f3ff8037000 comp rx=0 tx=0).stop 2024-08-17T02:26:14.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.478+0000 7f4008000640 1 -- 172.21.15.136:0/37660873 shutdown_connections 2024-08-17T02:26:14.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.478+0000 7f4008000640 1 --2- 172.21.15.136:0/37660873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40001589e0 0x7f400016c950 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.478+0000 7f4008000640 1 --2- 172.21.15.136:0/37660873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40000cda30 0x7f400014e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.478+0000 7f4008000640 1 --2- 172.21.15.136:0/37660873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40000cb0d0 0x7f40000b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.478+0000 7f4008000640 1 -- 172.21.15.136:0/37660873 >> 172.21.15.136:0/37660873 conn(0x7f400006e590 msgr2=0x7f4000156630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:14.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.478+0000 7f4008000640 1 -- 172.21.15.136:0/37660873 shutdown_connections 2024-08-17T02:26:14.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.478+0000 7f4008000640 1 -- 172.21.15.136:0/37660873 wait complete. 2024-08-17T02:26:14.492 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:14.492+0000 7fac36768ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:26:14.493 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new f257b775-74b0-4e36-9493-99536f8c0246 3 2024-08-17T02:26:14.506 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:14.505+0000 7f7d03440ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:26:14.596 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:14.595+0000 7fac36768ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:26:14.609 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:14.608+0000 7f7d03440ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:26:14.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.636+0000 7f8de0e00640 1 Processor -- start 2024-08-17T02:26:14.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.636+0000 7f8de0e00640 1 -- start start 2024-08-17T02:26:14.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.638+0000 7f8de0e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc158dd0 0x7f8ddc06e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.638+0000 7f8de0e00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ddc06ef10 con 0x7f8ddc06ead0 2024-08-17T02:26:14.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.638+0000 7f8de0e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ddc0cbc50 con 0x7f8ddc158a00 2024-08-17T02:26:14.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.638+0000 7f8de0e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc159200 con 0x7f8ddc158dd0 2024-08-17T02:26:14.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.638+0000 7f8ddb400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f8ddc158a00 0x7f8ddc0cb190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:54628/0 (socket says 172.21.15.136:54628) 2024-08-17T02:26:14.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.638+0000 7f8ddb400640 1 -- 172.21.15.136:0/2167387562 learned_addr learned my addr 172.21.15.136:0/2167387562 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-08-17T02:26:14.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.638+0000 7f8ddaa00640 1 --2- 172.21.15.136:0/2167387562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc158dd0 0x7f8ddc06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.638+0000 7f8dda000640 1 -- 172.21.15.136:0/2167387562 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686327961 0 0) 0x7f8ddc0cbc50 con 0x7f8ddc158a00 2024-08-17T02:26:14.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.638+0000 7f8dda000640 1 -- 172.21.15.136:0/2167387562 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dc00034e0 con 0x7f8ddc158a00 2024-08-17T02:26:14.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.638+0000 7f8ddaa00640 1 -- 172.21.15.136:0/2167387562 >> v1:172.21.15.136:6789/0 conn(0x7f8ddc158a00 legacy=0x7f8ddc0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.638+0000 7f8ddaa00640 1 -- 172.21.15.136:0/2167387562 >> v1:172.21.15.6:6789/0 conn(0x7f8ddc06ead0 legacy=0x7f8ddc0b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.639+0000 7f8dda000640 1 -- 172.21.15.136:0/2167387562 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511936484 0 0) 0x7f8ddc06ef10 con 0x7f8ddc06ead0 2024-08-17T02:26:14.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.639+0000 7f8ddaa00640 1 -- 172.21.15.136:0/2167387562 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc0cbf30 con 0x7f8ddc158dd0 2024-08-17T02:26:14.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.640+0000 7f8ddaa00640 1 --2- 172.21.15.136:0/2167387562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc158dd0 0x7f8ddc06e590 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009880 tx=0x7f8dc80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0ef8b3ad98084cd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.640+0000 7f8dda000640 1 -- 172.21.15.136:0/2167387562 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc802ae10 con 0x7f8ddc158dd0 2024-08-17T02:26:14.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.640+0000 7f8dda000640 1 -- 172.21.15.136:0/2167387562 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc8032440 con 0x7f8ddc158dd0 2024-08-17T02:26:14.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.640+0000 7f8dda000640 1 -- 172.21.15.136:0/2167387562 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc80327c0 con 0x7f8ddc158dd0 2024-08-17T02:26:14.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.641+0000 7f8de0e00640 1 -- 172.21.15.136:0/2167387562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc158dd0 msgr2=0x7f8ddc06e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.641+0000 7f8de0e00640 1 --2- 172.21.15.136:0/2167387562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc158dd0 0x7f8ddc06e590 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009880 tx=0x7f8dc80090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.641+0000 7f8de0e00640 1 -- 172.21.15.136:0/2167387562 shutdown_connections 2024-08-17T02:26:14.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.641+0000 7f8de0e00640 1 --2- 172.21.15.136:0/2167387562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc158dd0 0x7f8ddc06e590 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.641+0000 7f8de0e00640 1 -- 172.21.15.136:0/2167387562 >> 172.21.15.136:0/2167387562 conn(0x7f8ddc0cfb80 msgr2=0x7f8ddc0cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:14.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.641+0000 7f8de0e00640 1 -- 172.21.15.136:0/2167387562 shutdown_connections 2024-08-17T02:26:14.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.641+0000 7f8de0e00640 1 -- 172.21.15.136:0/2167387562 wait complete. 2024-08-17T02:26:14.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.642+0000 7f8de0e00640 1 Processor -- start 2024-08-17T02:26:14.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.643+0000 7f8de0e00640 1 -- start start 2024-08-17T02:26:14.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.643+0000 7f8de0e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc06ead0 0x7f8ddc159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.643+0000 7f8de0e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc158a00 0x7f8ddc167f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.643+0000 7f8de0e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ddc158dd0 0x7f8ddc155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.643+0000 7f8de0e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc15b790 con 0x7f8ddc06ead0 2024-08-17T02:26:14.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.643+0000 7f8de0e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc15ab80 con 0x7f8ddc158dd0 2024-08-17T02:26:14.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.643+0000 7f8de0e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc15ae60 con 0x7f8ddc158a00 2024-08-17T02:26:14.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.644+0000 7f8ddaa00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc158a00 0x7f8ddc167f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.644+0000 7f8ddbe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ddc158dd0 0x7f8ddc155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.644+0000 7f8ddaa00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc158a00 0x7f8ddc167f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:34746/0 (socket says 172.21.15.136:34746) 2024-08-17T02:26:14.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.644+0000 7f8ddaa00640 1 -- 172.21.15.136:0/1755096080 learned_addr learned my addr 172.21.15.136:0/1755096080 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-08-17T02:26:14.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.644+0000 7f8ddb400640 1 --2- 172.21.15.136:0/1755096080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc06ead0 0x7f8ddc159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.644+0000 7f8ddbe00640 1 -- 172.21.15.136:0/1755096080 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc158a00 msgr2=0x7f8ddc167f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.644+0000 7f8ddbe00640 1 --2- 172.21.15.136:0/1755096080 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc158a00 0x7f8ddc167f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.644+0000 7f8ddbe00640 1 -- 172.21.15.136:0/1755096080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc06ead0 msgr2=0x7f8ddc159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.644+0000 7f8ddbe00640 1 --2- 172.21.15.136:0/1755096080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc06ead0 0x7f8ddc159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.644+0000 7f8ddbe00640 1 -- 172.21.15.136:0/1755096080 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc8009390 con 0x7f8ddc158dd0 2024-08-17T02:26:14.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.644+0000 7f8ddb400640 1 --2- 172.21.15.136:0/1755096080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc06ead0 0x7f8ddc159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:14.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.644+0000 7f8ddaa00640 1 --2- 172.21.15.136:0/1755096080 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc158a00 0x7f8ddc167f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:14.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.645+0000 7f8ddbe00640 1 --2- 172.21.15.136:0/1755096080 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ddc158dd0 0x7f8ddc155e30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400c790 tx=0x7f8dd4007f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.645+0000 7f8dd2a00640 1 -- 172.21.15.136:0/1755096080 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd400a640 con 0x7f8ddc158dd0 2024-08-17T02:26:14.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.645+0000 7f8dd2a00640 1 -- 172.21.15.136:0/1755096080 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd400a7c0 con 0x7f8ddc158dd0 2024-08-17T02:26:14.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.645+0000 7f8dd2a00640 1 -- 172.21.15.136:0/1755096080 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd400ab80 con 0x7f8ddc158dd0 2024-08-17T02:26:14.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.645+0000 7f8de0e00640 1 -- 172.21.15.136:0/1755096080 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ddc15b140 con 0x7f8ddc158dd0 2024-08-17T02:26:14.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.645+0000 7f8de0e00640 1 -- 172.21.15.136:0/1755096080 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ddc15a270 con 0x7f8ddc158dd0 2024-08-17T02:26:14.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.645+0000 7f8dd2a00640 1 -- 172.21.15.136:0/1755096080 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f8dd4012420 con 0x7f8ddc158dd0 2024-08-17T02:26:14.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.645+0000 7f8dd2a00640 1 -- 172.21.15.136:0/1755096080 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f8dd4012b70 con 0x7f8ddc158dd0 2024-08-17T02:26:14.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.646+0000 7f8de0e00640 1 -- 172.21.15.136:0/1755096080 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ddc15b900 con 0x7f8ddc158dd0 2024-08-17T02:26:14.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.649+0000 7f8dd2a00640 1 -- 172.21.15.136:0/1755096080 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f8dd403a7a0 con 0x7f8ddc158dd0 2024-08-17T02:26:14.654 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:14.646+0000 7fac36768ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:26:14.662 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:14.661+0000 7f7d03440ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:26:14.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.723+0000 7f8de0e00640 1 -- 172.21.15.136:0/1755096080 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f257b775-74b0-4e36-9493-99536f8c0246", "id": 3} v 0) v1 -- 0x7f8ddc070720 con 0x7f8ddc158dd0 2024-08-17T02:26:14.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.731+0000 7f8dd2a00640 1 -- 172.21.15.136:0/1755096080 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f257b775-74b0-4e36-9493-99536f8c0246", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8dd4029070 con 0x7f8ddc158dd0 2024-08-17T02:26:14.732 INFO:teuthology.orchestra.run.smithi136.stdout:3 2024-08-17T02:26:14.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.732+0000 7f8de0e00640 1 -- 172.21.15.136:0/1755096080 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ddc158dd0 msgr2=0x7f8ddc155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.732+0000 7f8de0e00640 1 --2- 172.21.15.136:0/1755096080 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ddc158dd0 0x7f8ddc155e30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400c790 tx=0x7f8dd4007f50 comp rx=0 tx=0).stop 2024-08-17T02:26:14.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.732+0000 7f8de0e00640 1 -- 172.21.15.136:0/1755096080 shutdown_connections 2024-08-17T02:26:14.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.732+0000 7f8de0e00640 1 --2- 172.21.15.136:0/1755096080 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ddc158dd0 0x7f8ddc155e30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.732+0000 7f8de0e00640 1 --2- 172.21.15.136:0/1755096080 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ddc158a00 0x7f8ddc167f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.732+0000 7f8de0e00640 1 --2- 172.21.15.136:0/1755096080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc06ead0 0x7f8ddc159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.732+0000 7f8de0e00640 1 -- 172.21.15.136:0/1755096080 >> 172.21.15.136:0/1755096080 conn(0x7f8ddc0cfb80 msgr2=0x7f8ddc0cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:14.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.732+0000 7f8de0e00640 1 -- 172.21.15.136:0/1755096080 shutdown_connections 2024-08-17T02:26:14.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.732+0000 7f8de0e00640 1 -- 172.21.15.136:0/1755096080 wait complete. 2024-08-17T02:26:14.747 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 341b8afc-3c7c-43d9-9a4f-a01758853f96 4 2024-08-17T02:26:14.821 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:14.821+0000 7fac36768ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:26:14.839 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:14.838+0000 7f7d03440ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:26:14.883 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:14.882+0000 7fac36768ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:26:14.904 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:14.903+0000 7f7d03440ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:26:14.931 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.930+0000 7fecc0e00640 1 Processor -- start 2024-08-17T02:26:14.931 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.930+0000 7fecc0e00640 1 -- start start 2024-08-17T02:26:14.933 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.931+0000 7fecc0e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fecbc158dd0 0x7fecbc06e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.933 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.931+0000 7fecc0e00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecbc06eed0 con 0x7fecbc06ead0 2024-08-17T02:26:14.933 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.931+0000 7fecc0e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecbc0cbc50 con 0x7fecbc158a00 2024-08-17T02:26:14.933 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.931+0000 7fecc0e00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecbc159230 con 0x7fecbc158dd0 2024-08-17T02:26:14.933 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.932+0000 7fecbb400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fecbc158a00 0x7fecbc0cb190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:54642/0 (socket says 172.21.15.136:54642) 2024-08-17T02:26:14.933 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.932+0000 7fecbb400640 1 -- 172.21.15.136:0/1903595212 learned_addr learned my addr 172.21.15.136:0/1903595212 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-08-17T02:26:14.934 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.932+0000 7fecbaa00640 1 --2- 172.21.15.136:0/1903595212 >> v2:172.21.15.6:3300/0 conn(0x7fecbc158dd0 0x7fecbc06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.934 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.932+0000 7fecba000640 1 -- 172.21.15.136:0/1903595212 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643961645 0 0) 0x7fecbc0cbc50 con 0x7fecbc158a00 2024-08-17T02:26:14.934 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.932+0000 7fecbaa00640 1 -- 172.21.15.136:0/1903595212 >> v1:172.21.15.136:6789/0 conn(0x7fecbc158a00 legacy=0x7fecbc0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.934 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.932+0000 7fecbaa00640 1 -- 172.21.15.136:0/1903595212 >> v1:172.21.15.6:6789/0 conn(0x7fecbc06ead0 legacy=0x7fecbc0b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.934 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.932+0000 7fecbaa00640 1 -- 172.21.15.136:0/1903595212 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc0cbf30 con 0x7fecbc158dd0 2024-08-17T02:26:14.934 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.933+0000 7fecbaa00640 1 --2- 172.21.15.136:0/1903595212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecbc158dd0 0x7fecbc06e590 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feca4009850 tx=0x7feca40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b0bdef4c4a87bc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.935 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.933+0000 7fecba000640 1 -- 172.21.15.136:0/1903595212 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca402ac60 con 0x7fecbc158dd0 2024-08-17T02:26:14.935 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.933+0000 7fecba000640 1 -- 172.21.15.136:0/1903595212 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca402adc0 con 0x7fecbc158dd0 2024-08-17T02:26:14.935 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.933+0000 7fecba000640 1 -- 172.21.15.136:0/1903595212 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca4032670 con 0x7fecbc158dd0 2024-08-17T02:26:14.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.934+0000 7fecc0e00640 1 -- 172.21.15.136:0/1903595212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecbc158dd0 msgr2=0x7fecbc06e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.934+0000 7fecc0e00640 1 --2- 172.21.15.136:0/1903595212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecbc158dd0 0x7fecbc06e590 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feca4009850 tx=0x7feca40090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.934+0000 7fecc0e00640 1 -- 172.21.15.136:0/1903595212 shutdown_connections 2024-08-17T02:26:14.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.934+0000 7fecc0e00640 1 --2- 172.21.15.136:0/1903595212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecbc158dd0 0x7fecbc06e590 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.934+0000 7fecc0e00640 1 -- 172.21.15.136:0/1903595212 >> 172.21.15.136:0/1903595212 conn(0x7fecbc0cfb80 msgr2=0x7fecbc0cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:14.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.934+0000 7fecc0e00640 1 -- 172.21.15.136:0/1903595212 shutdown_connections 2024-08-17T02:26:14.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.934+0000 7fecc0e00640 1 -- 172.21.15.136:0/1903595212 wait complete. 2024-08-17T02:26:14.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.936+0000 7fecc0e00640 1 Processor -- start 2024-08-17T02:26:14.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.936+0000 7fecc0e00640 1 -- start start 2024-08-17T02:26:14.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.936+0000 7fecc0e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecbc06ead0 0x7fecbc0a6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.936+0000 7fecc0e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecbc158a00 0x7fecbc169070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.936+0000 7fecc0e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecbc158dd0 0x7fecbc1695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.936+0000 7fecc0e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc16a240 con 0x7fecbc158a00 2024-08-17T02:26:14.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.937+0000 7fecc0e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc0c9540 con 0x7fecbc158dd0 2024-08-17T02:26:14.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.937+0000 7fecc0e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc0b0400 con 0x7fecbc06ead0 2024-08-17T02:26:14.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.937+0000 7fecbb400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecbc06ead0 0x7fecbc0a6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.937+0000 7fecbb400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecbc06ead0 0x7fecbc0a6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:34758/0 (socket says 172.21.15.136:34758) 2024-08-17T02:26:14.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.937+0000 7fecbb400640 1 -- 172.21.15.136:0/4109656799 learned_addr learned my addr 172.21.15.136:0/4109656799 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-08-17T02:26:14.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.937+0000 7fecbbe00640 1 --2- 172.21.15.136:0/4109656799 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecbc158dd0 0x7fecbc1695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.937+0000 7fecbaa00640 1 --2- 172.21.15.136:0/4109656799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecbc158a00 0x7fecbc169070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.937+0000 7fecbb400640 1 -- 172.21.15.136:0/4109656799 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecbc158dd0 msgr2=0x7fecbc1695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.937+0000 7fecbb400640 1 --2- 172.21.15.136:0/4109656799 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecbc158dd0 0x7fecbc1695b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.937+0000 7fecbb400640 1 -- 172.21.15.136:0/4109656799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecbc158a00 msgr2=0x7fecbc169070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.937+0000 7fecbb400640 1 --2- 172.21.15.136:0/4109656799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecbc158a00 0x7fecbc169070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.937+0000 7fecbb400640 1 -- 172.21.15.136:0/4109656799 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca4009390 con 0x7fecbc06ead0 2024-08-17T02:26:14.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.937+0000 7fecbbe00640 1 --2- 172.21.15.136:0/4109656799 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecbc158dd0 0x7fecbc1695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:14.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.937+0000 7fecbaa00640 1 --2- 172.21.15.136:0/4109656799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecbc158a00 0x7fecbc169070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:14.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.938+0000 7fecbb400640 1 --2- 172.21.15.136:0/4109656799 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecbc06ead0 0x7fecbc0a6ea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fecac00c5e0 tx=0x7fecac007d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.938+0000 7fecb2a00640 1 -- 172.21.15.136:0/4109656799 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac005aa0 con 0x7fecbc06ead0 2024-08-17T02:26:14.941 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.938+0000 7fecb2a00640 1 -- 172.21.15.136:0/4109656799 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac005c00 con 0x7fecbc06ead0 2024-08-17T02:26:14.941 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.938+0000 7fecb2a00640 1 -- 172.21.15.136:0/4109656799 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac0070f0 con 0x7fecbc06ead0 2024-08-17T02:26:14.941 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.938+0000 7fecc0e00640 1 -- 172.21.15.136:0/4109656799 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecbc0a79a0 con 0x7fecbc06ead0 2024-08-17T02:26:14.941 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.938+0000 7fecc0e00640 1 -- 172.21.15.136:0/4109656799 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecbc0a7f60 con 0x7fecbc06ead0 2024-08-17T02:26:14.941 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.938+0000 7fecb2a00640 1 -- 172.21.15.136:0/4109656799 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fecac007520 con 0x7fecbc06ead0 2024-08-17T02:26:14.941 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.938+0000 7fecb2a00640 1 -- 172.21.15.136:0/4109656799 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fecac01b400 con 0x7fecbc06ead0 2024-08-17T02:26:14.941 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.939+0000 7fecc0e00640 1 -- 172.21.15.136:0/4109656799 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecbc070720 con 0x7fecbc06ead0 2024-08-17T02:26:14.942 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:14.941+0000 7fecb2a00640 1 -- 172.21.15.136:0/4109656799 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fecac025480 con 0x7fecbc06ead0 2024-08-17T02:26:14.946 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:14.946+0000 7fac36768ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:26:14.968 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:14.967+0000 7f7d03440ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:26:15.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.017+0000 7fecc0e00640 1 -- 172.21.15.136:0/4109656799 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "341b8afc-3c7c-43d9-9a4f-a01758853f96", "id": 4} v 0) v1 -- 0x7fecbc064040 con 0x7fecbc06ead0 2024-08-17T02:26:15.023 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.022+0000 7fecb2a00640 1 -- 172.21.15.136:0/4109656799 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "341b8afc-3c7c-43d9-9a4f-a01758853f96", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fecac01ba40 con 0x7fecbc06ead0 2024-08-17T02:26:15.023 INFO:teuthology.orchestra.run.smithi136.stdout:4 2024-08-17T02:26:15.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.023+0000 7fecc0e00640 1 -- 172.21.15.136:0/4109656799 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecbc06ead0 msgr2=0x7fecbc0a6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.023+0000 7fecc0e00640 1 --2- 172.21.15.136:0/4109656799 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecbc06ead0 0x7fecbc0a6ea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fecac00c5e0 tx=0x7fecac007d00 comp rx=0 tx=0).stop 2024-08-17T02:26:15.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.023+0000 7fecc0e00640 1 -- 172.21.15.136:0/4109656799 shutdown_connections 2024-08-17T02:26:15.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.023+0000 7fecc0e00640 1 --2- 172.21.15.136:0/4109656799 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecbc158dd0 0x7fecbc1695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.023+0000 7fecc0e00640 1 --2- 172.21.15.136:0/4109656799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecbc158a00 0x7fecbc169070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.023+0000 7fecc0e00640 1 --2- 172.21.15.136:0/4109656799 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecbc06ead0 0x7fecbc0a6ea0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.023+0000 7fecc0e00640 1 -- 172.21.15.136:0/4109656799 >> 172.21.15.136:0/4109656799 conn(0x7fecbc0cfb80 msgr2=0x7fecbc157d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.023+0000 7fecc0e00640 1 -- 172.21.15.136:0/4109656799 shutdown_connections 2024-08-17T02:26:15.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.023+0000 7fecc0e00640 1 -- 172.21.15.136:0/4109656799 wait complete. 2024-08-17T02:26:15.038 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new b728e85a-56ef-42ea-bf01-6cb390a743f8 5 2024-08-17T02:26:15.059 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:15.058+0000 7fac36768ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:26:15.084 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:15.083+0000 7f7d03440ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:26:15.184 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.183+0000 7f8cf9600640 1 Processor -- start 2024-08-17T02:26:15.184 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.183+0000 7f8cf9600640 1 -- start start 2024-08-17T02:26:15.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.184+0000 7f8cf9600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cf40ad960 0x7f8cf415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.184+0000 7f8cf9600640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf415b5e0 con 0x7f8cf40ca050 2024-08-17T02:26:15.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.184+0000 7f8cf9600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf40cb160 con 0x7f8cf40add30 2024-08-17T02:26:15.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.184+0000 7f8cf9600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf40b0d10 con 0x7f8cf40ad960 2024-08-17T02:26:15.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.184+0000 7f8cf3400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f8cf40add30 0x7f8cf40aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:54656/0 (socket says 172.21.15.136:54656) 2024-08-17T02:26:15.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.184+0000 7f8cf3400640 1 -- 172.21.15.136:0/1520654181 learned_addr learned my addr 172.21.15.136:0/1520654181 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-08-17T02:26:15.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.184+0000 7f8cf2a00640 1 --2- 172.21.15.136:0/1520654181 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cf40ad960 0x7f8cf415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.185+0000 7f8cf1600640 1 -- 172.21.15.136:0/1520654181 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913281605 0 0) 0x7f8cf40cb160 con 0x7f8cf40add30 2024-08-17T02:26:15.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.185+0000 7f8cf1600640 1 -- 172.21.15.136:0/1520654181 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cd80034e0 con 0x7f8cf40add30 2024-08-17T02:26:15.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.185+0000 7f8cf2a00640 1 -- 172.21.15.136:0/1520654181 >> v1:172.21.15.136:6789/0 conn(0x7f8cf40add30 legacy=0x7f8cf40aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.185+0000 7f8cf2a00640 1 -- 172.21.15.136:0/1520654181 >> v1:172.21.15.6:6789/0 conn(0x7f8cf40ca050 legacy=0x7f8cf4156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.185+0000 7f8cf1600640 1 -- 172.21.15.136:0/1520654181 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283793712 0 0) 0x7f8ce0001110 con 0x7f8cf40ca050 2024-08-17T02:26:15.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.185+0000 7f8cf2a00640 1 -- 172.21.15.136:0/1520654181 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf40ca550 con 0x7f8cf40ad960 2024-08-17T02:26:15.188 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.186+0000 7f8cf2a00640 1 --2- 172.21.15.136:0/1520654181 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cf40ad960 0x7f8cf415b0a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009880 tx=0x7f8ce40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98289725c1168a9b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.188 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.186+0000 7f8cf1600640 1 -- 172.21.15.136:0/1520654181 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce402aea0 con 0x7f8cf40ad960 2024-08-17T02:26:15.188 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.186+0000 7f8cf1600640 1 -- 172.21.15.136:0/1520654181 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce4032440 con 0x7f8cf40ad960 2024-08-17T02:26:15.188 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.186+0000 7f8cf1600640 1 -- 172.21.15.136:0/1520654181 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce40327c0 con 0x7f8cf40ad960 2024-08-17T02:26:15.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.187+0000 7f8cf9600640 1 -- 172.21.15.136:0/1520654181 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cf40ad960 msgr2=0x7f8cf415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.187+0000 7f8cf9600640 1 --2- 172.21.15.136:0/1520654181 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cf40ad960 0x7f8cf415b0a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009880 tx=0x7f8ce40090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.187+0000 7f8cf9600640 1 -- 172.21.15.136:0/1520654181 shutdown_connections 2024-08-17T02:26:15.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.187+0000 7f8cf9600640 1 --2- 172.21.15.136:0/1520654181 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cf40ad960 0x7f8cf415b0a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.187+0000 7f8cf9600640 1 -- 172.21.15.136:0/1520654181 >> 172.21.15.136:0/1520654181 conn(0x7f8cf4066e60 msgr2=0x7f8cf4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.187+0000 7f8cf9600640 1 -- 172.21.15.136:0/1520654181 shutdown_connections 2024-08-17T02:26:15.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.187+0000 7f8cf9600640 1 -- 172.21.15.136:0/1520654181 wait complete. 2024-08-17T02:26:15.190 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.189+0000 7f8cf9600640 1 Processor -- start 2024-08-17T02:26:15.190 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.189+0000 7f8cf9600640 1 -- start start 2024-08-17T02:26:15.192 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.190+0000 7f8cf9600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cf40ad960 0x7f8cf40a80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.192 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.190+0000 7f8cf9600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf40add30 0x7f8cf415f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.192 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.190+0000 7f8cf9600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cf40ca050 0x7f8cf40a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.192 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.190+0000 7f8cf9600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf40a5420 con 0x7f8cf40ca050 2024-08-17T02:26:15.192 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.190+0000 7f8cf9600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf40a58f0 con 0x7f8cf40add30 2024-08-17T02:26:15.192 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.190+0000 7f8cf9600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf415ced0 con 0x7f8cf40ad960 2024-08-17T02:26:15.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.190+0000 7f8cf2000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf40add30 0x7f8cf415f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.190+0000 7f8cf2a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cf40ad960 0x7f8cf40a80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.190+0000 7f8cf2000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf40add30 0x7f8cf415f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54424/0 (socket says 172.21.15.136:54424) 2024-08-17T02:26:15.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.190+0000 7f8cf2000640 1 -- 172.21.15.136:0/1867564653 learned_addr learned my addr 172.21.15.136:0/1867564653 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-08-17T02:26:15.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.190+0000 7f8cf3400640 1 --2- 172.21.15.136:0/1867564653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cf40ca050 0x7f8cf40a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.190+0000 7f8cf2a00640 1 -- 172.21.15.136:0/1867564653 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf40add30 msgr2=0x7f8cf415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.190+0000 7f8cf2a00640 1 --2- 172.21.15.136:0/1867564653 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf40add30 0x7f8cf415f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.190+0000 7f8cf2a00640 1 -- 172.21.15.136:0/1867564653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cf40ca050 msgr2=0x7f8cf40a4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.190+0000 7f8cf2a00640 1 --2- 172.21.15.136:0/1867564653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cf40ca050 0x7f8cf40a4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.190+0000 7f8cf2a00640 1 -- 172.21.15.136:0/1867564653 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce4009390 con 0x7f8cf40ad960 2024-08-17T02:26:15.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.190+0000 7f8cf2000640 1 --2- 172.21.15.136:0/1867564653 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf40add30 0x7f8cf415f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:15.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.191+0000 7f8cf2a00640 1 --2- 172.21.15.136:0/1867564653 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cf40ad960 0x7f8cf40a80f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4031000 tx=0x7f8ce4032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.191+0000 7f8cea000640 1 -- 172.21.15.136:0/1867564653 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce402aea0 con 0x7f8cf40ad960 2024-08-17T02:26:15.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.191+0000 7f8cea000640 1 -- 172.21.15.136:0/1867564653 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce4031900 con 0x7f8cf40ad960 2024-08-17T02:26:15.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.191+0000 7f8cea000640 1 -- 172.21.15.136:0/1867564653 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4031ca0 con 0x7f8cf40ad960 2024-08-17T02:26:15.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.191+0000 7f8cf9600640 1 -- 172.21.15.136:0/1867564653 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf40a5610 con 0x7f8cf40ad960 2024-08-17T02:26:15.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.191+0000 7f8cf9600640 1 -- 172.21.15.136:0/1867564653 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf415cb60 con 0x7f8cf40ad960 2024-08-17T02:26:15.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.191+0000 7f8cea000640 1 -- 172.21.15.136:0/1867564653 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f8ce4039040 con 0x7f8cf40ad960 2024-08-17T02:26:15.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.191+0000 7f8cea000640 1 -- 172.21.15.136:0/1867564653 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f8ce4031e00 con 0x7f8cf40ad960 2024-08-17T02:26:15.195 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.192+0000 7f8cf9600640 1 -- 172.21.15.136:0/1867564653 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf4063fb0 con 0x7f8cf40ad960 2024-08-17T02:26:15.195 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.194+0000 7f8cea000640 1 -- 172.21.15.136:0/1867564653 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f8ce4042070 con 0x7f8cf40ad960 2024-08-17T02:26:15.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.268+0000 7f8cf9600640 1 -- 172.21.15.136:0/1867564653 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b728e85a-56ef-42ea-bf01-6cb390a743f8", "id": 5} v 0) v1 -- 0x7f8cf40acfd0 con 0x7f8cf40ad960 2024-08-17T02:26:15.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.275+0000 7f8cea000640 1 -- 172.21.15.136:0/1867564653 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b728e85a-56ef-42ea-bf01-6cb390a743f8", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8ce4037070 con 0x7f8cf40ad960 2024-08-17T02:26:15.277 INFO:teuthology.orchestra.run.smithi136.stdout:5 2024-08-17T02:26:15.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.276+0000 7f8cf9600640 1 -- 172.21.15.136:0/1867564653 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cf40ad960 msgr2=0x7f8cf40a80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.276+0000 7f8cf9600640 1 --2- 172.21.15.136:0/1867564653 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cf40ad960 0x7f8cf40a80f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4031000 tx=0x7f8ce4032000 comp rx=0 tx=0).stop 2024-08-17T02:26:15.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.276+0000 7f8cf9600640 1 -- 172.21.15.136:0/1867564653 shutdown_connections 2024-08-17T02:26:15.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.276+0000 7f8cf9600640 1 --2- 172.21.15.136:0/1867564653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cf40ca050 0x7f8cf40a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.276+0000 7f8cf9600640 1 --2- 172.21.15.136:0/1867564653 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf40add30 0x7f8cf415f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.276+0000 7f8cf9600640 1 --2- 172.21.15.136:0/1867564653 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8cf40ad960 0x7f8cf40a80f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.276+0000 7f8cf9600640 1 -- 172.21.15.136:0/1867564653 >> 172.21.15.136:0/1867564653 conn(0x7f8cf4066e60 msgr2=0x7f8cf40abed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.276+0000 7f8cf9600640 1 -- 172.21.15.136:0/1867564653 shutdown_connections 2024-08-17T02:26:15.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.276+0000 7f8cf9600640 1 -- 172.21.15.136:0/1867564653 wait complete. 2024-08-17T02:26:15.291 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 86cecff6-1678-424d-b980-f4cf3ea1c0cb 6 2024-08-17T02:26:15.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.477+0000 7f6956200640 1 Processor -- start 2024-08-17T02:26:15.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.477+0000 7f6956200640 1 -- start start 2024-08-17T02:26:15.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.478+0000 7f6956200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6950158dd0 0x7f695006e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.478+0000 7f6956200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f695006ead0 0x7f69500b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.478+0000 7f6956200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695006ef10 con 0x7f6950158a00 2024-08-17T02:26:15.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.478+0000 7f6956200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6950159200 con 0x7f695006ead0 2024-08-17T02:26:15.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.478+0000 7f6956200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69500cbc50 con 0x7f6950158dd0 2024-08-17T02:26:15.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.478+0000 7f694fe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6950158dd0 0x7f695006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.478+0000 7f694fe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6950158dd0 0x7f695006e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:34776/0 (socket says 172.21.15.136:34776) 2024-08-17T02:26:15.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.478+0000 7f6955800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f695006ead0 0x7f69500b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.478+0000 7f694fe00640 1 -- 172.21.15.136:0/345807786 learned_addr learned my addr 172.21.15.136:0/345807786 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-08-17T02:26:15.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.479+0000 7f694fe00640 1 -- 172.21.15.136:0/345807786 >> v2:172.21.15.136:3300/0 conn(0x7f695006ead0 msgr2=0x7f69500b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:15.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.479+0000 7f694fe00640 1 --2- 172.21.15.136:0/345807786 >> v2:172.21.15.136:3300/0 conn(0x7f695006ead0 0x7f69500b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.479+0000 7f694fe00640 1 -- 172.21.15.136:0/345807786 >> v1:172.21.15.6:6789/0 conn(0x7f6950158a00 legacy=0x7f69500cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.479+0000 7f694fe00640 1 -- 172.21.15.136:0/345807786 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69500cbf30 con 0x7f6950158dd0 2024-08-17T02:26:15.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.480+0000 7f694fe00640 1 --2- 172.21.15.136:0/345807786 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6950158dd0 0x7f695006e590 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6950159340 tx=0x7f693c0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5835cc53871d2bb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.480+0000 7f694f400640 1 -- 172.21.15.136:0/345807786 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c02ae40 con 0x7f6950158dd0 2024-08-17T02:26:15.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.480+0000 7f694f400640 1 -- 172.21.15.136:0/345807786 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693c032440 con 0x7f6950158dd0 2024-08-17T02:26:15.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.480+0000 7f694f400640 1 -- 172.21.15.136:0/345807786 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c032820 con 0x7f6950158dd0 2024-08-17T02:26:15.482 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.480+0000 7f6956200640 1 -- 172.21.15.136:0/345807786 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6950158dd0 msgr2=0x7f695006e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.482 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.480+0000 7f6956200640 1 --2- 172.21.15.136:0/345807786 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6950158dd0 0x7f695006e590 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6950159340 tx=0x7f693c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.482 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.481+0000 7f6956200640 1 -- 172.21.15.136:0/345807786 shutdown_connections 2024-08-17T02:26:15.482 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.481+0000 7f6956200640 1 --2- 172.21.15.136:0/345807786 >> v2:172.21.15.136:3300/0 conn(0x7f695006ead0 0x7f69500b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.482 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.481+0000 7f6956200640 1 --2- 172.21.15.136:0/345807786 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6950158dd0 0x7f695006e590 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.482 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.481+0000 7f6956200640 1 -- 172.21.15.136:0/345807786 >> 172.21.15.136:0/345807786 conn(0x7f69500cfb80 msgr2=0x7f69500cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.482 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.481+0000 7f6956200640 1 -- 172.21.15.136:0/345807786 shutdown_connections 2024-08-17T02:26:15.482 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.481+0000 7f6956200640 1 -- 172.21.15.136:0/345807786 wait complete. 2024-08-17T02:26:15.483 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.482+0000 7f6956200640 1 Processor -- start 2024-08-17T02:26:15.483 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.482+0000 7f6956200640 1 -- start start 2024-08-17T02:26:15.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.483+0000 7f6956200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f695006ead0 0x7f6950157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.483+0000 7f6956200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6950158a00 0x7f69500c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.483+0000 7f6956200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6950158dd0 0x7f69500a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.483+0000 7f6956200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69501695a0 con 0x7f6950158a00 2024-08-17T02:26:15.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.483+0000 7f6956200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6950168f70 con 0x7f6950158dd0 2024-08-17T02:26:15.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.483+0000 7f6956200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69500c91e0 con 0x7f695006ead0 2024-08-17T02:26:15.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.483+0000 7f6954e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f695006ead0 0x7f6950157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.483+0000 7f6955800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6950158dd0 0x7f69500a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.483+0000 7f6954e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f695006ead0 0x7f6950157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:34780/0 (socket says 172.21.15.136:34780) 2024-08-17T02:26:15.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.483+0000 7f6954e00640 1 -- 172.21.15.136:0/2151838485 learned_addr learned my addr 172.21.15.136:0/2151838485 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-08-17T02:26:15.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.483+0000 7f694fe00640 1 --2- 172.21.15.136:0/2151838485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6950158a00 0x7f69500c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.484+0000 7f6954e00640 1 -- 172.21.15.136:0/2151838485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6950158dd0 msgr2=0x7f69500a64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.484+0000 7f6954e00640 1 --2- 172.21.15.136:0/2151838485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6950158dd0 0x7f69500a64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.484+0000 7f6954e00640 1 -- 172.21.15.136:0/2151838485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6950158a00 msgr2=0x7f69500c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.484+0000 7f6954e00640 1 --2- 172.21.15.136:0/2151838485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6950158a00 0x7f69500c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.484+0000 7f6954e00640 1 -- 172.21.15.136:0/2151838485 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c009450 con 0x7f695006ead0 2024-08-17T02:26:15.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.484+0000 7f694fe00640 1 --2- 172.21.15.136:0/2151838485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6950158a00 0x7f69500c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:15.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.484+0000 7f6954e00640 1 --2- 172.21.15.136:0/2151838485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f695006ead0 0x7f6950157310 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f694400c560 tx=0x7f6944007ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.484+0000 7f6943e00640 1 -- 172.21.15.136:0/2151838485 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944001120 con 0x7f695006ead0 2024-08-17T02:26:15.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.484+0000 7f6943e00640 1 -- 172.21.15.136:0/2151838485 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6944011590 con 0x7f695006ead0 2024-08-17T02:26:15.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.484+0000 7f6943e00640 1 -- 172.21.15.136:0/2151838485 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944011950 con 0x7f695006ead0 2024-08-17T02:26:15.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.484+0000 7f6956200640 1 -- 172.21.15.136:0/2151838485 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69500c94c0 con 0x7f695006ead0 2024-08-17T02:26:15.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.485+0000 7f6956200640 1 -- 172.21.15.136:0/2151838485 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6950157850 con 0x7f695006ead0 2024-08-17T02:26:15.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.485+0000 7f6943e00640 1 -- 172.21.15.136:0/2151838485 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f694401c440 con 0x7f695006ead0 2024-08-17T02:26:15.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.485+0000 7f6943e00640 1 -- 172.21.15.136:0/2151838485 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f6944011d80 con 0x7f695006ead0 2024-08-17T02:26:15.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.486+0000 7f6956200640 1 -- 172.21.15.136:0/2151838485 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6950070720 con 0x7f695006ead0 2024-08-17T02:26:15.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.488+0000 7f6943e00640 1 -- 172.21.15.136:0/2151838485 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f6944017070 con 0x7f695006ead0 2024-08-17T02:26:15.529 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:15.529+0000 7fac36768ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:26:15.559 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:15.558+0000 7f7d03440ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:26:15.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.562+0000 7f6956200640 1 -- 172.21.15.136:0/2151838485 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "86cecff6-1678-424d-b980-f4cf3ea1c0cb", "id": 6} v 0) v1 -- 0x7f69500cd030 con 0x7f695006ead0 2024-08-17T02:26:15.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.570+0000 7f6943e00640 1 -- 172.21.15.136:0/2151838485 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86cecff6-1678-424d-b980-f4cf3ea1c0cb", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f694401c710 con 0x7f695006ead0 2024-08-17T02:26:15.571 INFO:teuthology.orchestra.run.smithi136.stdout:6 2024-08-17T02:26:15.572 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.571+0000 7f6956200640 1 -- 172.21.15.136:0/2151838485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f695006ead0 msgr2=0x7f6950157310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.572 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.571+0000 7f6956200640 1 --2- 172.21.15.136:0/2151838485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f695006ead0 0x7f6950157310 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f694400c560 tx=0x7f6944007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.572 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.571+0000 7f6956200640 1 -- 172.21.15.136:0/2151838485 shutdown_connections 2024-08-17T02:26:15.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.571+0000 7f6956200640 1 --2- 172.21.15.136:0/2151838485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6950158dd0 0x7f69500a64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.571+0000 7f6956200640 1 --2- 172.21.15.136:0/2151838485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6950158a00 0x7f69500c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.571+0000 7f6956200640 1 --2- 172.21.15.136:0/2151838485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f695006ead0 0x7f6950157310 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.571+0000 7f6956200640 1 -- 172.21.15.136:0/2151838485 >> 172.21.15.136:0/2151838485 conn(0x7f69500cfb80 msgr2=0x7f695015bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.571+0000 7f6956200640 1 -- 172.21.15.136:0/2151838485 shutdown_connections 2024-08-17T02:26:15.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.571+0000 7f6956200640 1 -- 172.21.15.136:0/2151838485 wait complete. 2024-08-17T02:26:15.586 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 9104ae61-807f-4fee-99ce-f40615e22d9c 7 2024-08-17T02:26:15.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.730+0000 7fc6cee00640 1 Processor -- start 2024-08-17T02:26:15.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.730+0000 7fc6cee00640 1 -- start start 2024-08-17T02:26:15.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.731+0000 7fc6cee00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6c80b1000 0x7fc6c80cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.732+0000 7fc6cee00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c80af600 con 0x7fc6c80caf10 2024-08-17T02:26:15.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.732+0000 7fc6cee00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c80afb60 con 0x7fc6c81588d0 2024-08-17T02:26:15.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.732+0000 7fc6cee00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c80d04e0 con 0x7fc6c80b1000 2024-08-17T02:26:15.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.732+0000 7fc6cda00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fc6c81588d0 0x7fc6c80ca800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:54668/0 (socket says 172.21.15.136:54668) 2024-08-17T02:26:15.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.732+0000 7fc6cda00640 1 -- 172.21.15.136:0/926877473 learned_addr learned my addr 172.21.15.136:0/926877473 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-08-17T02:26:15.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.732+0000 7fc6ce400640 1 --2- 172.21.15.136:0/926877473 >> v2:172.21.15.6:3300/0 conn(0x7fc6c80b1000 0x7fc6c80cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.732+0000 7fc6c7e00640 1 -- 172.21.15.136:0/926877473 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592379351 0 0) 0x7fc6c80afb60 con 0x7fc6c81588d0 2024-08-17T02:26:15.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.732+0000 7fc6c7e00640 1 -- 172.21.15.136:0/926877473 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6b00034e0 con 0x7fc6c81588d0 2024-08-17T02:26:15.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.732+0000 7fc6ce400640 1 -- 172.21.15.136:0/926877473 >> v1:172.21.15.136:6789/0 conn(0x7fc6c81588d0 legacy=0x7fc6c80ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.732+0000 7fc6ce400640 1 -- 172.21.15.136:0/926877473 >> v1:172.21.15.6:6789/0 conn(0x7fc6c80caf10 legacy=0x7fc6c80cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.732+0000 7fc6c7e00640 1 -- 172.21.15.136:0/926877473 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886193136 0 0) 0x7fc6c80af600 con 0x7fc6c80caf10 2024-08-17T02:26:15.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.732+0000 7fc6ce400640 1 -- 172.21.15.136:0/926877473 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c80af830 con 0x7fc6c80b1000 2024-08-17T02:26:15.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.733+0000 7fc6ce400640 1 --2- 172.21.15.136:0/926877473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c80b1000 0x7fc6c80cf900 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0009e60 tx=0x7fc6c0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21e64c40a5c308d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.734+0000 7fc6c7e00640 1 -- 172.21.15.136:0/926877473 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0007550 con 0x7fc6c80b1000 2024-08-17T02:26:15.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.734+0000 7fc6c7e00640 1 -- 172.21.15.136:0/926877473 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c002d050 con 0x7fc6c80b1000 2024-08-17T02:26:15.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.734+0000 7fc6c7e00640 1 -- 172.21.15.136:0/926877473 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c00078e0 con 0x7fc6c80b1000 2024-08-17T02:26:15.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.734+0000 7fc6cee00640 1 -- 172.21.15.136:0/926877473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c80b1000 msgr2=0x7fc6c80cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.734+0000 7fc6cee00640 1 --2- 172.21.15.136:0/926877473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c80b1000 0x7fc6c80cf900 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0009e60 tx=0x7fc6c0009780 comp rx=0 tx=0).stop 2024-08-17T02:26:15.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.735+0000 7fc6cee00640 1 -- 172.21.15.136:0/926877473 shutdown_connections 2024-08-17T02:26:15.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.735+0000 7fc6cee00640 1 --2- 172.21.15.136:0/926877473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c80b1000 0x7fc6c80cf900 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.735+0000 7fc6cee00640 1 -- 172.21.15.136:0/926877473 >> 172.21.15.136:0/926877473 conn(0x7fc6c8087a80 msgr2=0x7fc6c806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.735+0000 7fc6cee00640 1 -- 172.21.15.136:0/926877473 shutdown_connections 2024-08-17T02:26:15.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.735+0000 7fc6cee00640 1 -- 172.21.15.136:0/926877473 wait complete. 2024-08-17T02:26:15.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.736+0000 7fc6cee00640 1 Processor -- start 2024-08-17T02:26:15.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.736+0000 7fc6cee00640 1 -- start start 2024-08-17T02:26:15.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.737+0000 7fc6cee00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6c80b1000 0x7fc6c8155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.737+0000 7fc6cee00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c80caf10 0x7fc6c80cf020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.737+0000 7fc6cee00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6c81588d0 0x7fc6c8156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.737+0000 7fc6cee00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c80c8eb0 con 0x7fc6c80caf10 2024-08-17T02:26:15.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.737+0000 7fc6cee00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c80c9a50 con 0x7fc6c81588d0 2024-08-17T02:26:15.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.737+0000 7fc6cee00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c80c9120 con 0x7fc6c80b1000 2024-08-17T02:26:15.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.737+0000 7fc6cda00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6c80b1000 0x7fc6c8155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.737+0000 7fc6ce400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6c81588d0 0x7fc6c8156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.737+0000 7fc6cda00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6c80b1000 0x7fc6c8155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:34792/0 (socket says 172.21.15.136:34792) 2024-08-17T02:26:15.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.737+0000 7fc6cda00640 1 -- 172.21.15.136:0/239403103 learned_addr learned my addr 172.21.15.136:0/239403103 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-08-17T02:26:15.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.737+0000 7fc6cd000640 1 --2- 172.21.15.136:0/239403103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c80caf10 0x7fc6c80cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.738+0000 7fc6cda00640 1 -- 172.21.15.136:0/239403103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6c81588d0 msgr2=0x7fc6c8156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.738+0000 7fc6cda00640 1 --2- 172.21.15.136:0/239403103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6c81588d0 0x7fc6c8156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.738+0000 7fc6cda00640 1 -- 172.21.15.136:0/239403103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c80caf10 msgr2=0x7fc6c80cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.738+0000 7fc6cda00640 1 --2- 172.21.15.136:0/239403103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c80caf10 0x7fc6c80cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.738+0000 7fc6cda00640 1 -- 172.21.15.136:0/239403103 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c0009a20 con 0x7fc6c80b1000 2024-08-17T02:26:15.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.738+0000 7fc6cd000640 1 --2- 172.21.15.136:0/239403103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c80caf10 0x7fc6c80cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:15.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.738+0000 7fc6cda00640 1 --2- 172.21.15.136:0/239403103 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6c80b1000 0x7fc6c8155f00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00c4b0 tx=0x7fc6bc007d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.738+0000 7fc6c4c00640 1 -- 172.21.15.136:0/239403103 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc005aa0 con 0x7fc6c80b1000 2024-08-17T02:26:15.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.738+0000 7fc6c4c00640 1 -- 172.21.15.136:0/239403103 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc005c00 con 0x7fc6c80b1000 2024-08-17T02:26:15.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.738+0000 7fc6c4c00640 1 -- 172.21.15.136:0/239403103 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0070d0 con 0x7fc6c80b1000 2024-08-17T02:26:15.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.738+0000 7fc6cee00640 1 -- 172.21.15.136:0/239403103 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c80c9400 con 0x7fc6c80b1000 2024-08-17T02:26:15.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.738+0000 7fc6cee00640 1 -- 172.21.15.136:0/239403103 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c80cf560 con 0x7fc6c80b1000 2024-08-17T02:26:15.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.739+0000 7fc6c4c00640 1 -- 172.21.15.136:0/239403103 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fc6bc0074c0 con 0x7fc6c80b1000 2024-08-17T02:26:15.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.739+0000 7fc6c4c00640 1 -- 172.21.15.136:0/239403103 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fc6bc01c440 con 0x7fc6c80b1000 2024-08-17T02:26:15.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.739+0000 7fc6cee00640 1 -- 172.21.15.136:0/239403103 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c80c9880 con 0x7fc6c80b1000 2024-08-17T02:26:15.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.742+0000 7fc6c4c00640 1 -- 172.21.15.136:0/239403103 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fc6bc017070 con 0x7fc6c80b1000 2024-08-17T02:26:15.810 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:15.810+0000 7fac36768ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:26:15.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.815+0000 7fc6cee00640 1 -- 172.21.15.136:0/239403103 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9104ae61-807f-4fee-99ce-f40615e22d9c", "id": 7} v 0) v1 -- 0x7fc6c8070720 con 0x7fc6c80b1000 2024-08-17T02:26:15.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.821+0000 7fc6c4c00640 1 -- 172.21.15.136:0/239403103 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9104ae61-807f-4fee-99ce-f40615e22d9c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc6bc01c9e0 con 0x7fc6c80b1000 2024-08-17T02:26:15.823 INFO:teuthology.orchestra.run.smithi136.stdout:7 2024-08-17T02:26:15.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.822+0000 7fc6cee00640 1 -- 172.21.15.136:0/239403103 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6c80b1000 msgr2=0x7fc6c8155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.822+0000 7fc6cee00640 1 --2- 172.21.15.136:0/239403103 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6c80b1000 0x7fc6c8155f00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00c4b0 tx=0x7fc6bc007d60 comp rx=0 tx=0).stop 2024-08-17T02:26:15.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.823+0000 7fc6cee00640 1 -- 172.21.15.136:0/239403103 shutdown_connections 2024-08-17T02:26:15.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.823+0000 7fc6cee00640 1 --2- 172.21.15.136:0/239403103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6c81588d0 0x7fc6c8156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.823+0000 7fc6cee00640 1 --2- 172.21.15.136:0/239403103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c80caf10 0x7fc6c80cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.823+0000 7fc6cee00640 1 --2- 172.21.15.136:0/239403103 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6c80b1000 0x7fc6c8155f00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.823+0000 7fc6cee00640 1 -- 172.21.15.136:0/239403103 >> 172.21.15.136:0/239403103 conn(0x7fc6c8087a80 msgr2=0x7fc6c80ccee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.823+0000 7fc6cee00640 1 -- 172.21.15.136:0/239403103 shutdown_connections 2024-08-17T02:26:15.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-08-17T02:26:15.823+0000 7fc6cee00640 1 -- 172.21.15.136:0/239403103 wait complete. 2024-08-17T02:26:15.838 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:26:15.838 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:26:15.842 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:26:15.842 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:26:15.843 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:26:15.843 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:15.842+0000 7f7d03440ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:26:15.846 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:26:15.847 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:26:15.847 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:26:15.851 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:26:15.851 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:26:15.851 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:26:15.855 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:26:15.855 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:26:15.856 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:26:15.859 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:26:15.860 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:26:15.860 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:26:15.864 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:26:15.864 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:26:15.864 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:26:15.868 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:26:15.868 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:26:15.868 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:26:15.873 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:26:15.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:15.881 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:15.881+0000 7fac36768ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:26:15.920 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:15.919+0000 7f7d03440ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:26:16.048 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:16.048+0000 7fac36768ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:26:16.062 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:16.061+0000 7f7d03440ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:26:16.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.083+0000 7f1808000640 1 Processor -- start 2024-08-17T02:26:16.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.083+0000 7f1808000640 1 -- start start 2024-08-17T02:26:16.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.085+0000 7f1808000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f18000ad960 0x7f180015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.085+0000 7f1808000640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180015b5e0 con 0x7f18000ca050 2024-08-17T02:26:16.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.085+0000 7f1808000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18000cb160 con 0x7f18000add30 2024-08-17T02:26:16.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.085+0000 7f1808000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18000b0d10 con 0x7f18000ad960 2024-08-17T02:26:16.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.085+0000 7f1805600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f18000ad960 0x7f180015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.085+0000 7f1804c00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f18000ca050 0x7f1800156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36284/0 (socket says 172.21.15.6:36284) 2024-08-17T02:26:16.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.085+0000 7f1804c00640 1 -- 172.21.15.6:0/357433476 learned_addr learned my addr 172.21.15.6:0/357433476 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:16.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.085+0000 7f1805600640 1 -- 172.21.15.6:0/357433476 >> v1:172.21.15.136:6789/0 conn(0x7f18000add30 legacy=0x7f18000aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.085+0000 7f1805600640 1 -- 172.21.15.6:0/357433476 >> v1:172.21.15.6:6789/0 conn(0x7f18000ca050 legacy=0x7f1800156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.085+0000 7f1805600640 1 -- 172.21.15.6:0/357433476 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000ca550 con 0x7f18000ad960 2024-08-17T02:26:16.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.086+0000 7f1805600640 1 --2- 172.21.15.6:0/357433476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18000ad960 0x7f180015b0a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009850 tx=0x7f17f40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7f9043b9b297c31 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.087+0000 7f17ffe00640 1 -- 172.21.15.6:0/357433476 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4032440 con 0x7f18000ad960 2024-08-17T02:26:16.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.087+0000 7f17ffe00640 1 -- 172.21.15.6:0/357433476 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f40325a0 con 0x7f18000ad960 2024-08-17T02:26:16.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.087+0000 7f17ffe00640 1 -- 172.21.15.6:0/357433476 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4032980 con 0x7f18000ad960 2024-08-17T02:26:16.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.087+0000 7f1808000640 1 -- 172.21.15.6:0/357433476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18000ad960 msgr2=0x7f180015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.087+0000 7f1808000640 1 --2- 172.21.15.6:0/357433476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18000ad960 0x7f180015b0a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009850 tx=0x7f17f40090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.088+0000 7f1808000640 1 -- 172.21.15.6:0/357433476 shutdown_connections 2024-08-17T02:26:16.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.088+0000 7f1808000640 1 --2- 172.21.15.6:0/357433476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18000ad960 0x7f180015b0a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.088+0000 7f1808000640 1 -- 172.21.15.6:0/357433476 >> 172.21.15.6:0/357433476 conn(0x7f1800066e60 msgr2=0x7f1800067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.088+0000 7f1808000640 1 -- 172.21.15.6:0/357433476 shutdown_connections 2024-08-17T02:26:16.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.088+0000 7f1808000640 1 -- 172.21.15.6:0/357433476 wait complete. 2024-08-17T02:26:16.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.089+0000 7f1808000640 1 Processor -- start 2024-08-17T02:26:16.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.089+0000 7f1808000640 1 -- start start 2024-08-17T02:26:16.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.090+0000 7f1808000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18000ad960 0x7f1800154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.090+0000 7f1808000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18000add30 0x7f1800150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.090+0000 7f1808000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18000ca050 0x7f1800150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.090+0000 7f1808000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18000a9270 con 0x7f18000add30 2024-08-17T02:26:16.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.090+0000 7f1808000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18000a8980 con 0x7f18000ca050 2024-08-17T02:26:16.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.090+0000 7f1808000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18000a8c20 con 0x7f18000ad960 2024-08-17T02:26:16.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.090+0000 7f1804c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18000add30 0x7f1800150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.091+0000 7f1805600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18000ad960 0x7f1800154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.091+0000 7f1804c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18000add30 0x7f1800150340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33324/0 (socket says 172.21.15.6:33324) 2024-08-17T02:26:16.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.091+0000 7f1805600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18000ad960 0x7f1800154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:40868/0 (socket says 172.21.15.6:40868) 2024-08-17T02:26:16.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.091+0000 7f1804c00640 1 -- 172.21.15.6:0/564012412 learned_addr learned my addr 172.21.15.6:0/564012412 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:16.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.091+0000 7f1806000640 1 --2- 172.21.15.6:0/564012412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18000ca050 0x7f1800150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.091+0000 7f1804c00640 1 -- 172.21.15.6:0/564012412 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18000ad960 msgr2=0x7f1800154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.091+0000 7f1804c00640 1 --2- 172.21.15.6:0/564012412 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18000ad960 0x7f1800154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.091+0000 7f1804c00640 1 -- 172.21.15.6:0/564012412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18000ca050 msgr2=0x7f1800150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.091+0000 7f1804c00640 1 --2- 172.21.15.6:0/564012412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18000ca050 0x7f1800150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.091+0000 7f1804c00640 1 -- 172.21.15.6:0/564012412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f4009390 con 0x7f18000add30 2024-08-17T02:26:16.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.091+0000 7f1805600640 1 --2- 172.21.15.6:0/564012412 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18000ad960 0x7f1800154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:16.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.091+0000 7f1804c00640 1 --2- 172.21.15.6:0/564012412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18000add30 0x7f1800150340 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00c560 tx=0x7f17ec007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.092+0000 7f17fcc00640 1 -- 172.21.15.6:0/564012412 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec005aa0 con 0x7f18000add30 2024-08-17T02:26:16.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.092+0000 7f17fcc00640 1 -- 172.21.15.6:0/564012412 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ec005c20 con 0x7f18000add30 2024-08-17T02:26:16.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.092+0000 7f17fcc00640 1 -- 172.21.15.6:0/564012412 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec007320 con 0x7f18000add30 2024-08-17T02:26:16.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.092+0000 7f1808000640 1 -- 172.21.15.6:0/564012412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18000a8f00 con 0x7f18000add30 2024-08-17T02:26:16.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.092+0000 7f1808000640 1 -- 172.21.15.6:0/564012412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18001553c0 con 0x7f18000add30 2024-08-17T02:26:16.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.092+0000 7f17fcc00640 1 -- 172.21.15.6:0/564012412 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f17ec01c440 con 0x7f18000add30 2024-08-17T02:26:16.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.092+0000 7f17fcc00640 1 -- 172.21.15.6:0/564012412 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f17ec005e10 con 0x7f18000add30 2024-08-17T02:26:16.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.093+0000 7f1808000640 1 -- 172.21.15.6:0/564012412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18000a93e0 con 0x7f18000add30 2024-08-17T02:26:16.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.095+0000 7f17fcc00640 1 -- 172.21.15.6:0/564012412 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f17ec021060 con 0x7f18000add30 2024-08-17T02:26:16.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.159+0000 7f1808000640 1 -- 172.21.15.6:0/564012412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1800063fb0 con 0x7f18000add30 2024-08-17T02:26:16.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.159+0000 7f17fcc00640 1 -- 172.21.15.6:0/564012412 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f17ec017070 con 0x7f18000add30 2024-08-17T02:26:16.160 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:16.160 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:15.818235+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:16.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.160+0000 7f1808000640 1 -- 172.21.15.6:0/564012412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18000add30 msgr2=0x7f1800150340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.160+0000 7f1808000640 1 --2- 172.21.15.6:0/564012412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18000add30 0x7f1800150340 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00c560 tx=0x7f17ec007f40 comp rx=0 tx=0).stop 2024-08-17T02:26:16.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.160+0000 7f1808000640 1 -- 172.21.15.6:0/564012412 shutdown_connections 2024-08-17T02:26:16.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.160+0000 7f1808000640 1 --2- 172.21.15.6:0/564012412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18000ca050 0x7f1800150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.160+0000 7f1808000640 1 --2- 172.21.15.6:0/564012412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18000add30 0x7f1800150340 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.161+0000 7f1808000640 1 --2- 172.21.15.6:0/564012412 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18000ad960 0x7f1800154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.161+0000 7f1808000640 1 -- 172.21.15.6:0/564012412 >> 172.21.15.6:0/564012412 conn(0x7f1800066e60 msgr2=0x7f1800151560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.161+0000 7f1808000640 1 -- 172.21.15.6:0/564012412 shutdown_connections 2024-08-17T02:26:16.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:16.161+0000 7f1808000640 1 -- 172.21.15.6:0/564012412 wait complete. 2024-08-17T02:26:16.175 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:26:16.176 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:26:16.344 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:16.343+0000 7f7d03440ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:26:16.353 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:16.351+0000 7fac36768ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:26:16.396 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:16.395+0000 7f7d03440ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:26:16.407 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:16.406+0000 7fac36768ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:26:16.521 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-08-17T02:26:16.520+0000 7ff0add7a2c0 -1 Falling back to public interface 2024-08-17T02:26:16.522 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-08-17T02:26:16.521+0000 7f9a009232c0 -1 Falling back to public interface 2024-08-17T02:26:16.527 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-08-17T02:26:16.527+0000 7f272732d2c0 -1 Falling back to public interface 2024-08-17T02:26:16.539 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-08-17T02:26:16.539+0000 7efdec72d2c0 -1 Falling back to public interface 2024-08-17T02:26:16.545 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-08-17T02:26:16.544+0000 7fafe791d2c0 -1 Falling back to public interface 2024-08-17T02:26:16.551 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-08-17T02:26:16.551+0000 7f5bce28d2c0 -1 Falling back to public interface 2024-08-17T02:26:16.558 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-08-17T02:26:16.557+0000 7f800e0872c0 -1 Falling back to public interface 2024-08-17T02:26:16.558 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-08-17T02:26:16.557+0000 7fd5ecc132c0 -1 Falling back to public interface 2024-08-17T02:26:16.574 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:16.573+0000 7f7d03440ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:26:16.598 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:16.598+0000 7fac36768ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:26:16.631 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:16.630+0000 7f7d03440ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:26:16.658 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:16.657+0000 7fac36768ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:26:16.708 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:16.707+0000 7f7d03440ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:26:16.740 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:16.740+0000 7fac36768ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:26:16.757 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:16.756+0000 7f7d03440ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:26:16.793 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:16.793+0000 7fac36768ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:26:16.982 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:17.114 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.113+0000 7f2736000640 1 Processor -- start 2024-08-17T02:26:17.114 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.114+0000 7f2736000640 1 -- start start 2024-08-17T02:26:17.116 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.115+0000 7f2736000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27300b0830 0x7f27301637b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.116 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.115+0000 7f2736000640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27300cf250 con 0x7f27300ce120 2024-08-17T02:26:17.116 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.115+0000 7f2736000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27300cb3e0 con 0x7f27300cc3a0 2024-08-17T02:26:17.116 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.115+0000 7f2736000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27300ce640 con 0x7f27300b0830 2024-08-17T02:26:17.116 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.115+0000 7f272fe00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f27300ce120 0x7f27300cacd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36292/0 (socket says 172.21.15.6:36292) 2024-08-17T02:26:17.116 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.115+0000 7f272fe00640 1 -- 172.21.15.6:0/1328413573 learned_addr learned my addr 172.21.15.6:0/1328413573 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:17.116 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.115+0000 7f2735600640 1 --2- 172.21.15.6:0/1328413573 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27300b0830 0x7f27301637b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.117 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.115+0000 7f272f400640 1 -- 172.21.15.6:0/1328413573 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965542446 0 0) 0x7f27300cf250 con 0x7f27300ce120 2024-08-17T02:26:17.117 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.115+0000 7f272f400640 1 -- 172.21.15.6:0/1328413573 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27180034e0 con 0x7f27300ce120 2024-08-17T02:26:17.117 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.116+0000 7f272f400640 1 -- 172.21.15.6:0/1328413573 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961686791 0 0) 0x7f27300cb3e0 con 0x7f27300cc3a0 2024-08-17T02:26:17.117 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.116+0000 7f272f400640 1 -- 172.21.15.6:0/1328413573 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27300cf250 con 0x7f27300cc3a0 2024-08-17T02:26:17.117 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.116+0000 7f2735600640 1 -- 172.21.15.6:0/1328413573 >> v1:172.21.15.136:6789/0 conn(0x7f27300cc3a0 legacy=0x7f27300cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.117 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.116+0000 7f2735600640 1 -- 172.21.15.6:0/1328413573 >> v1:172.21.15.6:6789/0 conn(0x7f27300ce120 legacy=0x7f27300cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.117 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.116+0000 7f2735600640 1 -- 172.21.15.6:0/1328413573 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27300ce920 con 0x7f27300b0830 2024-08-17T02:26:17.118 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.117+0000 7f2735600640 1 --2- 172.21.15.6:0/1328413573 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27300b0830 0x7f27301637b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2728009e90 tx=0x7f2728009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9db5a9120c09c42a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.118 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.117+0000 7f272f400640 1 -- 172.21.15.6:0/1328413573 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272802aea0 con 0x7f27300b0830 2024-08-17T02:26:17.118 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.117+0000 7f272f400640 1 -- 172.21.15.6:0/1328413573 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272802d050 con 0x7f27300b0830 2024-08-17T02:26:17.118 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.117+0000 7f272f400640 1 -- 172.21.15.6:0/1328413573 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728007780 con 0x7f27300b0830 2024-08-17T02:26:17.119 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.118+0000 7f2736000640 1 -- 172.21.15.6:0/1328413573 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27300b0830 msgr2=0x7f27301637b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.119 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.118+0000 7f2736000640 1 --2- 172.21.15.6:0/1328413573 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27300b0830 0x7f27301637b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2728009e90 tx=0x7f2728009780 comp rx=0 tx=0).stop 2024-08-17T02:26:17.119 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.118+0000 7f2736000640 1 -- 172.21.15.6:0/1328413573 shutdown_connections 2024-08-17T02:26:17.119 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.118+0000 7f2736000640 1 --2- 172.21.15.6:0/1328413573 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27300b0830 0x7f27301637b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.119 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.118+0000 7f2736000640 1 -- 172.21.15.6:0/1328413573 >> 172.21.15.6:0/1328413573 conn(0x7f273006efb0 msgr2=0x7f2730068460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.119 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.118+0000 7f2736000640 1 -- 172.21.15.6:0/1328413573 shutdown_connections 2024-08-17T02:26:17.119 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.118+0000 7f2736000640 1 -- 172.21.15.6:0/1328413573 wait complete. 2024-08-17T02:26:17.120 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.119+0000 7f2736000640 1 Processor -- start 2024-08-17T02:26:17.120 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.120+0000 7f2736000640 1 -- start start 2024-08-17T02:26:17.122 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.120+0000 7f2736000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27300b0830 0x7f273014ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.122 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.120+0000 7f2736000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27300cc3a0 0x7f273014a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.122 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.121+0000 7f2736000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27300ce120 0x7f2730169930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.122 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.121+0000 7f2736000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273016c680 con 0x7f27300cc3a0 2024-08-17T02:26:17.122 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.121+0000 7f2736000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273016c960 con 0x7f27300b0830 2024-08-17T02:26:17.122 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.121+0000 7f2736000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273016cc40 con 0x7f27300ce120 2024-08-17T02:26:17.122 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.121+0000 7f272fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27300cc3a0 0x7f273014a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.122 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.121+0000 7f272fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27300cc3a0 0x7f273014a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33338/0 (socket says 172.21.15.6:33338) 2024-08-17T02:26:17.123 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.121+0000 7f272fe00640 1 -- 172.21.15.6:0/2269661912 learned_addr learned my addr 172.21.15.6:0/2269661912 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:17.123 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.121+0000 7f2735600640 1 --2- 172.21.15.6:0/2269661912 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27300ce120 0x7f2730169930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.123 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.121+0000 7f2734c00640 1 --2- 172.21.15.6:0/2269661912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27300b0830 0x7f273014ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.123 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.121+0000 7f272fe00640 1 -- 172.21.15.6:0/2269661912 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27300ce120 msgr2=0x7f2730169930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.123 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.121+0000 7f272fe00640 1 --2- 172.21.15.6:0/2269661912 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27300ce120 0x7f2730169930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.123 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.121+0000 7f272fe00640 1 -- 172.21.15.6:0/2269661912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27300b0830 msgr2=0x7f273014ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.123 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.121+0000 7f272fe00640 1 --2- 172.21.15.6:0/2269661912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27300b0830 0x7f273014ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.123 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.121+0000 7f272fe00640 1 -- 172.21.15.6:0/2269661912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2728009a20 con 0x7f27300cc3a0 2024-08-17T02:26:17.123 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.122+0000 7f272fe00640 1 --2- 172.21.15.6:0/2269661912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27300cc3a0 0x7f273014a650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f271c005840 tx=0x7f271c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.124 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.122+0000 7f2723e00640 1 -- 172.21.15.6:0/2269661912 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c005aa0 con 0x7f27300cc3a0 2024-08-17T02:26:17.124 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.122+0000 7f2723e00640 1 -- 172.21.15.6:0/2269661912 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c005c00 con 0x7f27300cc3a0 2024-08-17T02:26:17.124 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.122+0000 7f2723e00640 1 -- 172.21.15.6:0/2269661912 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c0070d0 con 0x7f27300cc3a0 2024-08-17T02:26:17.124 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.122+0000 7f2736000640 1 -- 172.21.15.6:0/2269661912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273016cf20 con 0x7f27300cc3a0 2024-08-17T02:26:17.124 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.122+0000 7f2736000640 1 -- 172.21.15.6:0/2269661912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2730159300 con 0x7f27300cc3a0 2024-08-17T02:26:17.124 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.122+0000 7f2723e00640 1 -- 172.21.15.6:0/2269661912 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f271c007500 con 0x7f27300cc3a0 2024-08-17T02:26:17.124 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.122+0000 7f2723e00640 1 -- 172.21.15.6:0/2269661912 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f271c01c440 con 0x7f27300cc3a0 2024-08-17T02:26:17.125 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.124+0000 7f2736000640 1 -- 172.21.15.6:0/2269661912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273016d3a0 con 0x7f27300cc3a0 2024-08-17T02:26:17.126 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.126+0000 7f2723e00640 1 -- 172.21.15.6:0/2269661912 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f271c021060 con 0x7f27300cc3a0 2024-08-17T02:26:17.190 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.190+0000 7f2736000640 1 -- 172.21.15.6:0/2269661912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2730071010 con 0x7f27300cc3a0 2024-08-17T02:26:17.191 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.190+0000 7f2723e00640 1 -- 172.21.15.6:0/2269661912 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f271c017070 con 0x7f27300cc3a0 2024-08-17T02:26:17.191 INFO:teuthology.misc.health.smithi006.stdout: 2024-08-17T02:26:17.191 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":10,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:15.818235+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:17.192 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.191+0000 7f2736000640 1 -- 172.21.15.6:0/2269661912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27300cc3a0 msgr2=0x7f273014a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.193 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.191+0000 7f2736000640 1 --2- 172.21.15.6:0/2269661912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27300cc3a0 0x7f273014a650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f271c005840 tx=0x7f271c007df0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.193 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.191+0000 7f2736000640 1 -- 172.21.15.6:0/2269661912 shutdown_connections 2024-08-17T02:26:17.193 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.191+0000 7f2736000640 1 --2- 172.21.15.6:0/2269661912 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27300ce120 0x7f2730169930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.193 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.191+0000 7f2736000640 1 --2- 172.21.15.6:0/2269661912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27300cc3a0 0x7f273014a650 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.193 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.191+0000 7f2736000640 1 --2- 172.21.15.6:0/2269661912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27300b0830 0x7f273014ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.193 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.191+0000 7f2736000640 1 -- 172.21.15.6:0/2269661912 >> 172.21.15.6:0/2269661912 conn(0x7f273006efb0 msgr2=0x7f27300c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.194 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.192+0000 7f2736000640 1 -- 172.21.15.6:0/2269661912 shutdown_connections 2024-08-17T02:26:17.194 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:17.192+0000 7f2736000640 1 -- 172.21.15.6:0/2269661912 wait complete. 2024-08-17T02:26:17.203 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:26:17.281 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:17.279+0000 7f7d03440ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:26:17.350 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:17.349+0000 7fac36768ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:26:17.390 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:17.388+0000 7f7d03440ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:26:17.467 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-08-17T02:26:17.467+0000 7fac36768ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:26:18.412 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:18.411+0000 7f7ce7c00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:26:18.413 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-08-17T02:26:18.412+0000 7f7ce7c00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:26:20.030 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-08-17T02:26:20.029+0000 7f272732d2c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:26:20.057 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-08-17T02:26:20.057+0000 7ff0add7a2c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:26:20.087 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-08-17T02:26:20.087+0000 7f9a009232c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:26:20.114 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-08-17T02:26:20.113+0000 7efdec72d2c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:26:20.125 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-08-17T02:26:20.125+0000 7f800e0872c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:26:20.142 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-08-17T02:26:20.142+0000 7fd5ecc132c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:26:20.210 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-08-17T02:26:20.209+0000 7f5bce28d2c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:26:20.211 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-08-17T02:26:20.210+0000 7fafe791d2c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:26:23.131 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-08-17T02:26:23.131+0000 7f99fa000640 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:26:23.141 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-08-17T02:26:23.141+0000 7f99f1400640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:26:23.163 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-08-17T02:26:23.163+0000 7ff0a7400640 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:26:23.168 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-08-17T02:26:23.168+0000 7ff09e800640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:26:23.185 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-08-17T02:26:23.185+0000 7f8007e00640 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:26:23.190 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-08-17T02:26:23.190+0000 7fd5e6000640 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:26:23.192 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-08-17T02:26:23.192+0000 7f7fff200640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:26:23.195 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-08-17T02:26:23.196+0000 7fd5dd400640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:26:23.698 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-08-17T02:26:23.697+0000 7f5bc8000640 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:26:23.708 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-08-17T02:26:23.708+0000 7f5bbf400640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:26:23.715 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-08-17T02:26:23.714+0000 7f2720a00640 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:26:23.718 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-08-17T02:26:23.718+0000 7efde5e00640 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:26:23.721 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-08-17T02:26:23.721+0000 7f2717e00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:26:23.725 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-08-17T02:26:23.724+0000 7efddd200640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:26:23.758 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-08-17T02:26:23.757+0000 7fafe1000640 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:26:23.763 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-08-17T02:26:23.763+0000 7fafd8400640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:26:24.011 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:24.146 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.146+0000 7f920aa00640 1 Processor -- start 2024-08-17T02:26:24.147 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.146+0000 7f920aa00640 1 -- start start 2024-08-17T02:26:24.148 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.147+0000 7f920aa00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9204159180 0x7f92040caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.148 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.147+0000 7f920aa00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f92040d0030 0x7f92040d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.148 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.147+0000 7f920aa00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92040af2c0 con 0x7f9204158db0 2024-08-17T02:26:24.148 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.147+0000 7f920aa00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92040d09a0 con 0x7f9204159180 2024-08-17T02:26:24.148 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.147+0000 7f920aa00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92040b0410 con 0x7f92040d0030 2024-08-17T02:26:24.149 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.147+0000 7f9203400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9204159180 0x7f92040caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.149 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.147+0000 7f9203400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9204159180 0x7f92040caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33372/0 (socket says 172.21.15.6:33372) 2024-08-17T02:26:24.149 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.147+0000 7f9203400640 1 -- 172.21.15.6:0/2219758574 learned_addr learned my addr 172.21.15.6:0/2219758574 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:24.149 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.147+0000 7f9208a00640 1 --2- 172.21.15.6:0/2219758574 >> v2:172.21.15.136:3300/0 conn(0x7f92040d0030 0x7f92040d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.149 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.148+0000 7f9203400640 1 -- 172.21.15.6:0/2219758574 >> v2:172.21.15.136:3300/0 conn(0x7f92040d0030 msgr2=0x7f92040d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:24.149 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.148+0000 7f9203400640 1 --2- 172.21.15.6:0/2219758574 >> v2:172.21.15.136:3300/0 conn(0x7f92040d0030 0x7f92040d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.149 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.148+0000 7f9203400640 1 -- 172.21.15.6:0/2219758574 >> v1:172.21.15.136:6789/0 conn(0x7f9204158db0 legacy=0x7f92040af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.149 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.148+0000 7f9203400640 1 -- 172.21.15.6:0/2219758574 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92040b3c60 con 0x7f9204159180 2024-08-17T02:26:24.149 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.148+0000 7f9202a00640 1 -- 172.21.15.6:0/2219758574 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307065179 0 0) 0x7f92040af2c0 con 0x7f9204158db0 2024-08-17T02:26:24.150 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.149+0000 7f9203400640 1 --2- 172.21.15.6:0/2219758574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9204159180 0x7f92040caad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f92040b5dd0 tx=0x7f91f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d759240edd552b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.150 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.149+0000 7f9202a00640 1 -- 172.21.15.6:0/2219758574 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f002ae80 con 0x7f9204159180 2024-08-17T02:26:24.150 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.149+0000 7f9202a00640 1 -- 172.21.15.6:0/2219758574 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f0032440 con 0x7f9204159180 2024-08-17T02:26:24.151 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.149+0000 7f9202a00640 1 -- 172.21.15.6:0/2219758574 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f00327c0 con 0x7f9204159180 2024-08-17T02:26:24.151 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.149+0000 7f920aa00640 1 -- 172.21.15.6:0/2219758574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9204159180 msgr2=0x7f92040caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.151 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.149+0000 7f920aa00640 1 --2- 172.21.15.6:0/2219758574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9204159180 0x7f92040caad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f92040b5dd0 tx=0x7f91f00091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.151 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.149+0000 7f920aa00640 1 -- 172.21.15.6:0/2219758574 shutdown_connections 2024-08-17T02:26:24.151 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.149+0000 7f920aa00640 1 --2- 172.21.15.6:0/2219758574 >> v2:172.21.15.136:3300/0 conn(0x7f92040d0030 0x7f92040d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.151 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.149+0000 7f920aa00640 1 --2- 172.21.15.6:0/2219758574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9204159180 0x7f92040caad0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.151 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.149+0000 7f920aa00640 1 -- 172.21.15.6:0/2219758574 >> 172.21.15.6:0/2219758574 conn(0x7f9204062bf0 msgr2=0x7f9204062ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.151 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.150+0000 7f920aa00640 1 -- 172.21.15.6:0/2219758574 shutdown_connections 2024-08-17T02:26:24.151 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.150+0000 7f920aa00640 1 -- 172.21.15.6:0/2219758574 wait complete. 2024-08-17T02:26:24.152 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.151+0000 7f920aa00640 1 Processor -- start 2024-08-17T02:26:24.152 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.151+0000 7f920aa00640 1 -- start start 2024-08-17T02:26:24.155 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.153+0000 7f920aa00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92040d0030 0x7f92040c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.155 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.153+0000 7f920aa00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9204158db0 0x7f92041512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.155 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.153+0000 7f920aa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9204159180 0x7f92040cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.155 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.154+0000 7f920aa00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92040c3760 con 0x7f9204159180 2024-08-17T02:26:24.155 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.154+0000 7f920aa00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92040c7280 con 0x7f9204158db0 2024-08-17T02:26:24.155 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.154+0000 7f920aa00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92040c7560 con 0x7f92040d0030 2024-08-17T02:26:24.158 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.156+0000 7f9203e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92040d0030 0x7f92040c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.158 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.156+0000 7f9208a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9204159180 0x7f92040cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.158 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.156+0000 7f9208a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9204159180 0x7f92040cbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33376/0 (socket says 172.21.15.6:33376) 2024-08-17T02:26:24.158 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.156+0000 7f9203e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92040d0030 0x7f92040c96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:40942/0 (socket says 172.21.15.6:40942) 2024-08-17T02:26:24.158 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.156+0000 7f9208a00640 1 -- 172.21.15.6:0/409737656 learned_addr learned my addr 172.21.15.6:0/409737656 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:24.158 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.157+0000 7f9203400640 1 --2- 172.21.15.6:0/409737656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9204158db0 0x7f92041512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.158 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.157+0000 7f9208a00640 1 -- 172.21.15.6:0/409737656 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92040d0030 msgr2=0x7f92040c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.158 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.157+0000 7f9208a00640 1 --2- 172.21.15.6:0/409737656 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92040d0030 0x7f92040c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.158 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.157+0000 7f9208a00640 1 -- 172.21.15.6:0/409737656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9204158db0 msgr2=0x7f92041512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.158 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.157+0000 7f9208a00640 1 --2- 172.21.15.6:0/409737656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9204158db0 0x7f92041512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.158 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.157+0000 7f9208a00640 1 -- 172.21.15.6:0/409737656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f0009450 con 0x7f9204159180 2024-08-17T02:26:24.159 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.157+0000 7f9203400640 1 --2- 172.21.15.6:0/409737656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9204158db0 0x7f92041512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:24.159 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.157+0000 7f9208a00640 1 --2- 172.21.15.6:0/409737656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9204159180 0x7f92040cbf10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009df0 tx=0x7f91fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.159 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.158+0000 7f91fb400640 1 -- 172.21.15.6:0/409737656 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc00cd40 con 0x7f9204159180 2024-08-17T02:26:24.159 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.158+0000 7f91fb400640 1 -- 172.21.15.6:0/409737656 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc00f040 con 0x7f9204159180 2024-08-17T02:26:24.159 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.158+0000 7f91fb400640 1 -- 172.21.15.6:0/409737656 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc0146d0 con 0x7f9204159180 2024-08-17T02:26:24.159 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.158+0000 7f920aa00640 1 -- 172.21.15.6:0/409737656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92040c7840 con 0x7f9204159180 2024-08-17T02:26:24.160 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.159+0000 7f920aa00640 1 -- 172.21.15.6:0/409737656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92040c9c10 con 0x7f9204159180 2024-08-17T02:26:24.163 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.161+0000 7f920aa00640 1 -- 172.21.15.6:0/409737656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92040c38d0 con 0x7f9204159180 2024-08-17T02:26:24.163 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.161+0000 7f91fb400640 1 -- 172.21.15.6:0/409737656 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f91fc014a80 con 0x7f9204159180 2024-08-17T02:26:24.163 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.162+0000 7f91fb400640 1 --2- 172.21.15.6:0/409737656 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91e4065190 0x7f91e4067640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.163 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.163+0000 7f91fb400640 1 -- 172.21.15.6:0/409737656 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f91fc082910 con 0x7f9204159180 2024-08-17T02:26:24.163 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.163+0000 7f9203e00640 1 --2- 172.21.15.6:0/409737656 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91e4065190 0x7f91e4067640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.164 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.163+0000 7f9203e00640 1 --2- 172.21.15.6:0/409737656 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91e4065190 0x7f91e4067640 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f91f40036f0 tx=0x7f91f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.168 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.167+0000 7f91fb400640 1 -- 172.21.15.6:0/409737656 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f91fc050f60 con 0x7f9204159180 2024-08-17T02:26:24.357 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.353+0000 7f920aa00640 1 -- 172.21.15.6:0/409737656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9204064540 con 0x7f9204159180 2024-08-17T02:26:24.358 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.354+0000 7f91fb400640 1 -- 172.21.15.6:0/409737656 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10348 (secure 0 0 0) 0x7f91fc054580 con 0x7f9204159180 2024-08-17T02:26:24.358 INFO:teuthology.misc.health.smithi006.stdout: 2024-08-17T02:26:24.358 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":13,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:24.134491+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:24.359 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.356+0000 7f920aa00640 1 -- 172.21.15.6:0/409737656 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91e4065190 msgr2=0x7f91e4067640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.359 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.356+0000 7f920aa00640 1 --2- 172.21.15.6:0/409737656 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91e4065190 0x7f91e4067640 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f91f40036f0 tx=0x7f91f4009040 comp rx=0 tx=0).stop 2024-08-17T02:26:24.359 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.356+0000 7f920aa00640 1 -- 172.21.15.6:0/409737656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9204159180 msgr2=0x7f92040cbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.359 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.356+0000 7f920aa00640 1 --2- 172.21.15.6:0/409737656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9204159180 0x7f92040cbf10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009df0 tx=0x7f91fc00b040 comp rx=0 tx=0).stop 2024-08-17T02:26:24.359 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.356+0000 7f920aa00640 1 -- 172.21.15.6:0/409737656 shutdown_connections 2024-08-17T02:26:24.359 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.356+0000 7f920aa00640 1 --2- 172.21.15.6:0/409737656 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91e4065190 0x7f91e4067640 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.359 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.356+0000 7f920aa00640 1 --2- 172.21.15.6:0/409737656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9204159180 0x7f92040cbf10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.359 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.356+0000 7f920aa00640 1 --2- 172.21.15.6:0/409737656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9204158db0 0x7f92041512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.359 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.356+0000 7f920aa00640 1 --2- 172.21.15.6:0/409737656 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92040d0030 0x7f92040c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.360 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.356+0000 7f920aa00640 1 -- 172.21.15.6:0/409737656 >> 172.21.15.6:0/409737656 conn(0x7f9204062bf0 msgr2=0x7f92041575d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.360 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.356+0000 7f920aa00640 1 -- 172.21.15.6:0/409737656 shutdown_connections 2024-08-17T02:26:24.360 INFO:teuthology.misc.health.smithi006.stderr:2024-08-17T02:26:24.356+0000 7f920aa00640 1 -- 172.21.15.6:0/409737656 wait complete. 2024-08-17T02:26:24.369 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:26:24.369 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:26:24.369 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:26:24.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:26:24.373 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:26:24.373 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:26:24.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:26:24.376 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:26:24.377 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:26:24.377 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:26:24.381 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:26:24.381 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:26:24.381 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:26:24.385 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:26:24.385 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:26:24.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:24.502 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-08-17T02:26:24.503 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-08-17T02:26:24.511 INFO:tasks.ceph.mds.b.smithi136.stdout:starting mds.b at 2024-08-17T02:26:24.514 INFO:tasks.ceph.mds.d.smithi136.stdout:starting mds.d at 2024-08-17T02:26:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.550+0000 7fd18dc00640 1 Processor -- start 2024-08-17T02:26:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.550+0000 7fd18dc00640 1 -- start start 2024-08-17T02:26:24.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.551+0000 7fd18dc00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd1880ca050 0x7fd188156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.552+0000 7fd18dc00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1880cb160 con 0x7fd1880ad960 2024-08-17T02:26:24.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.552+0000 7fd18dc00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1880b0d10 con 0x7fd1880add30 2024-08-17T02:26:24.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.552+0000 7fd18dc00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880ca550 con 0x7fd1880ca050 2024-08-17T02:26:24.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.552+0000 7fd186a00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd1880ad960 0x7fd188156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36324/0 (socket says 172.21.15.6:36324) 2024-08-17T02:26:24.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.552+0000 7fd186a00640 1 -- 172.21.15.6:0/3685245031 learned_addr learned my addr 172.21.15.6:0/3685245031 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:24.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.552+0000 7fd17fe00640 1 --2- 172.21.15.6:0/3685245031 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd1880ca050 0x7fd188156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.552+0000 7fd186000640 1 -- 172.21.15.6:0/3685245031 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839824687 0 0) 0x7fd1880cb160 con 0x7fd1880ad960 2024-08-17T02:26:24.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.552+0000 7fd186000640 1 -- 172.21.15.6:0/3685245031 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd16c0034e0 con 0x7fd1880ad960 2024-08-17T02:26:24.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.552+0000 7fd186000640 1 -- 172.21.15.6:0/3685245031 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448561305 0 0) 0x7fd1880b0d10 con 0x7fd1880add30 2024-08-17T02:26:24.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.552+0000 7fd186000640 1 -- 172.21.15.6:0/3685245031 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1880cb160 con 0x7fd1880add30 2024-08-17T02:26:24.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.552+0000 7fd17fe00640 1 -- 172.21.15.6:0/3685245031 >> v1:172.21.15.136:6789/0 conn(0x7fd1880add30 legacy=0x7fd1880aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.552+0000 7fd17fe00640 1 -- 172.21.15.6:0/3685245031 >> v1:172.21.15.6:6789/0 conn(0x7fd1880ad960 legacy=0x7fd188156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.552+0000 7fd17fe00640 1 -- 172.21.15.6:0/3685245031 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1880ca830 con 0x7fd1880ca050 2024-08-17T02:26:24.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.553+0000 7fd17fe00640 1 --2- 172.21.15.6:0/3685245031 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd1880ca050 0x7fd188156b30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd170009880 tx=0x7fd1700090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cea143c94050d78a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.554+0000 7fd186000640 1 -- 172.21.15.6:0/3685245031 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170032440 con 0x7fd1880ca050 2024-08-17T02:26:24.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.554+0000 7fd186000640 1 -- 172.21.15.6:0/3685245031 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1700325a0 con 0x7fd1880ca050 2024-08-17T02:26:24.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.554+0000 7fd186000640 1 -- 172.21.15.6:0/3685245031 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170032920 con 0x7fd1880ca050 2024-08-17T02:26:24.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.554+0000 7fd18dc00640 1 -- 172.21.15.6:0/3685245031 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd1880ca050 msgr2=0x7fd188156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.554+0000 7fd18dc00640 1 --2- 172.21.15.6:0/3685245031 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd1880ca050 0x7fd188156b30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd170009880 tx=0x7fd1700090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.554+0000 7fd18dc00640 1 -- 172.21.15.6:0/3685245031 shutdown_connections 2024-08-17T02:26:24.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.554+0000 7fd18dc00640 1 --2- 172.21.15.6:0/3685245031 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd1880ca050 0x7fd188156b30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.555+0000 7fd18dc00640 1 -- 172.21.15.6:0/3685245031 >> 172.21.15.6:0/3685245031 conn(0x7fd188066e60 msgr2=0x7fd188067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.555+0000 7fd18dc00640 1 -- 172.21.15.6:0/3685245031 shutdown_connections 2024-08-17T02:26:24.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.555+0000 7fd18dc00640 1 -- 172.21.15.6:0/3685245031 wait complete. 2024-08-17T02:26:24.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.556+0000 7fd18dc00640 1 Processor -- start 2024-08-17T02:26:24.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.556+0000 7fd18dc00640 1 -- start start 2024-08-17T02:26:24.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.557+0000 7fd18dc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880ad960 0x7fd188167ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.557+0000 7fd18dc00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd1880add30 0x7fd18814e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.557+0000 7fd18dc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1880ca050 0x7fd188154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.557+0000 7fd18dc00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd188168020 con 0x7fd1880ad960 2024-08-17T02:26:24.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.557+0000 7fd18dc00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880a5430 con 0x7fd1880ca050 2024-08-17T02:26:24.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.557+0000 7fd18dc00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880a5150 con 0x7fd1880add30 2024-08-17T02:26:24.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.557+0000 7fd186a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880ad960 0x7fd188167ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.557+0000 7fd186a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880ad960 0x7fd188167ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33402/0 (socket says 172.21.15.6:33402) 2024-08-17T02:26:24.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.557+0000 7fd186a00640 1 -- 172.21.15.6:0/4282037140 learned_addr learned my addr 172.21.15.6:0/4282037140 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:24.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.557+0000 7fd17fe00640 1 --2- 172.21.15.6:0/4282037140 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd1880add30 0x7fd18814e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.557+0000 7fd187400640 1 --2- 172.21.15.6:0/4282037140 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1880ca050 0x7fd188154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.558+0000 7fd186a00640 1 -- 172.21.15.6:0/4282037140 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd1880add30 msgr2=0x7fd18814e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.558+0000 7fd186a00640 1 --2- 172.21.15.6:0/4282037140 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd1880add30 0x7fd18814e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.558+0000 7fd186a00640 1 -- 172.21.15.6:0/4282037140 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1880ca050 msgr2=0x7fd188154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.558+0000 7fd186a00640 1 --2- 172.21.15.6:0/4282037140 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1880ca050 0x7fd188154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.558+0000 7fd186a00640 1 -- 172.21.15.6:0/4282037140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd170009390 con 0x7fd1880ad960 2024-08-17T02:26:24.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.558+0000 7fd186a00640 1 --2- 172.21.15.6:0/4282037140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880ad960 0x7fd188167ae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd178005840 tx=0x7fd178007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.558+0000 7fd17e000640 1 -- 172.21.15.6:0/4282037140 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd178005aa0 con 0x7fd1880ad960 2024-08-17T02:26:24.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.558+0000 7fd17e000640 1 -- 172.21.15.6:0/4282037140 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd178005c00 con 0x7fd1880ad960 2024-08-17T02:26:24.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.558+0000 7fd18dc00640 1 -- 172.21.15.6:0/4282037140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1881683b0 con 0x7fd1880ad960 2024-08-17T02:26:24.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.558+0000 7fd17e000640 1 -- 172.21.15.6:0/4282037140 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1780070f0 con 0x7fd1880ad960 2024-08-17T02:26:24.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.558+0000 7fd18dc00640 1 -- 172.21.15.6:0/4282037140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd188168970 con 0x7fd1880ad960 2024-08-17T02:26:24.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.560+0000 7fd18dc00640 1 -- 172.21.15.6:0/4282037140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd188168b60 con 0x7fd1880ad960 2024-08-17T02:26:24.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.560+0000 7fd17e000640 1 -- 172.21.15.6:0/4282037140 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7fd178007520 con 0x7fd1880ad960 2024-08-17T02:26:24.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.561+0000 7fd17e000640 1 --2- 172.21.15.6:0/4282037140 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd1640650c0 0x7fd164067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.561+0000 7fd17e000640 1 -- 172.21.15.6:0/4282037140 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7fd178081890 con 0x7fd1880ad960 2024-08-17T02:26:24.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.562+0000 7fd17fe00640 1 --2- 172.21.15.6:0/4282037140 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd1640650c0 0x7fd164067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.562+0000 7fd17fe00640 1 --2- 172.21.15.6:0/4282037140 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd1640650c0 0x7fd164067570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd170034000 tx=0x7fd170032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.565+0000 7fd17e000640 1 -- 172.21.15.6:0/4282037140 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd17804ff90 con 0x7fd1880ad960 2024-08-17T02:26:24.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.749+0000 7fd18dc00640 1 -- 172.21.15.6:0/4282037140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd188063fb0 con 0x7fd1880ad960 2024-08-17T02:26:24.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.750+0000 7fd17e000640 1 -- 172.21.15.6:0/4282037140 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10348 (secure 0 0 0) 0x7fd1780535b0 con 0x7fd1880ad960 2024-08-17T02:26:24.751 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:24.751 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":13,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:24.134491+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:24.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.752+0000 7fd18dc00640 1 -- 172.21.15.6:0/4282037140 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd1640650c0 msgr2=0x7fd164067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.752+0000 7fd18dc00640 1 --2- 172.21.15.6:0/4282037140 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd1640650c0 0x7fd164067570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd170034000 tx=0x7fd170032000 comp rx=0 tx=0).stop 2024-08-17T02:26:24.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.752+0000 7fd18dc00640 1 -- 172.21.15.6:0/4282037140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880ad960 msgr2=0x7fd188167ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.752+0000 7fd18dc00640 1 --2- 172.21.15.6:0/4282037140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880ad960 0x7fd188167ae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd178005840 tx=0x7fd178007df0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.752+0000 7fd18dc00640 1 -- 172.21.15.6:0/4282037140 shutdown_connections 2024-08-17T02:26:24.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.752+0000 7fd18dc00640 1 --2- 172.21.15.6:0/4282037140 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd1640650c0 0x7fd164067570 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.752+0000 7fd18dc00640 1 --2- 172.21.15.6:0/4282037140 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1880ca050 0x7fd188154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.752+0000 7fd18dc00640 1 --2- 172.21.15.6:0/4282037140 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd1880add30 0x7fd18814e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.752+0000 7fd18dc00640 1 --2- 172.21.15.6:0/4282037140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880ad960 0x7fd188167ae0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.752+0000 7fd18dc00640 1 -- 172.21.15.6:0/4282037140 >> 172.21.15.6:0/4282037140 conn(0x7fd188066e60 msgr2=0x7fd1881561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.752+0000 7fd18dc00640 1 -- 172.21.15.6:0/4282037140 shutdown_connections 2024-08-17T02:26:24.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.752+0000 7fd18dc00640 1 -- 172.21.15.6:0/4282037140 wait complete. 2024-08-17T02:26:24.767 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-08-17T02:26:24.768 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:24.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.918+0000 7f1f6b200640 1 Processor -- start 2024-08-17T02:26:24.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.919+0000 7f1f6b200640 1 -- start start 2024-08-17T02:26:24.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.920+0000 7f1f6b200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1f6c069840 0x7f1f6c0cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.920+0000 7f1f6b200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c0cd550 0x7f1f6c15ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.920+0000 7f1f6b200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6c15c9d0 con 0x7f1f6c0cbe10 2024-08-17T02:26:24.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.920+0000 7f1f6b200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6c15a200 con 0x7f1f6c069840 2024-08-17T02:26:24.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.920+0000 7f1f6b200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c0b0830 con 0x7f1f6c0cd550 2024-08-17T02:26:24.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.920+0000 7f1f69e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1f6c069840 0x7f1f6c0cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.920+0000 7f1f69e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1f6c069840 0x7f1f6c0cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59076/0 (socket says 172.21.15.6:59076) 2024-08-17T02:26:24.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.920+0000 7f1f69e00640 1 -- 172.21.15.6:0/3017840032 learned_addr learned my addr 172.21.15.6:0/3017840032 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:24.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.920+0000 7f1f6a800640 1 --1- 172.21.15.6:0/3017840032 >> v1:172.21.15.6:6789/0 conn(0x7f1f6c0cbe10 0x7f1f6c09a0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60716/0 (socket says 172.21.15.6:60716) 2024-08-17T02:26:24.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.920+0000 7f1f69e00640 1 -- 172.21.15.6:0/3017840032 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c0cd550 msgr2=0x7f1f6c15ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:24.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.920+0000 7f1f63e00640 1 --2- 172.21.15.6:0/3017840032 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c0cd550 0x7f1f6c15ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.921+0000 7f1f69e00640 1 --2- 172.21.15.6:0/3017840032 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c0cd550 0x7f1f6c15ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.921+0000 7f1f69e00640 1 -- 172.21.15.6:0/3017840032 >> v1:172.21.15.6:6789/0 conn(0x7f1f6c0cbe10 legacy=0x7f1f6c09a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.921+0000 7f1f69e00640 1 -- 172.21.15.6:0/3017840032 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c0b0b10 con 0x7f1f6c069840 2024-08-17T02:26:24.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.921+0000 7f1f63e00640 1 --2- 172.21.15.6:0/3017840032 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c0cd550 0x7f1f6c15ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:24.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.921+0000 7f1f69400640 1 -- 172.21.15.6:0/3017840032 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804399860 0 0) 0x7f1f6c15c9d0 con 0x7f1f6c0cbe10 2024-08-17T02:26:24.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.922+0000 7f1f69e00640 1 --2- 172.21.15.6:0/3017840032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c069840 0x7f1f6c0cb8d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009910 tx=0x7f1f5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3401fb340c1ef1ad server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.922+0000 7f1f69400640 1 -- 172.21.15.6:0/3017840032 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c02ae40 con 0x7f1f6c069840 2024-08-17T02:26:24.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.922+0000 7f1f69400640 1 -- 172.21.15.6:0/3017840032 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c032440 con 0x7f1f6c069840 2024-08-17T02:26:24.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.922+0000 7f1f69400640 1 -- 172.21.15.6:0/3017840032 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0327e0 con 0x7f1f6c069840 2024-08-17T02:26:24.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.922+0000 7f1f6b200640 1 -- 172.21.15.6:0/3017840032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c069840 msgr2=0x7f1f6c0cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.922+0000 7f1f6b200640 1 --2- 172.21.15.6:0/3017840032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c069840 0x7f1f6c0cb8d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009910 tx=0x7f1f5c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.922+0000 7f1f6b200640 1 -- 172.21.15.6:0/3017840032 shutdown_connections 2024-08-17T02:26:24.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.922+0000 7f1f6b200640 1 --2- 172.21.15.6:0/3017840032 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c0cd550 0x7f1f6c15ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.922+0000 7f1f6b200640 1 --2- 172.21.15.6:0/3017840032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c069840 0x7f1f6c0cb8d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.922+0000 7f1f6b200640 1 -- 172.21.15.6:0/3017840032 >> 172.21.15.6:0/3017840032 conn(0x7f1f6c066e60 msgr2=0x7f1f6c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.923+0000 7f1f6b200640 1 -- 172.21.15.6:0/3017840032 shutdown_connections 2024-08-17T02:26:24.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.923+0000 7f1f6b200640 1 -- 172.21.15.6:0/3017840032 wait complete. 2024-08-17T02:26:24.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.924+0000 7f1f6b200640 1 Processor -- start 2024-08-17T02:26:24.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.924+0000 7f1f6b200640 1 -- start start 2024-08-17T02:26:24.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.925+0000 7f1f6b200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c069840 0x7f1f6c0af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.925+0000 7f1f6b200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f6c0cbe10 0x7f1f6c152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.925+0000 7f1f6b200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c152610 0x7f1f6c1545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.925+0000 7f1f6b200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c153360 con 0x7f1f6c069840 2024-08-17T02:26:24.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.925+0000 7f1f6b200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c154160 con 0x7f1f6c0cbe10 2024-08-17T02:26:24.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.925+0000 7f1f6b200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c152ab0 con 0x7f1f6c152610 2024-08-17T02:26:24.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.925+0000 7f1f69e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c069840 0x7f1f6c0af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.925+0000 7f1f69e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c069840 0x7f1f6c0af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59086/0 (socket says 172.21.15.6:59086) 2024-08-17T02:26:24.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.925+0000 7f1f69e00640 1 -- 172.21.15.6:0/2435149562 learned_addr learned my addr 172.21.15.6:0/2435149562 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:24.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.925+0000 7f1f6a800640 1 --2- 172.21.15.6:0/2435149562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c152610 0x7f1f6c1545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.925+0000 7f1f63e00640 1 --2- 172.21.15.6:0/2435149562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f6c0cbe10 0x7f1f6c152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.925+0000 7f1f69e00640 1 -- 172.21.15.6:0/2435149562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c152610 msgr2=0x7f1f6c1545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.925+0000 7f1f69e00640 1 --2- 172.21.15.6:0/2435149562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c152610 0x7f1f6c1545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.925+0000 7f1f69e00640 1 -- 172.21.15.6:0/2435149562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f6c0cbe10 msgr2=0x7f1f6c152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.925+0000 7f1f69e00640 1 --2- 172.21.15.6:0/2435149562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f6c0cbe10 0x7f1f6c152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.925+0000 7f1f69e00640 1 -- 172.21.15.6:0/2435149562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c009450 con 0x7f1f6c069840 2024-08-17T02:26:24.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.925+0000 7f1f63e00640 1 --2- 172.21.15.6:0/2435149562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f6c0cbe10 0x7f1f6c152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.926+0000 7f1f69e00640 1 --2- 172.21.15.6:0/2435149562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c069840 0x7f1f6c0af490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009970 tx=0x7f1f5c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.926+0000 7f1f61600640 1 -- 172.21.15.6:0/2435149562 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c031a60 con 0x7f1f6c069840 2024-08-17T02:26:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.926+0000 7f1f61600640 1 -- 172.21.15.6:0/2435149562 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c031be0 con 0x7f1f6c069840 2024-08-17T02:26:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.926+0000 7f1f61600640 1 -- 172.21.15.6:0/2435149562 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c03e450 con 0x7f1f6c069840 2024-08-17T02:26:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.926+0000 7f1f6b200640 1 -- 172.21.15.6:0/2435149562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f6c153550 con 0x7f1f6c069840 2024-08-17T02:26:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.926+0000 7f1f6b200640 1 -- 172.21.15.6:0/2435149562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6c153b10 con 0x7f1f6c069840 2024-08-17T02:26:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.927+0000 7f1f6b200640 1 -- 172.21.15.6:0/2435149562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6c09b210 con 0x7f1f6c069840 2024-08-17T02:26:24.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.928+0000 7f1f61600640 1 -- 172.21.15.6:0/2435149562 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f1f5c03c400 con 0x7f1f6c069840 2024-08-17T02:26:24.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.929+0000 7f1f61600640 1 --2- 172.21.15.6:0/2435149562 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1f480650f0 0x7f1f480675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.929+0000 7f1f61600640 1 -- 172.21.15.6:0/2435149562 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f1f5c02ae40 con 0x7f1f6c069840 2024-08-17T02:26:24.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.929+0000 7f1f63e00640 1 --2- 172.21.15.6:0/2435149562 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1f480650f0 0x7f1f480675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.930+0000 7f1f63e00640 1 --2- 172.21.15.6:0/2435149562 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1f480650f0 0x7f1f480675a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1f54006fd0 tx=0x7f1f54008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:24.933+0000 7f1f61600640 1 -- 172.21.15.6:0/2435149562 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1f6c09b210 con 0x7f1f6c069840 2024-08-17T02:26:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:25.155+0000 7f1f6b200640 1 -- 172.21.15.6:0/2435149562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f6c09b210 con 0x7f1f6c069840 2024-08-17T02:26:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:25.155+0000 7f1f61600640 1 -- 172.21.15.6:0/2435149562 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1250 (secure 0 0 0) 0x7f1f5c043500 con 0x7f1f6c069840 2024-08-17T02:26:25.156 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:25.156 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/881817227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":881817227},{"type":"v1","addr":"172.21.15.6:6833","nonce":881817227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:26:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 2 2024-08-17T02:26:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:25.157+0000 7f1f6b200640 1 -- 172.21.15.6:0/2435149562 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1f480650f0 msgr2=0x7f1f480675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:25.157+0000 7f1f6b200640 1 --2- 172.21.15.6:0/2435149562 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1f480650f0 0x7f1f480675a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1f54006fd0 tx=0x7f1f54008040 comp rx=0 tx=0).stop 2024-08-17T02:26:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:25.157+0000 7f1f6b200640 1 -- 172.21.15.6:0/2435149562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c069840 msgr2=0x7f1f6c0af490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:25.157+0000 7f1f6b200640 1 --2- 172.21.15.6:0/2435149562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c069840 0x7f1f6c0af490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009970 tx=0x7f1f5c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:25.157+0000 7f1f6b200640 1 -- 172.21.15.6:0/2435149562 shutdown_connections 2024-08-17T02:26:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:25.157+0000 7f1f6b200640 1 --2- 172.21.15.6:0/2435149562 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1f480650f0 0x7f1f480675a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:25.157+0000 7f1f6b200640 1 --2- 172.21.15.6:0/2435149562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c152610 0x7f1f6c1545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:25.157+0000 7f1f6b200640 1 --2- 172.21.15.6:0/2435149562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f6c0cbe10 0x7f1f6c152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:25.157+0000 7f1f6b200640 1 --2- 172.21.15.6:0/2435149562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c069840 0x7f1f6c0af490 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:25.157+0000 7f1f6b200640 1 -- 172.21.15.6:0/2435149562 >> 172.21.15.6:0/2435149562 conn(0x7f1f6c066e60 msgr2=0x7f1f6c0cc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:25.158+0000 7f1f6b200640 1 -- 172.21.15.6:0/2435149562 shutdown_connections 2024-08-17T02:26:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:25.158+0000 7f1f6b200640 1 -- 172.21.15.6:0/2435149562 wait complete. 2024-08-17T02:26:27.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:27.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.343+0000 7f0e6aa00640 1 Processor -- start 2024-08-17T02:26:27.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.343+0000 7f0e6aa00640 1 -- start start 2024-08-17T02:26:27.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.344+0000 7f0e6aa00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e64158e10 0x7f0e64068180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.345+0000 7f0e6aa00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e641591e0 0x7f0e640686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.345+0000 7f0e6aa00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e640c40a0 con 0x7f0e640ace00 2024-08-17T02:26:27.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.345+0000 7f0e6aa00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e640694e0 con 0x7f0e64158e10 2024-08-17T02:26:27.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.345+0000 7f0e6aa00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e64069240 con 0x7f0e641591e0 2024-08-17T02:26:27.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.345+0000 7f0e63e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e64158e10 0x7f0e64068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.345+0000 7f0e63400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e641591e0 0x7f0e640686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.345+0000 7f0e63e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e64158e10 0x7f0e64068180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59098/0 (socket says 172.21.15.6:59098) 2024-08-17T02:26:27.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.345+0000 7f0e63e00640 1 -- 172.21.15.6:0/1052825787 learned_addr learned my addr 172.21.15.6:0/1052825787 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:27.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.345+0000 7f0e68a00640 1 --1- 172.21.15.6:0/1052825787 >> v1:172.21.15.6:6789/0 conn(0x7f0e640ace00 0x7f0e640c28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60720/0 (socket says 172.21.15.6:60720) 2024-08-17T02:26:27.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.345+0000 7f0e63e00640 1 -- 172.21.15.6:0/1052825787 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e641591e0 msgr2=0x7f0e640686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:27.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.345+0000 7f0e63e00640 1 --2- 172.21.15.6:0/1052825787 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e641591e0 0x7f0e640686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.345+0000 7f0e63e00640 1 -- 172.21.15.6:0/1052825787 >> v1:172.21.15.6:6789/0 conn(0x7f0e640ace00 legacy=0x7f0e640c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.345+0000 7f0e63e00640 1 -- 172.21.15.6:0/1052825787 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e640c3a50 con 0x7f0e64158e10 2024-08-17T02:26:27.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.345+0000 7f0e62a00640 1 -- 172.21.15.6:0/1052825787 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782660630 0 0) 0x7f0e640c40a0 con 0x7f0e640ace00 2024-08-17T02:26:27.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.346+0000 7f0e63e00640 1 --2- 172.21.15.6:0/1052825787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e64158e10 0x7f0e64068180 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009910 tx=0x7f0e540091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936b456381865c05 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.347+0000 7f0e62a00640 1 -- 172.21.15.6:0/1052825787 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5402ae40 con 0x7f0e64158e10 2024-08-17T02:26:27.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.347+0000 7f0e62a00640 1 -- 172.21.15.6:0/1052825787 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e54032440 con 0x7f0e64158e10 2024-08-17T02:26:27.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.347+0000 7f0e62a00640 1 -- 172.21.15.6:0/1052825787 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e540327e0 con 0x7f0e64158e10 2024-08-17T02:26:27.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.347+0000 7f0e6aa00640 1 -- 172.21.15.6:0/1052825787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e64158e10 msgr2=0x7f0e64068180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.347+0000 7f0e6aa00640 1 --2- 172.21.15.6:0/1052825787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e64158e10 0x7f0e64068180 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009910 tx=0x7f0e540091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.347+0000 7f0e6aa00640 1 -- 172.21.15.6:0/1052825787 shutdown_connections 2024-08-17T02:26:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.347+0000 7f0e6aa00640 1 --2- 172.21.15.6:0/1052825787 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e641591e0 0x7f0e640686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.347+0000 7f0e6aa00640 1 --2- 172.21.15.6:0/1052825787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e64158e10 0x7f0e64068180 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.347+0000 7f0e6aa00640 1 -- 172.21.15.6:0/1052825787 >> 172.21.15.6:0/1052825787 conn(0x7f0e640ce590 msgr2=0x7f0e640ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.347+0000 7f0e6aa00640 1 -- 172.21.15.6:0/1052825787 shutdown_connections 2024-08-17T02:26:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.347+0000 7f0e6aa00640 1 -- 172.21.15.6:0/1052825787 wait complete. 2024-08-17T02:26:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.349+0000 7f0e6aa00640 1 Processor -- start 2024-08-17T02:26:27.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.349+0000 7f0e6aa00640 1 -- start start 2024-08-17T02:26:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.350+0000 7f0e6aa00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e640ace00 0x7f0e640b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.350+0000 7f0e6aa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e64158e10 0x7f0e6416c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.350+0000 7f0e6aa00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e641591e0 0x7f0e6416cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.350+0000 7f0e6aa00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e640c5580 con 0x7f0e64158e10 2024-08-17T02:26:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.350+0000 7f0e6aa00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6416d460 con 0x7f0e640ace00 2024-08-17T02:26:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.350+0000 7f0e6aa00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6416d710 con 0x7f0e641591e0 2024-08-17T02:26:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.350+0000 7f0e63400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e64158e10 0x7f0e6416c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.350+0000 7f0e63400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e64158e10 0x7f0e6416c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59112/0 (socket says 172.21.15.6:59112) 2024-08-17T02:26:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.350+0000 7f0e63400640 1 -- 172.21.15.6:0/3724935927 learned_addr learned my addr 172.21.15.6:0/3724935927 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.350+0000 7f0e63e00640 1 --2- 172.21.15.6:0/3724935927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e640ace00 0x7f0e640b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.350+0000 7f0e68a00640 1 --2- 172.21.15.6:0/3724935927 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e641591e0 0x7f0e6416cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.351+0000 7f0e63400640 1 -- 172.21.15.6:0/3724935927 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e641591e0 msgr2=0x7f0e6416cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.351+0000 7f0e63400640 1 --2- 172.21.15.6:0/3724935927 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e641591e0 0x7f0e6416cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.351+0000 7f0e63400640 1 -- 172.21.15.6:0/3724935927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e640ace00 msgr2=0x7f0e640b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.351+0000 7f0e63400640 1 --2- 172.21.15.6:0/3724935927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e640ace00 0x7f0e640b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.351+0000 7f0e63400640 1 -- 172.21.15.6:0/3724935927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e54009450 con 0x7f0e64158e10 2024-08-17T02:26:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.351+0000 7f0e68a00640 1 --2- 172.21.15.6:0/3724935927 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e641591e0 0x7f0e6416cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.351+0000 7f0e63400640 1 --2- 172.21.15.6:0/3724935927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e64158e10 0x7f0e6416c9e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009fd0 tx=0x7f0e500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.351+0000 7f0e5b400640 1 -- 172.21.15.6:0/3724935927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000c940 con 0x7f0e64158e10 2024-08-17T02:26:27.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.351+0000 7f0e5b400640 1 -- 172.21.15.6:0/3724935927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5000caa0 con 0x7f0e64158e10 2024-08-17T02:26:27.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.351+0000 7f0e5b400640 1 -- 172.21.15.6:0/3724935927 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000ce20 con 0x7f0e64158e10 2024-08-17T02:26:27.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.351+0000 7f0e6aa00640 1 -- 172.21.15.6:0/3724935927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e640c4c50 con 0x7f0e64158e10 2024-08-17T02:26:27.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.351+0000 7f0e6aa00640 1 -- 172.21.15.6:0/3724935927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e640c5210 con 0x7f0e64158e10 2024-08-17T02:26:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.353+0000 7f0e6aa00640 1 -- 172.21.15.6:0/3724935927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e64063fb0 con 0x7f0e64158e10 2024-08-17T02:26:27.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.353+0000 7f0e5b400640 1 -- 172.21.15.6:0/3724935927 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f0e50013680 con 0x7f0e64158e10 2024-08-17T02:26:27.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.354+0000 7f0e5b400640 1 --2- 172.21.15.6:0/3724935927 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0e440650c0 0x7f0e44067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.354+0000 7f0e5b400640 1 -- 172.21.15.6:0/3724935927 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0e500821f0 con 0x7f0e64158e10 2024-08-17T02:26:27.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.355+0000 7f0e63e00640 1 --2- 172.21.15.6:0/3724935927 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0e440650c0 0x7f0e44067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.355+0000 7f0e63e00640 1 --2- 172.21.15.6:0/3724935927 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0e440650c0 0x7f0e44067570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0e54034000 tx=0x7f0e54032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.359+0000 7f0e5b400640 1 -- 172.21.15.6:0/3724935927 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0e50050790 con 0x7f0e64158e10 2024-08-17T02:26:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.592+0000 7f0e6aa00640 1 -- 172.21.15.6:0/3724935927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e6406d020 con 0x7f0e64158e10 2024-08-17T02:26:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.593+0000 7f0e5b400640 1 -- 172.21.15.6:0/3724935927 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3515 (secure 0 0 0) 0x7f0e50017dd0 con 0x7f0e64158e10 2024-08-17T02:26:27.594 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:27.594 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/881817227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":881817227},{"type":"v1","addr":"172.21.15.6:6833","nonce":881817227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/546855411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":546855411},{"type":"v1","addr":"172.21.15.6:6835","nonce":546855411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/539185499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":539185499},{"type":"v1","addr":"172.21.15.136:6837","nonce":539185499}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2230598578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2230598578},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230598578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-08-17T02:26:27.594 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 3 2024-08-17T02:26:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.595+0000 7f0e6aa00640 1 -- 172.21.15.6:0/3724935927 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0e440650c0 msgr2=0x7f0e44067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.595+0000 7f0e6aa00640 1 --2- 172.21.15.6:0/3724935927 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0e440650c0 0x7f0e44067570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0e54034000 tx=0x7f0e54032000 comp rx=0 tx=0).stop 2024-08-17T02:26:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.595+0000 7f0e6aa00640 1 -- 172.21.15.6:0/3724935927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e64158e10 msgr2=0x7f0e6416c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.595+0000 7f0e6aa00640 1 --2- 172.21.15.6:0/3724935927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e64158e10 0x7f0e6416c9e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009fd0 tx=0x7f0e500090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.595+0000 7f0e6aa00640 1 -- 172.21.15.6:0/3724935927 shutdown_connections 2024-08-17T02:26:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.595+0000 7f0e6aa00640 1 --2- 172.21.15.6:0/3724935927 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0e440650c0 0x7f0e44067570 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.595+0000 7f0e6aa00640 1 --2- 172.21.15.6:0/3724935927 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0e641591e0 0x7f0e6416cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.595+0000 7f0e6aa00640 1 --2- 172.21.15.6:0/3724935927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e64158e10 0x7f0e6416c9e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.595+0000 7f0e6aa00640 1 --2- 172.21.15.6:0/3724935927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e640ace00 0x7f0e640b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.595+0000 7f0e6aa00640 1 -- 172.21.15.6:0/3724935927 >> 172.21.15.6:0/3724935927 conn(0x7f0e640ce590 msgr2=0x7f0e640ac660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:27.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.595+0000 7f0e6aa00640 1 -- 172.21.15.6:0/3724935927 shutdown_connections 2024-08-17T02:26:27.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.595+0000 7f0e6aa00640 1 -- 172.21.15.6:0/3724935927 wait complete. 2024-08-17T02:26:27.611 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:27.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.766+0000 7faa3dc00640 1 Processor -- start 2024-08-17T02:26:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.766+0000 7faa3dc00640 1 -- start start 2024-08-17T02:26:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.767+0000 7faa3dc00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7faa38155040 0x7faa38158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.767+0000 7faa3dc00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380aeeb0 con 0x7faa381591c0 2024-08-17T02:26:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.767+0000 7faa3dc00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380aadd0 con 0x7faa3806e770 2024-08-17T02:26:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.767+0000 7faa3dc00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa38159610 con 0x7faa38155040 2024-08-17T02:26:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.767+0000 7faa2fe00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faa381591c0 0x7faa3806e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60732/0 (socket says 172.21.15.6:60732) 2024-08-17T02:26:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.767+0000 7faa2fe00640 1 -- 172.21.15.6:0/3382421887 learned_addr learned my addr 172.21.15.6:0/3382421887 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.767+0000 7faa36a00640 1 --2- 172.21.15.6:0/3382421887 >> v2:172.21.15.136:3300/0 conn(0x7faa38155040 0x7faa38158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.768+0000 7faa36a00640 1 -- 172.21.15.6:0/3382421887 >> v1:172.21.15.136:6789/0 conn(0x7faa3806e770 legacy=0x7faa380af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.768+0000 7faa36a00640 1 -- 172.21.15.6:0/3382421887 >> v1:172.21.15.6:6789/0 conn(0x7faa381591c0 legacy=0x7faa3806e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.768+0000 7faa36a00640 1 -- 172.21.15.6:0/3382421887 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa381597f0 con 0x7faa38155040 2024-08-17T02:26:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.769+0000 7faa36a00640 1 --2- 172.21.15.6:0/3382421887 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa38155040 0x7faa38158c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faa28009850 tx=0x7faa280090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af70a58e5b4a87d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.769+0000 7faa36000640 1 -- 172.21.15.6:0/3382421887 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2802be10 con 0x7faa38155040 2024-08-17T02:26:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.769+0000 7faa36000640 1 -- 172.21.15.6:0/3382421887 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa28033440 con 0x7faa38155040 2024-08-17T02:26:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.769+0000 7faa36000640 1 -- 172.21.15.6:0/3382421887 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa28033820 con 0x7faa38155040 2024-08-17T02:26:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.770+0000 7faa3dc00640 1 -- 172.21.15.6:0/3382421887 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa38155040 msgr2=0x7faa38158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.770+0000 7faa3dc00640 1 --2- 172.21.15.6:0/3382421887 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa38155040 0x7faa38158c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faa28009850 tx=0x7faa280090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.770+0000 7faa3dc00640 1 -- 172.21.15.6:0/3382421887 shutdown_connections 2024-08-17T02:26:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.770+0000 7faa3dc00640 1 --2- 172.21.15.6:0/3382421887 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa38155040 0x7faa38158c80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.770+0000 7faa3dc00640 1 -- 172.21.15.6:0/3382421887 >> 172.21.15.6:0/3382421887 conn(0x7faa38066e60 msgr2=0x7faa38067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.770+0000 7faa3dc00640 1 -- 172.21.15.6:0/3382421887 shutdown_connections 2024-08-17T02:26:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.770+0000 7faa3dc00640 1 -- 172.21.15.6:0/3382421887 wait complete. 2024-08-17T02:26:27.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.772+0000 7faa3dc00640 1 Processor -- start 2024-08-17T02:26:27.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.772+0000 7faa3dc00640 1 -- start start 2024-08-17T02:26:27.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.773+0000 7faa3dc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa3806e770 0x7faa3813bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.773+0000 7faa3dc00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa38155040 0x7faa3815a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.773+0000 7faa3dc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa381591c0 0x7faa3813c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.773+0000 7faa3dc00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3815be30 con 0x7faa381591c0 2024-08-17T02:26:27.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.773+0000 7faa3dc00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3815b220 con 0x7faa3806e770 2024-08-17T02:26:27.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.773+0000 7faa3dc00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3815b500 con 0x7faa38155040 2024-08-17T02:26:27.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.773+0000 7faa37400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa381591c0 0x7faa3813c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.773+0000 7faa36a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa3806e770 0x7faa3813bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.773+0000 7faa36a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa3806e770 0x7faa3813bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:37974/0 (socket says 172.21.15.6:37974) 2024-08-17T02:26:27.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.773+0000 7faa36a00640 1 -- 172.21.15.6:0/3085783713 learned_addr learned my addr 172.21.15.6:0/3085783713 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:27.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.773+0000 7faa2fe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa38155040 0x7faa3815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.774+0000 7faa37400640 1 -- 172.21.15.6:0/3085783713 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa38155040 msgr2=0x7faa3815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.774+0000 7faa37400640 1 --2- 172.21.15.6:0/3085783713 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa38155040 0x7faa3815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.774+0000 7faa37400640 1 -- 172.21.15.6:0/3085783713 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa3806e770 msgr2=0x7faa3813bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.774+0000 7faa37400640 1 --2- 172.21.15.6:0/3085783713 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa3806e770 0x7faa3813bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.774+0000 7faa37400640 1 -- 172.21.15.6:0/3085783713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa28009390 con 0x7faa381591c0 2024-08-17T02:26:27.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.774+0000 7faa37400640 1 --2- 172.21.15.6:0/3085783713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa381591c0 0x7faa3813c880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa3806eb70 tx=0x7faa30001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.774+0000 7faa2e000640 1 -- 172.21.15.6:0/3085783713 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa30012630 con 0x7faa381591c0 2024-08-17T02:26:27.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.774+0000 7faa2e000640 1 -- 172.21.15.6:0/3085783713 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa30012790 con 0x7faa381591c0 2024-08-17T02:26:27.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.774+0000 7faa2e000640 1 -- 172.21.15.6:0/3085783713 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa30012b50 con 0x7faa381591c0 2024-08-17T02:26:27.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.774+0000 7faa3dc00640 1 -- 172.21.15.6:0/3085783713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa3815b7e0 con 0x7faa381591c0 2024-08-17T02:26:27.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.774+0000 7faa3dc00640 1 -- 172.21.15.6:0/3085783713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa3813c490 con 0x7faa381591c0 2024-08-17T02:26:27.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.775+0000 7faa3dc00640 1 -- 172.21.15.6:0/3085783713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa3815bfe0 con 0x7faa381591c0 2024-08-17T02:26:27.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.776+0000 7faa2e000640 1 -- 172.21.15.6:0/3085783713 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7faa3001a3a0 con 0x7faa381591c0 2024-08-17T02:26:27.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.777+0000 7faa2e000640 1 --2- 172.21.15.6:0/3085783713 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7faa140650c0 0x7faa14067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.777+0000 7faa2e000640 1 -- 172.21.15.6:0/3085783713 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7faa30082120 con 0x7faa381591c0 2024-08-17T02:26:27.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.777+0000 7faa36a00640 1 --2- 172.21.15.6:0/3085783713 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7faa140650c0 0x7faa14067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.778+0000 7faa36a00640 1 --2- 172.21.15.6:0/3085783713 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7faa140650c0 0x7faa14067570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faa28009130 tx=0x7faa28033000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.782+0000 7faa2e000640 1 -- 172.21.15.6:0/3085783713 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faa3815bfe0 con 0x7faa381591c0 2024-08-17T02:26:27.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.968+0000 7faa3dc00640 1 -- 172.21.15.6:0/3085783713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa38063fb0 con 0x7faa381591c0 2024-08-17T02:26:27.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.969+0000 7faa2e000640 1 -- 172.21.15.6:0/3085783713 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12092 (secure 0 0 0) 0x7faa30050620 con 0x7faa381591c0 2024-08-17T02:26:27.970 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:27.970 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":16,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:27.145790+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:27.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.971+0000 7faa3dc00640 1 -- 172.21.15.6:0/3085783713 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7faa140650c0 msgr2=0x7faa14067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.971+0000 7faa3dc00640 1 --2- 172.21.15.6:0/3085783713 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7faa140650c0 0x7faa14067570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faa28009130 tx=0x7faa28033000 comp rx=0 tx=0).stop 2024-08-17T02:26:27.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.971+0000 7faa3dc00640 1 -- 172.21.15.6:0/3085783713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa381591c0 msgr2=0x7faa3813c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.971+0000 7faa3dc00640 1 --2- 172.21.15.6:0/3085783713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa381591c0 0x7faa3813c880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa3806eb70 tx=0x7faa30001610 comp rx=0 tx=0).stop 2024-08-17T02:26:27.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.971+0000 7faa3dc00640 1 -- 172.21.15.6:0/3085783713 shutdown_connections 2024-08-17T02:26:27.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.971+0000 7faa3dc00640 1 --2- 172.21.15.6:0/3085783713 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7faa140650c0 0x7faa14067570 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.971+0000 7faa3dc00640 1 --2- 172.21.15.6:0/3085783713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa381591c0 0x7faa3813c880 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.971+0000 7faa3dc00640 1 --2- 172.21.15.6:0/3085783713 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa38155040 0x7faa3815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.971+0000 7faa3dc00640 1 --2- 172.21.15.6:0/3085783713 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa3806e770 0x7faa3813bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.971+0000 7faa3dc00640 1 -- 172.21.15.6:0/3085783713 >> 172.21.15.6:0/3085783713 conn(0x7faa38066e60 msgr2=0x7faa380c9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:27.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.971+0000 7faa3dc00640 1 -- 172.21.15.6:0/3085783713 shutdown_connections 2024-08-17T02:26:27.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:27.972+0000 7faa3dc00640 1 -- 172.21.15.6:0/3085783713 wait complete. 2024-08-17T02:26:27.992 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:25.463503+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:26:27.993 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:28.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.147+0000 7f7dca200640 1 Processor -- start 2024-08-17T02:26:28.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.148+0000 7f7dca200640 1 -- start start 2024-08-17T02:26:28.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.149+0000 7f7dca200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7dc40cc7e0 0x7f7dc40ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.149+0000 7f7dca200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7dc415bbd0 0x7f7dc415c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.149+0000 7f7dca200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc415c550 con 0x7f7dc40cd780 2024-08-17T02:26:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.149+0000 7f7dca200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc40cdc60 con 0x7f7dc415bbd0 2024-08-17T02:26:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.149+0000 7f7dca200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc40cdf40 con 0x7f7dc40cc7e0 2024-08-17T02:26:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.149+0000 7f7dc8e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7dc40cc7e0 0x7f7dc40ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.150+0000 7f7dc9800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7dc415bbd0 0x7f7dc415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.150+0000 7f7dc8e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7dc40cc7e0 0x7f7dc40ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:37980/0 (socket says 172.21.15.6:37980) 2024-08-17T02:26:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.150+0000 7f7dc8e00640 1 -- 172.21.15.6:0/1003086978 learned_addr learned my addr 172.21.15.6:0/1003086978 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.150+0000 7f7dbbe00640 1 --1- 172.21.15.6:0/1003086978 >> v1:172.21.15.136:6789/0 conn(0x7f7dc40cd780 0x7f7dc40cab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:58018/0 (socket says 172.21.15.6:58018) 2024-08-17T02:26:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.150+0000 7f7dc9800640 1 -- 172.21.15.6:0/1003086978 >> v2:172.21.15.136:3300/0 conn(0x7f7dc40cc7e0 msgr2=0x7f7dc40ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.150+0000 7f7dc9800640 1 --2- 172.21.15.6:0/1003086978 >> v2:172.21.15.136:3300/0 conn(0x7f7dc40cc7e0 0x7f7dc40ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.150+0000 7f7dc9800640 1 -- 172.21.15.6:0/1003086978 >> v1:172.21.15.136:6789/0 conn(0x7f7dc40cd780 legacy=0x7f7dc40cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.150+0000 7f7dc9800640 1 -- 172.21.15.6:0/1003086978 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc40ce220 con 0x7f7dc415bbd0 2024-08-17T02:26:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.151+0000 7f7dc9800640 1 --2- 172.21.15.6:0/1003086978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc415bbd0 0x7f7dc415c010 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4087f90 tx=0x7f7dbc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdcc4895e63593d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.151+0000 7f7dc3e00640 1 -- 172.21.15.6:0/1003086978 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc007550 con 0x7f7dc415bbd0 2024-08-17T02:26:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.151+0000 7f7dc3e00640 1 -- 172.21.15.6:0/1003086978 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc02d050 con 0x7f7dc415bbd0 2024-08-17T02:26:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.151+0000 7f7dc3e00640 1 -- 172.21.15.6:0/1003086978 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc007920 con 0x7f7dc415bbd0 2024-08-17T02:26:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.152+0000 7f7dca200640 1 -- 172.21.15.6:0/1003086978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc415bbd0 msgr2=0x7f7dc415c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.152+0000 7f7dca200640 1 --2- 172.21.15.6:0/1003086978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc415bbd0 0x7f7dc415c010 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4087f90 tx=0x7f7dbc009780 comp rx=0 tx=0).stop 2024-08-17T02:26:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.152+0000 7f7dca200640 1 -- 172.21.15.6:0/1003086978 shutdown_connections 2024-08-17T02:26:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.152+0000 7f7dca200640 1 --2- 172.21.15.6:0/1003086978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc415bbd0 0x7f7dc415c010 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.152+0000 7f7dca200640 1 --2- 172.21.15.6:0/1003086978 >> v2:172.21.15.136:3300/0 conn(0x7f7dc40cc7e0 0x7f7dc40ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.152+0000 7f7dca200640 1 -- 172.21.15.6:0/1003086978 >> 172.21.15.6:0/1003086978 conn(0x7f7dc4087a80 msgr2=0x7f7dc406e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.152+0000 7f7dca200640 1 -- 172.21.15.6:0/1003086978 shutdown_connections 2024-08-17T02:26:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.152+0000 7f7dca200640 1 -- 172.21.15.6:0/1003086978 wait complete. 2024-08-17T02:26:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.154+0000 7f7dca200640 1 Processor -- start 2024-08-17T02:26:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.154+0000 7f7dca200640 1 -- start start 2024-08-17T02:26:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.155+0000 7f7dca200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc40cc7e0 0x7f7dc41487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.155+0000 7f7dca200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7dc40cd780 0x7f7dc40c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.155+0000 7f7dca200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7dc415bbd0 0x7f7dc4158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.155+0000 7f7dca200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc41490c0 con 0x7f7dc40cc7e0 2024-08-17T02:26:28.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.155+0000 7f7dca200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc40b2e50 con 0x7f7dc40cd780 2024-08-17T02:26:28.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.155+0000 7f7dca200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc40b3130 con 0x7f7dc415bbd0 2024-08-17T02:26:28.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.155+0000 7f7dc8e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc40cc7e0 0x7f7dc41487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.155+0000 7f7dc8e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc40cc7e0 0x7f7dc41487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59140/0 (socket says 172.21.15.6:59140) 2024-08-17T02:26:28.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.155+0000 7f7dc8e00640 1 -- 172.21.15.6:0/1385726074 learned_addr learned my addr 172.21.15.6:0/1385726074 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:28.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.155+0000 7f7dbbe00640 1 --2- 172.21.15.6:0/1385726074 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7dc40cd780 0x7f7dc40c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.155+0000 7f7dc9800640 1 --2- 172.21.15.6:0/1385726074 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7dc415bbd0 0x7f7dc4158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.155+0000 7f7dc8e00640 1 -- 172.21.15.6:0/1385726074 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7dc415bbd0 msgr2=0x7f7dc4158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.155+0000 7f7dc8e00640 1 --2- 172.21.15.6:0/1385726074 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7dc415bbd0 0x7f7dc4158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.155+0000 7f7dc8e00640 1 -- 172.21.15.6:0/1385726074 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7dc40cd780 msgr2=0x7f7dc40c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.155+0000 7f7dc8e00640 1 --2- 172.21.15.6:0/1385726074 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7dc40cd780 0x7f7dc40c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.155+0000 7f7dc8e00640 1 -- 172.21.15.6:0/1385726074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc009a20 con 0x7f7dc40cc7e0 2024-08-17T02:26:28.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.155+0000 7f7dc9800640 1 --2- 172.21.15.6:0/1385726074 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7dc415bbd0 0x7f7dc4158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:28.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.156+0000 7f7dc8e00640 1 --2- 172.21.15.6:0/1385726074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc40cc7e0 0x7f7dc41487e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7db400e950 tx=0x7f7db40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.156+0000 7f7dc0c00640 1 -- 172.21.15.6:0/1385726074 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db400c8e0 con 0x7f7dc40cc7e0 2024-08-17T02:26:28.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.156+0000 7f7dc0c00640 1 -- 172.21.15.6:0/1385726074 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db400ca60 con 0x7f7dc40cc7e0 2024-08-17T02:26:28.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.156+0000 7f7dca200640 1 -- 172.21.15.6:0/1385726074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc40b3410 con 0x7f7dc40cc7e0 2024-08-17T02:26:28.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.156+0000 7f7dc0c00640 1 -- 172.21.15.6:0/1385726074 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db400ce20 con 0x7f7dc40cc7e0 2024-08-17T02:26:28.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.156+0000 7f7dca200640 1 -- 172.21.15.6:0/1385726074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc40c8670 con 0x7f7dc40cc7e0 2024-08-17T02:26:28.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.157+0000 7f7dca200640 1 -- 172.21.15.6:0/1385726074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc40b1c90 con 0x7f7dc40cc7e0 2024-08-17T02:26:28.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.165+0000 7f7dc0c00640 1 -- 172.21.15.6:0/1385726074 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7db4013680 con 0x7f7dc40cc7e0 2024-08-17T02:26:28.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.166+0000 7f7dc0c00640 1 --2- 172.21.15.6:0/1385726074 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7da0065150 0x7f7da0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.166+0000 7f7dc0c00640 1 -- 172.21.15.6:0/1385726074 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7db40828f0 con 0x7f7dc40cc7e0 2024-08-17T02:26:28.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.168+0000 7f7dbbe00640 1 --2- 172.21.15.6:0/1385726074 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7da0065150 0x7f7da0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.169+0000 7f7dbbe00640 1 --2- 172.21.15.6:0/1385726074 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7da0065150 0x7f7da0067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40c9e70 tx=0x7f7dac007e20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.170+0000 7f7dc0c00640 1 -- 172.21.15.6:0/1385726074 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7db4050d90 con 0x7f7dc40cc7e0 2024-08-17T02:26:28.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.363+0000 7f7dca200640 1 -- 172.21.15.6:0/1385726074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7dc40b1c90 con 0x7f7dc40cc7e0 2024-08-17T02:26:28.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.363+0000 7f7dc0c00640 1 -- 172.21.15.6:0/1385726074 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7dc40b1c90 con 0x7f7dc40cc7e0 2024-08-17T02:26:28.364 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-08-17T02:26:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.365+0000 7f7dca200640 1 -- 172.21.15.6:0/1385726074 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7da0065150 msgr2=0x7f7da0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.365+0000 7f7dca200640 1 --2- 172.21.15.6:0/1385726074 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7da0065150 0x7f7da0067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40c9e70 tx=0x7f7dac007e20 comp rx=0 tx=0).stop 2024-08-17T02:26:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.365+0000 7f7dca200640 1 -- 172.21.15.6:0/1385726074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc40cc7e0 msgr2=0x7f7dc41487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.365+0000 7f7dca200640 1 --2- 172.21.15.6:0/1385726074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc40cc7e0 0x7f7dc41487e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7db400e950 tx=0x7f7db40091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.365+0000 7f7dca200640 1 -- 172.21.15.6:0/1385726074 shutdown_connections 2024-08-17T02:26:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.365+0000 7f7dca200640 1 --2- 172.21.15.6:0/1385726074 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7da0065150 0x7f7da0067600 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.365+0000 7f7dca200640 1 --2- 172.21.15.6:0/1385726074 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7dc415bbd0 0x7f7dc4158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.365+0000 7f7dca200640 1 --2- 172.21.15.6:0/1385726074 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7dc40cd780 0x7f7dc40c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.365+0000 7f7dca200640 1 --2- 172.21.15.6:0/1385726074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc40cc7e0 0x7f7dc41487e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.365+0000 7f7dca200640 1 -- 172.21.15.6:0/1385726074 >> 172.21.15.6:0/1385726074 conn(0x7f7dc4087a80 msgr2=0x7f7dc40ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.365+0000 7f7dca200640 1 -- 172.21.15.6:0/1385726074 shutdown_connections 2024-08-17T02:26:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.366+0000 7f7dca200640 1 -- 172.21.15.6:0/1385726074 wait complete. 2024-08-17T02:26:28.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:26:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.530+0000 7fb178a00640 1 Processor -- start 2024-08-17T02:26:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.531+0000 7fb178a00640 1 -- start start 2024-08-17T02:26:28.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.532+0000 7fb178a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb174158c90 0x7fb1740ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.532+0000 7fb178a00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb1740cadc0 0x7fb1740cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.532+0000 7fb178a00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1740cf600 con 0x7fb1740cca40 2024-08-17T02:26:28.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.532+0000 7fb178a00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1740cea90 con 0x7fb1740cadc0 2024-08-17T02:26:28.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.532+0000 7fb178a00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1740ced30 con 0x7fb174158c90 2024-08-17T02:26:28.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.532+0000 7fb172a00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb1740cadc0 0x7fb1740cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.532+0000 7fb173e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb1740cca40 0x7fb1740685f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60744/0 (socket says 172.21.15.6:60744) 2024-08-17T02:26:28.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.532+0000 7fb173e00640 1 -- 172.21.15.6:0/2720615674 learned_addr learned my addr 172.21.15.6:0/2720615674 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:28.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.532+0000 7fb173400640 1 --2- 172.21.15.6:0/2720615674 >> v2:172.21.15.136:3300/0 conn(0x7fb174158c90 0x7fb1740ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.532+0000 7fb172a00640 1 -- 172.21.15.6:0/2720615674 >> v2:172.21.15.136:3300/0 conn(0x7fb174158c90 msgr2=0x7fb1740ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:28.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.532+0000 7fb172a00640 1 --2- 172.21.15.6:0/2720615674 >> v2:172.21.15.136:3300/0 conn(0x7fb174158c90 0x7fb1740ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.532+0000 7fb172a00640 1 -- 172.21.15.6:0/2720615674 >> v1:172.21.15.6:6789/0 conn(0x7fb1740cca40 legacy=0x7fb1740685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.532+0000 7fb172a00640 1 -- 172.21.15.6:0/2720615674 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1740cefd0 con 0x7fb1740cadc0 2024-08-17T02:26:28.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.533+0000 7fb172a00640 1 --2- 172.21.15.6:0/2720615674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1740cadc0 0x7fb1740cc500 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb17406f380 tx=0x7fb1600090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edebd67ff4f3472f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.534+0000 7fb172000640 1 -- 172.21.15.6:0/2720615674 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16002adb0 con 0x7fb1740cadc0 2024-08-17T02:26:28.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.534+0000 7fb172000640 1 -- 172.21.15.6:0/2720615674 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb160032440 con 0x7fb1740cadc0 2024-08-17T02:26:28.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.534+0000 7fb172000640 1 -- 172.21.15.6:0/2720615674 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160032820 con 0x7fb1740cadc0 2024-08-17T02:26:28.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.534+0000 7fb178a00640 1 -- 172.21.15.6:0/2720615674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1740cadc0 msgr2=0x7fb1740cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.534+0000 7fb178a00640 1 --2- 172.21.15.6:0/2720615674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1740cadc0 0x7fb1740cc500 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb17406f380 tx=0x7fb1600090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.534+0000 7fb178a00640 1 -- 172.21.15.6:0/2720615674 shutdown_connections 2024-08-17T02:26:28.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.534+0000 7fb178a00640 1 --2- 172.21.15.6:0/2720615674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1740cadc0 0x7fb1740cc500 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.534+0000 7fb178a00640 1 --2- 172.21.15.6:0/2720615674 >> v2:172.21.15.136:3300/0 conn(0x7fb174158c90 0x7fb1740ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.534+0000 7fb178a00640 1 -- 172.21.15.6:0/2720615674 >> 172.21.15.6:0/2720615674 conn(0x7fb174087a80 msgr2=0x7fb17406e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:28.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.534+0000 7fb178a00640 1 -- 172.21.15.6:0/2720615674 shutdown_connections 2024-08-17T02:26:28.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.534+0000 7fb178a00640 1 -- 172.21.15.6:0/2720615674 wait complete. 2024-08-17T02:26:28.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.536+0000 7fb178a00640 1 Processor -- start 2024-08-17T02:26:28.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.536+0000 7fb178a00640 1 -- start start 2024-08-17T02:26:28.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.537+0000 7fb178a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1740cadc0 0x7fb1740c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.537+0000 7fb178a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1740cca40 0x7fb17413fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.537+0000 7fb178a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb174158c90 0x7fb1740c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.537+0000 7fb178a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb174155fb0 con 0x7fb1740cca40 2024-08-17T02:26:28.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.537+0000 7fb178a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1740c77a0 con 0x7fb1740cadc0 2024-08-17T02:26:28.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.537+0000 7fb178a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1740c7a80 con 0x7fb174158c90 2024-08-17T02:26:28.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.537+0000 7fb172a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1740cca40 0x7fb17413fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.537+0000 7fb172a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1740cca40 0x7fb17413fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59162/0 (socket says 172.21.15.6:59162) 2024-08-17T02:26:28.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.537+0000 7fb172a00640 1 -- 172.21.15.6:0/3457381974 learned_addr learned my addr 172.21.15.6:0/3457381974 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:28.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.537+0000 7fb173400640 1 --2- 172.21.15.6:0/3457381974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1740cadc0 0x7fb1740c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.537+0000 7fb173e00640 1 --2- 172.21.15.6:0/3457381974 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb174158c90 0x7fb1740c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.537+0000 7fb172a00640 1 -- 172.21.15.6:0/3457381974 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb174158c90 msgr2=0x7fb1740c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.537+0000 7fb172a00640 1 --2- 172.21.15.6:0/3457381974 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb174158c90 0x7fb1740c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.537+0000 7fb172a00640 1 -- 172.21.15.6:0/3457381974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1740cadc0 msgr2=0x7fb1740c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.537+0000 7fb172a00640 1 --2- 172.21.15.6:0/3457381974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1740cadc0 0x7fb1740c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.537+0000 7fb172a00640 1 -- 172.21.15.6:0/3457381974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb160009390 con 0x7fb1740cca40 2024-08-17T02:26:28.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.538+0000 7fb172a00640 1 --2- 172.21.15.6:0/3457381974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1740cca40 0x7fb17413fa00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb160009360 tx=0x7fb160032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.538+0000 7fb16aa00640 1 -- 172.21.15.6:0/3457381974 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160000d10 con 0x7fb1740cca40 2024-08-17T02:26:28.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.538+0000 7fb16aa00640 1 -- 172.21.15.6:0/3457381974 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb160031de0 con 0x7fb1740cca40 2024-08-17T02:26:28.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.538+0000 7fb16aa00640 1 -- 172.21.15.6:0/3457381974 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16003d670 con 0x7fb1740cca40 2024-08-17T02:26:28.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.538+0000 7fb178a00640 1 -- 172.21.15.6:0/3457381974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1740c7d60 con 0x7fb1740cca40 2024-08-17T02:26:28.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.538+0000 7fb178a00640 1 -- 172.21.15.6:0/3457381974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1740c8320 con 0x7fb1740cca40 2024-08-17T02:26:28.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.539+0000 7fb178a00640 1 -- 172.21.15.6:0/3457381974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1740c8540 con 0x7fb1740cca40 2024-08-17T02:26:28.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.540+0000 7fb16aa00640 1 -- 172.21.15.6:0/3457381974 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb160039040 con 0x7fb1740cca40 2024-08-17T02:26:28.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.541+0000 7fb16aa00640 1 --2- 172.21.15.6:0/3457381974 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb154065150 0x7fb154067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.541+0000 7fb16aa00640 1 -- 172.21.15.6:0/3457381974 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb1600a1ff0 con 0x7fb1740cca40 2024-08-17T02:26:28.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.541+0000 7fb173400640 1 --2- 172.21.15.6:0/3457381974 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb154065150 0x7fb154067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.542+0000 7fb173400640 1 --2- 172.21.15.6:0/3457381974 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb154065150 0x7fb154067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb164009c80 tx=0x7fb1640090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.544+0000 7fb16aa00640 1 -- 172.21.15.6:0/3457381974 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb160070410 con 0x7fb1740cca40 2024-08-17T02:26:28.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.730+0000 7fb178a00640 1 -- 172.21.15.6:0/3457381974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb174070720 con 0x7fb1740cca40 2024-08-17T02:26:28.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.845+0000 7fb16aa00640 1 -- 172.21.15.6:0/3457381974 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb160073a30 con 0x7fb1740cca40 2024-08-17T02:26:28.846 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:28.846 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-08-17T02:26:28.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:26:28.847 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-08-17T02:26:28.847 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-08-17T02:26:28.847 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:26:28.847 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-08-17T02:26:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.847+0000 7fb178a00640 1 -- 172.21.15.6:0/3457381974 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb154065150 msgr2=0x7fb154067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.847+0000 7fb178a00640 1 --2- 172.21.15.6:0/3457381974 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb154065150 0x7fb154067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb164009c80 tx=0x7fb1640090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.847+0000 7fb178a00640 1 -- 172.21.15.6:0/3457381974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1740cca40 msgr2=0x7fb17413fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.847+0000 7fb178a00640 1 --2- 172.21.15.6:0/3457381974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1740cca40 0x7fb17413fa00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb160009360 tx=0x7fb160032000 comp rx=0 tx=0).stop 2024-08-17T02:26:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.847+0000 7fb178a00640 1 -- 172.21.15.6:0/3457381974 shutdown_connections 2024-08-17T02:26:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.847+0000 7fb178a00640 1 --2- 172.21.15.6:0/3457381974 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb154065150 0x7fb154067600 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.847+0000 7fb178a00640 1 --2- 172.21.15.6:0/3457381974 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb174158c90 0x7fb1740c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.847+0000 7fb178a00640 1 --2- 172.21.15.6:0/3457381974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1740cca40 0x7fb17413fa00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.847+0000 7fb178a00640 1 --2- 172.21.15.6:0/3457381974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1740cadc0 0x7fb1740c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.847+0000 7fb178a00640 1 -- 172.21.15.6:0/3457381974 >> 172.21.15.6:0/3457381974 conn(0x7fb174087a80 msgr2=0x7fb1740cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.848+0000 7fb178a00640 1 -- 172.21.15.6:0/3457381974 shutdown_connections 2024-08-17T02:26:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:28.848+0000 7fb178a00640 1 -- 172.21.15.6:0/3457381974 wait complete. 2024-08-17T02:26:28.863 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:26:28.864 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:26:29.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.018+0000 7fcdc0c00640 1 Processor -- start 2024-08-17T02:26:29.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.018+0000 7fcdc0c00640 1 -- start start 2024-08-17T02:26:29.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.019+0000 7fcdc0c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcdbc0ad020 0x7fcdbc159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.019+0000 7fcdc0c00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdbc159ad0 con 0x7fcdbc0ac000 2024-08-17T02:26:29.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.019+0000 7fcdc0c00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdbc0ad590 con 0x7fcdbc0afa00 2024-08-17T02:26:29.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.019+0000 7fcdc0c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0ad870 con 0x7fcdbc0ad020 2024-08-17T02:26:29.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.020+0000 7fcdb9e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcdbc0ac000 0x7fcdbc156a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60760/0 (socket says 172.21.15.6:60760) 2024-08-17T02:26:29.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.020+0000 7fcdb9e00640 1 -- 172.21.15.6:0/2619835666 learned_addr learned my addr 172.21.15.6:0/2619835666 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:29.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.020+0000 7fcdb1400640 1 --2- 172.21.15.6:0/2619835666 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcdbc0ad020 0x7fcdbc159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.020+0000 7fcdb9400640 1 -- 172.21.15.6:0/2619835666 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205785093 0 0) 0x7fcdbc159ad0 con 0x7fcdbc0ac000 2024-08-17T02:26:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.020+0000 7fcdb9400640 1 -- 172.21.15.6:0/2619835666 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcda00034e0 con 0x7fcdbc0ac000 2024-08-17T02:26:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.020+0000 7fcdb9400640 1 -- 172.21.15.6:0/2619835666 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288715766 0 0) 0x7fcdbc0ad590 con 0x7fcdbc0afa00 2024-08-17T02:26:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.020+0000 7fcdb9400640 1 -- 172.21.15.6:0/2619835666 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdbc159ad0 con 0x7fcdbc0afa00 2024-08-17T02:26:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.020+0000 7fcdb9400640 1 -- 172.21.15.6:0/2619835666 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 800619112 0 0) 0x7fcda00034e0 con 0x7fcdbc0ac000 2024-08-17T02:26:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.020+0000 7fcdb9400640 1 -- 172.21.15.6:0/2619835666 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcdbc0ad020 msgr2=0x7fcdbc159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.020+0000 7fcdb9400640 1 --2- 172.21.15.6:0/2619835666 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcdbc0ad020 0x7fcdbc159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.020+0000 7fcdb9400640 1 -- 172.21.15.6:0/2619835666 >> v1:172.21.15.136:6789/0 conn(0x7fcdbc0afa00 legacy=0x7fcdbc157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.020+0000 7fcdb9400640 1 -- 172.21.15.6:0/2619835666 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc0adb50 con 0x7fcdbc0ac000 2024-08-17T02:26:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.020+0000 7fcdb9400640 1 -- 172.21.15.6:0/2619835666 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7fcdac001470 con 0x7fcdbc0ac000 2024-08-17T02:26:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.020+0000 7fcdb9400640 1 -- 172.21.15.6:0/2619835666 >> v1:172.21.15.6:6789/0 conn(0x7fcdbc0ac000 legacy=0x7fcdbc156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.021+0000 7fcdb9400640 1 --2- 172.21.15.6:0/2619835666 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcdbc0ad020 0x7fcda0003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.021+0000 7fcdb9400640 1 --2- 172.21.15.6:0/2619835666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcda00040f0 0x7fcda0004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.021+0000 7fcdb9400640 1 --2- 172.21.15.6:0/2619835666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda0004cc0 0x7fcda0005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.021+0000 7fcdb9400640 1 -- 172.21.15.6:0/2619835666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0ad870 con 0x7fcda0004cc0 2024-08-17T02:26:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.021+0000 7fcdb9400640 1 -- 172.21.15.6:0/2619835666 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda000bb10 con 0x7fcda00040f0 2024-08-17T02:26:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.021+0000 7fcdb9400640 1 -- 172.21.15.6:0/2619835666 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda000bcd0 con 0x7fcdbc0ad020 2024-08-17T02:26:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.021+0000 7fcdba800640 1 --2- 172.21.15.6:0/2619835666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda0004cc0 0x7fcda0005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.021+0000 7fcdb1400640 1 --2- 172.21.15.6:0/2619835666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcda00040f0 0x7fcda0004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.021+0000 7fcdb9e00640 1 --2- 172.21.15.6:0/2619835666 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcdbc0ad020 0x7fcda0003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.021+0000 7fcdba800640 1 -- 172.21.15.6:0/2619835666 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcdbc0ad020 msgr2=0x7fcda0003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.021+0000 7fcdba800640 1 --2- 172.21.15.6:0/2619835666 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcdbc0ad020 0x7fcda0003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.021+0000 7fcdba800640 1 -- 172.21.15.6:0/2619835666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcda00040f0 msgr2=0x7fcda0004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.021+0000 7fcdba800640 1 --2- 172.21.15.6:0/2619835666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcda00040f0 0x7fcda0004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.021+0000 7fcdba800640 1 -- 172.21.15.6:0/2619835666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda00034e0 con 0x7fcda0004cc0 2024-08-17T02:26:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.022+0000 7fcdba800640 1 --2- 172.21.15.6:0/2619835666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda0004cc0 0x7fcda0005130 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4002080 tx=0x7fcdb4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8167e0608fda8dad server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.022+0000 7fcdb9400640 1 -- 172.21.15.6:0/2619835666 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4031440 con 0x7fcda0004cc0 2024-08-17T02:26:29.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.022+0000 7fcdb9400640 1 -- 172.21.15.6:0/2619835666 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb402d050 con 0x7fcda0004cc0 2024-08-17T02:26:29.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.023+0000 7fcdb9400640 1 -- 172.21.15.6:0/2619835666 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4031830 con 0x7fcda0004cc0 2024-08-17T02:26:29.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.023+0000 7fcdc0c00640 1 -- 172.21.15.6:0/2619835666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda0004cc0 msgr2=0x7fcda0005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.023+0000 7fcdc0c00640 1 --2- 172.21.15.6:0/2619835666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda0004cc0 0x7fcda0005130 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4002080 tx=0x7fcdb4007f90 comp rx=0 tx=0).stop 2024-08-17T02:26:29.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.023+0000 7fcdba800640 1 -- 172.21.15.6:0/2619835666 reap_dead start 2024-08-17T02:26:29.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.023+0000 7fcdc0c00640 1 -- 172.21.15.6:0/2619835666 shutdown_connections 2024-08-17T02:26:29.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.023+0000 7fcdc0c00640 1 -- 172.21.15.6:0/2619835666 >> 172.21.15.6:0/2619835666 conn(0x7fcdbc066e60 msgr2=0x7fcdbc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:29.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.023+0000 7fcdc0c00640 1 -- 172.21.15.6:0/2619835666 shutdown_connections 2024-08-17T02:26:29.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.023+0000 7fcdc0c00640 1 -- 172.21.15.6:0/2619835666 wait complete. 2024-08-17T02:26:29.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.025+0000 7fcdc0c00640 1 Processor -- start 2024-08-17T02:26:29.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.025+0000 7fcdc0c00640 1 -- start start 2024-08-17T02:26:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.025+0000 7fcdc0c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcda0004cc0 0x7fcdbc0c3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.025+0000 7fcdc0c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdbc154f30 0x7fcdbc153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.026+0000 7fcdc0c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdbc154470 0x7fcdbc158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.026+0000 7fcdc0c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0c1600 con 0x7fcdbc154470 2024-08-17T02:26:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.026+0000 7fcdc0c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0c18a0 con 0x7fcdbc154f30 2024-08-17T02:26:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.026+0000 7fcdc0c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0c2840 con 0x7fcda0004cc0 2024-08-17T02:26:29.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.026+0000 7fcdba800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdbc154470 0x7fcdbc158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.026+0000 7fcdba800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdbc154470 0x7fcdbc158840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59188/0 (socket says 172.21.15.6:59188) 2024-08-17T02:26:29.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.026+0000 7fcdba800640 1 -- 172.21.15.6:0/2661061863 learned_addr learned my addr 172.21.15.6:0/2661061863 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:29.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.026+0000 7fcdb1400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdbc154f30 0x7fcdbc153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.026+0000 7fcdb9e00640 1 --2- 172.21.15.6:0/2661061863 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcda0004cc0 0x7fcdbc0c3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.026+0000 7fcdba800640 1 -- 172.21.15.6:0/2661061863 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcda0004cc0 msgr2=0x7fcdbc0c3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.026+0000 7fcdba800640 1 --2- 172.21.15.6:0/2661061863 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcda0004cc0 0x7fcdbc0c3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.026+0000 7fcdba800640 1 -- 172.21.15.6:0/2661061863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdbc154f30 msgr2=0x7fcdbc153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.026+0000 7fcdba800640 1 --2- 172.21.15.6:0/2661061863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdbc154f30 0x7fcdbc153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.026+0000 7fcdba800640 1 -- 172.21.15.6:0/2661061863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc0c2b20 con 0x7fcdbc154470 2024-08-17T02:26:29.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.026+0000 7fcdba800640 1 --2- 172.21.15.6:0/2661061863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdbc154470 0x7fcdbc158840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4001b00 tx=0x7fcdb4034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.027+0000 7fcdb2000640 1 -- 172.21.15.6:0/2661061863 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb403d610 con 0x7fcdbc154470 2024-08-17T02:26:29.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.027+0000 7fcdb2000640 1 -- 172.21.15.6:0/2661061863 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb403d770 con 0x7fcdbc154470 2024-08-17T02:26:29.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.027+0000 7fcdb2000640 1 -- 172.21.15.6:0/2661061863 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb403db10 con 0x7fcdbc154470 2024-08-17T02:26:29.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.027+0000 7fcdc0c00640 1 -- 172.21.15.6:0/2661061863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdbc0aa710 con 0x7fcdbc154470 2024-08-17T02:26:29.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.027+0000 7fcdc0c00640 1 -- 172.21.15.6:0/2661061863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdbc158f20 con 0x7fcdbc154470 2024-08-17T02:26:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.028+0000 7fcdc0c00640 1 -- 172.21.15.6:0/2661061863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdbc063fb0 con 0x7fcdbc154470 2024-08-17T02:26:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.029+0000 7fcdb2000640 1 -- 172.21.15.6:0/2661061863 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcdb4038070 con 0x7fcdbc154470 2024-08-17T02:26:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.030+0000 7fcdb2000640 1 --2- 172.21.15.6:0/2661061863 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fcd98065180 0x7fcd98067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.030+0000 7fcdb2000640 1 -- 172.21.15.6:0/2661061863 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fcdb40a2880 con 0x7fcdbc154470 2024-08-17T02:26:29.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.030+0000 7fcdb9e00640 1 --2- 172.21.15.6:0/2661061863 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fcd98065180 0x7fcd98067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.031+0000 7fcdb9e00640 1 --2- 172.21.15.6:0/2661061863 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fcd98065180 0x7fcd98067630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcdac000e10 tx=0x7fcdac007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.034+0000 7fcdb2000640 1 -- 172.21.15.6:0/2661061863 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcdb4070d20 con 0x7fcdbc154470 2024-08-17T02:26:29.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:29.216+0000 7fcdc0c00640 1 -- 172.21.15.6:0/2661061863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcdbc0aaa80 con 0x7fcdbc154470 2024-08-17T02:26:30.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.167+0000 7fcdb2000640 1 -- 172.21.15.6:0/2661061863 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcdb4074340 con 0x7fcdbc154470 2024-08-17T02:26:30.168 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-08-17T02:26:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.172+0000 7fcdc0c00640 1 -- 172.21.15.6:0/2661061863 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fcd98065180 msgr2=0x7fcd98067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.172+0000 7fcdc0c00640 1 --2- 172.21.15.6:0/2661061863 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fcd98065180 0x7fcd98067630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcdac000e10 tx=0x7fcdac007040 comp rx=0 tx=0).stop 2024-08-17T02:26:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.172+0000 7fcdc0c00640 1 -- 172.21.15.6:0/2661061863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdbc154470 msgr2=0x7fcdbc158840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.172+0000 7fcdc0c00640 1 --2- 172.21.15.6:0/2661061863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdbc154470 0x7fcdbc158840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4001b00 tx=0x7fcdb4034000 comp rx=0 tx=0).stop 2024-08-17T02:26:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.173+0000 7fcdc0c00640 1 -- 172.21.15.6:0/2661061863 shutdown_connections 2024-08-17T02:26:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.173+0000 7fcdc0c00640 1 --2- 172.21.15.6:0/2661061863 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fcd98065180 0x7fcd98067630 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.173+0000 7fcdc0c00640 1 --2- 172.21.15.6:0/2661061863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdbc154470 0x7fcdbc158840 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.173+0000 7fcdc0c00640 1 --2- 172.21.15.6:0/2661061863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcdbc154f30 0x7fcdbc153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.173+0000 7fcdc0c00640 1 --2- 172.21.15.6:0/2661061863 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcda0004cc0 0x7fcdbc0c3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.173+0000 7fcdc0c00640 1 -- 172.21.15.6:0/2661061863 >> 172.21.15.6:0/2661061863 conn(0x7fcdbc066e60 msgr2=0x7fcdbc0ab1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.173+0000 7fcdc0c00640 1 -- 172.21.15.6:0/2661061863 shutdown_connections 2024-08-17T02:26:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.174+0000 7fcdc0c00640 1 -- 172.21.15.6:0/2661061863 wait complete. 2024-08-17T02:26:30.195 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:26:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.356+0000 7f3318400640 1 Processor -- start 2024-08-17T02:26:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.356+0000 7f3318400640 1 -- start start 2024-08-17T02:26:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.357+0000 7f3318400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f33100afca0 0x7f33100b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.357+0000 7f3318400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f33101590b0 0x7f3310159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.357+0000 7f3318400640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331015a4e0 con 0x7f33100acf10 2024-08-17T02:26:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.357+0000 7f3318400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33100b0980 con 0x7f33101590b0 2024-08-17T02:26:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.357+0000 7f3318400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33100c92b0 con 0x7f33100afca0 2024-08-17T02:26:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.357+0000 7f3315000640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f33100acf10 0x7f33101589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60774/0 (socket says 172.21.15.6:60774) 2024-08-17T02:26:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.357+0000 7f3315000640 1 -- 172.21.15.6:0/3662426056 learned_addr learned my addr 172.21.15.6:0/3662426056 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f3315a00640 1 --2- 172.21.15.6:0/3662426056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f33100afca0 0x7f33100b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f3316400640 1 --2- 172.21.15.6:0/3662426056 >> v2:172.21.15.136:3300/0 conn(0x7f33101590b0 0x7f3310159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f330fe00640 1 -- 172.21.15.6:0/3662426056 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580994309 0 0) 0x7f32fc001110 con 0x7f33100acf10 2024-08-17T02:26:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f330fe00640 1 -- 172.21.15.6:0/3662426056 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32f80034e0 con 0x7f33100acf10 2024-08-17T02:26:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f330fe00640 1 -- 172.21.15.6:0/3662426056 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3817775277 0 0) 0x7f32f80034e0 con 0x7f33100acf10 2024-08-17T02:26:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f330fe00640 1 -- 172.21.15.6:0/3662426056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f33100afca0 msgr2=0x7f33100b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f330fe00640 1 --2- 172.21.15.6:0/3662426056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f33100afca0 0x7f33100b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f330fe00640 1 -- 172.21.15.6:0/3662426056 >> v2:172.21.15.136:3300/0 conn(0x7f33101590b0 msgr2=0x7f3310159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f330fe00640 1 --2- 172.21.15.6:0/3662426056 >> v2:172.21.15.136:3300/0 conn(0x7f33101590b0 0x7f3310159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f330fe00640 1 -- 172.21.15.6:0/3662426056 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33100ad480 con 0x7f33100acf10 2024-08-17T02:26:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f330fe00640 1 -- 172.21.15.6:0/3662426056 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f32fc001600 con 0x7f33100acf10 2024-08-17T02:26:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f330fe00640 1 -- 172.21.15.6:0/3662426056 >> v1:172.21.15.6:6789/0 conn(0x7f33100acf10 legacy=0x7f33101589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f330fe00640 1 --2- 172.21.15.6:0/3662426056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f33100afca0 0x7f32f80039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f330fe00640 1 --2- 172.21.15.6:0/3662426056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32f8003f50 0x7f32f8004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f330fe00640 1 --2- 172.21.15.6:0/3662426056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32f8004cc0 0x7f32f8005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f330fe00640 1 -- 172.21.15.6:0/3662426056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33100c92b0 con 0x7f32f8004cc0 2024-08-17T02:26:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f330fe00640 1 -- 172.21.15.6:0/3662426056 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f800b9d0 con 0x7f32f8003f50 2024-08-17T02:26:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.358+0000 7f330fe00640 1 -- 172.21.15.6:0/3662426056 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f800bb40 con 0x7f33100afca0 2024-08-17T02:26:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.359+0000 7f3315000640 1 --2- 172.21.15.6:0/3662426056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32f8003f50 0x7f32f8004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.359+0000 7f3315a00640 1 --2- 172.21.15.6:0/3662426056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f33100afca0 0x7f32f80039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.359+0000 7f3316400640 1 --2- 172.21.15.6:0/3662426056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32f8004cc0 0x7f32f8005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.359+0000 7f3315000640 1 -- 172.21.15.6:0/3662426056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f33100afca0 msgr2=0x7f32f80039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.359+0000 7f3315000640 1 --2- 172.21.15.6:0/3662426056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f33100afca0 0x7f32f80039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.359+0000 7f3315000640 1 -- 172.21.15.6:0/3662426056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32f8004cc0 msgr2=0x7f32f8005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.359+0000 7f3315000640 1 --2- 172.21.15.6:0/3662426056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32f8004cc0 0x7f32f8005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.359+0000 7f3315000640 1 -- 172.21.15.6:0/3662426056 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f80034e0 con 0x7f32f8003f50 2024-08-17T02:26:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.360+0000 7f3315000640 1 --2- 172.21.15.6:0/3662426056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32f8003f50 0x7f32f8004780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00c440 tx=0x7f32fc0079f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91e66edb9758bf26 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.360+0000 7f330fe00640 1 -- 172.21.15.6:0/3662426056 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc005890 con 0x7f32f8003f50 2024-08-17T02:26:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.360+0000 7f330fe00640 1 -- 172.21.15.6:0/3662426056 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc005a10 con 0x7f32f8003f50 2024-08-17T02:26:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.360+0000 7f330fe00640 1 -- 172.21.15.6:0/3662426056 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc005e50 con 0x7f32f8003f50 2024-08-17T02:26:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.361+0000 7f3318400640 1 -- 172.21.15.6:0/3662426056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32f8003f50 msgr2=0x7f32f8004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.361+0000 7f3318400640 1 --2- 172.21.15.6:0/3662426056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32f8003f50 0x7f32f8004780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00c440 tx=0x7f32fc0079f0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.361+0000 7f3316400640 1 -- 172.21.15.6:0/3662426056 reap_dead start 2024-08-17T02:26:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.361+0000 7f3318400640 1 -- 172.21.15.6:0/3662426056 shutdown_connections 2024-08-17T02:26:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.361+0000 7f3318400640 1 -- 172.21.15.6:0/3662426056 >> 172.21.15.6:0/3662426056 conn(0x7f3310066e60 msgr2=0x7f3310067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.361+0000 7f3318400640 1 -- 172.21.15.6:0/3662426056 shutdown_connections 2024-08-17T02:26:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.361+0000 7f3318400640 1 -- 172.21.15.6:0/3662426056 wait complete. 2024-08-17T02:26:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.362+0000 7f3318400640 1 Processor -- start 2024-08-17T02:26:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.363+0000 7f3318400640 1 -- start start 2024-08-17T02:26:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.363+0000 7f3318400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f32f8003f50 0x7f33100c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.363+0000 7f3318400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33100a4a10 0x7f3310143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.363+0000 7f3318400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3310152010 0x7f3310152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.363+0000 7f3318400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33101529c0 con 0x7f3310152010 2024-08-17T02:26:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.364+0000 7f3318400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33100c7ac0 con 0x7f33100a4a10 2024-08-17T02:26:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.364+0000 7f3318400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33100c6c00 con 0x7f32f8003f50 2024-08-17T02:26:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.364+0000 7f3316400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3310152010 0x7f3310152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.364+0000 7f3316400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3310152010 0x7f3310152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59210/0 (socket says 172.21.15.6:59210) 2024-08-17T02:26:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.364+0000 7f3316400640 1 -- 172.21.15.6:0/3344041717 learned_addr learned my addr 172.21.15.6:0/3344041717 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.364+0000 7f3315000640 1 --2- 172.21.15.6:0/3344041717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33100a4a10 0x7f3310143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.364+0000 7f3315a00640 1 --2- 172.21.15.6:0/3344041717 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f32f8003f50 0x7f33100c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.364+0000 7f3316400640 1 -- 172.21.15.6:0/3344041717 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f32f8003f50 msgr2=0x7f33100c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.364+0000 7f3316400640 1 --2- 172.21.15.6:0/3344041717 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f32f8003f50 0x7f33100c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.364+0000 7f3316400640 1 -- 172.21.15.6:0/3344041717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33100a4a10 msgr2=0x7f3310143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.364+0000 7f3316400640 1 --2- 172.21.15.6:0/3344041717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33100a4a10 0x7f3310143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.364+0000 7f3316400640 1 -- 172.21.15.6:0/3344041717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33100c6eb0 con 0x7f3310152010 2024-08-17T02:26:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.365+0000 7f3316400640 1 --2- 172.21.15.6:0/3344041717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3310152010 0x7f3310152480 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f33101594f0 tx=0x7f330800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.365+0000 7f330cc00640 1 -- 172.21.15.6:0/3344041717 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330800e040 con 0x7f3310152010 2024-08-17T02:26:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.365+0000 7f330cc00640 1 -- 172.21.15.6:0/3344041717 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330800f040 con 0x7f3310152010 2024-08-17T02:26:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.365+0000 7f330cc00640 1 -- 172.21.15.6:0/3344041717 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3308015920 con 0x7f3310152010 2024-08-17T02:26:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.365+0000 7f3318400640 1 -- 172.21.15.6:0/3344041717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33100c7190 con 0x7f3310152010 2024-08-17T02:26:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.365+0000 7f3318400640 1 -- 172.21.15.6:0/3344041717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33100c7750 con 0x7f3310152010 2024-08-17T02:26:30.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.366+0000 7f3318400640 1 -- 172.21.15.6:0/3344041717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33100c7c30 con 0x7f3310152010 2024-08-17T02:26:30.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.367+0000 7f330cc00640 1 -- 172.21.15.6:0/3344041717 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3308015cd0 con 0x7f3310152010 2024-08-17T02:26:30.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.368+0000 7f330cc00640 1 --2- 172.21.15.6:0/3344041717 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f32f0065180 0x7f32f0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.368+0000 7f330cc00640 1 -- 172.21.15.6:0/3344041717 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f3308082280 con 0x7f3310152010 2024-08-17T02:26:30.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.368+0000 7f3315a00640 1 --2- 172.21.15.6:0/3344041717 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f32f0065180 0x7f32f0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.369+0000 7f3315a00640 1 --2- 172.21.15.6:0/3344041717 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f32f0065180 0x7f32f0067630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3304006e70 tx=0x7f33040090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.372+0000 7f330cc00640 1 -- 172.21.15.6:0/3344041717 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3308050530 con 0x7f3310152010 2024-08-17T02:26:30.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:30.556+0000 7f3318400640 1 -- 172.21.15.6:0/3344041717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3310063fb0 con 0x7f3310152010 2024-08-17T02:26:31.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.173+0000 7f330cc00640 1 -- 172.21.15.6:0/3344041717 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3308053b50 con 0x7f3310152010 2024-08-17T02:26:31.174 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-08-17T02:26:31.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.179+0000 7f3318400640 1 -- 172.21.15.6:0/3344041717 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f32f0065180 msgr2=0x7f32f0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.179+0000 7f3318400640 1 --2- 172.21.15.6:0/3344041717 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f32f0065180 0x7f32f0067630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3304006e70 tx=0x7f33040090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.179+0000 7f3318400640 1 -- 172.21.15.6:0/3344041717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3310152010 msgr2=0x7f3310152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.179+0000 7f3318400640 1 --2- 172.21.15.6:0/3344041717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3310152010 0x7f3310152480 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f33101594f0 tx=0x7f330800b040 comp rx=0 tx=0).stop 2024-08-17T02:26:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.184+0000 7f3318400640 1 -- 172.21.15.6:0/3344041717 shutdown_connections 2024-08-17T02:26:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.184+0000 7f3318400640 1 --2- 172.21.15.6:0/3344041717 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f32f0065180 0x7f32f0067630 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.184+0000 7f3318400640 1 --2- 172.21.15.6:0/3344041717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3310152010 0x7f3310152480 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.184+0000 7f3318400640 1 --2- 172.21.15.6:0/3344041717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33100a4a10 0x7f3310143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.184+0000 7f3318400640 1 --2- 172.21.15.6:0/3344041717 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f32f8003f50 0x7f33100c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.184+0000 7f3318400640 1 -- 172.21.15.6:0/3344041717 >> 172.21.15.6:0/3344041717 conn(0x7f3310066e60 msgr2=0x7f3310152cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:31.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.186+0000 7f3318400640 1 -- 172.21.15.6:0/3344041717 shutdown_connections 2024-08-17T02:26:31.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.187+0000 7f3318400640 1 -- 172.21.15.6:0/3344041717 wait complete. 2024-08-17T02:26:31.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:26:31.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.372+0000 7f344a600640 1 Processor -- start 2024-08-17T02:26:31.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.372+0000 7f344a600640 1 -- start start 2024-08-17T02:26:31.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.373+0000 7f344a600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f34440afca0 0x7f34440b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.373+0000 7f344a600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34440acf10 0x7f3444159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.373+0000 7f344a600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344415a4e0 con 0x7f34441589a0 2024-08-17T02:26:31.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.373+0000 7f344a600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34440b0980 con 0x7f34440afca0 2024-08-17T02:26:31.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.373+0000 7f344a600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34440c92b0 con 0x7f34440acf10 2024-08-17T02:26:31.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.374+0000 7f3443400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f34440afca0 0x7f34440b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.374+0000 7f3442a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34440acf10 0x7f3444159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.374+0000 7f3443e00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f34441589a0 0x7f344406d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:58038/0 (socket says 172.21.15.6:58038) 2024-08-17T02:26:31.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.374+0000 7f3443e00640 1 -- 172.21.15.6:0/106041565 learned_addr learned my addr 172.21.15.6:0/106041565 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:31.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.374+0000 7f3443400640 1 -- 172.21.15.6:0/106041565 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34440acf10 msgr2=0x7f3444159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:31.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.374+0000 7f3443400640 1 --2- 172.21.15.6:0/106041565 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34440acf10 0x7f3444159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.374+0000 7f3443400640 1 -- 172.21.15.6:0/106041565 >> v1:172.21.15.136:6789/0 conn(0x7f34441589a0 legacy=0x7f344406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.375+0000 7f3443400640 1 -- 172.21.15.6:0/106041565 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34440ad480 con 0x7f34440afca0 2024-08-17T02:26:31.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.376+0000 7f3443400640 1 --2- 172.21.15.6:0/106041565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34440afca0 0x7f34440b0070 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3434009880 tx=0x7f34340090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcb2069b64daee51 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.376+0000 7f3442000640 1 -- 172.21.15.6:0/106041565 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343402ad90 con 0x7f34440afca0 2024-08-17T02:26:31.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.376+0000 7f3442000640 1 -- 172.21.15.6:0/106041565 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3434032440 con 0x7f34440afca0 2024-08-17T02:26:31.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.376+0000 7f3442000640 1 -- 172.21.15.6:0/106041565 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434032820 con 0x7f34440afca0 2024-08-17T02:26:31.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.376+0000 7f344a600640 1 -- 172.21.15.6:0/106041565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34440afca0 msgr2=0x7f34440b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.376+0000 7f344a600640 1 --2- 172.21.15.6:0/106041565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34440afca0 0x7f34440b0070 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3434009880 tx=0x7f34340090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.376+0000 7f344a600640 1 -- 172.21.15.6:0/106041565 shutdown_connections 2024-08-17T02:26:31.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.376+0000 7f344a600640 1 --2- 172.21.15.6:0/106041565 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34440acf10 0x7f3444159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.376+0000 7f344a600640 1 --2- 172.21.15.6:0/106041565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34440afca0 0x7f34440b0070 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.376+0000 7f344a600640 1 -- 172.21.15.6:0/106041565 >> 172.21.15.6:0/106041565 conn(0x7f3444066e60 msgr2=0x7f3444067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:31.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.377+0000 7f344a600640 1 -- 172.21.15.6:0/106041565 shutdown_connections 2024-08-17T02:26:31.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.377+0000 7f344a600640 1 -- 172.21.15.6:0/106041565 wait complete. 2024-08-17T02:26:31.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.378+0000 7f344a600640 1 Processor -- start 2024-08-17T02:26:31.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.378+0000 7f344a600640 1 -- start start 2024-08-17T02:26:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.379+0000 7f344a600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34440acf10 0x7f34441559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.379+0000 7f344a600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34440afca0 0x7f344414c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.379+0000 7f344a600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34441589a0 0x7f34441573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.379+0000 7f344a600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3444150460 con 0x7f34440afca0 2024-08-17T02:26:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.379+0000 7f344a600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3444156db0 con 0x7f34440acf10 2024-08-17T02:26:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.379+0000 7f344a600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3444155f20 con 0x7f34441589a0 2024-08-17T02:26:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.379+0000 7f3442a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34440afca0 0x7f344414c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.379+0000 7f3442a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34440afca0 0x7f344414c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59212/0 (socket says 172.21.15.6:59212) 2024-08-17T02:26:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.379+0000 7f3442a00640 1 -- 172.21.15.6:0/2809425302 learned_addr learned my addr 172.21.15.6:0/2809425302 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.379+0000 7f3443e00640 1 --2- 172.21.15.6:0/2809425302 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34441589a0 0x7f34441573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.379+0000 7f3443400640 1 --2- 172.21.15.6:0/2809425302 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34440acf10 0x7f34441559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.380+0000 7f3442a00640 1 -- 172.21.15.6:0/2809425302 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34441589a0 msgr2=0x7f34441573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.380+0000 7f3442a00640 1 --2- 172.21.15.6:0/2809425302 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34441589a0 0x7f34441573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.380+0000 7f3442a00640 1 -- 172.21.15.6:0/2809425302 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34440acf10 msgr2=0x7f34441559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.380+0000 7f3442a00640 1 --2- 172.21.15.6:0/2809425302 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34440acf10 0x7f34441559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.380+0000 7f3442a00640 1 -- 172.21.15.6:0/2809425302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3434009390 con 0x7f34440afca0 2024-08-17T02:26:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.380+0000 7f3442a00640 1 --2- 172.21.15.6:0/2809425302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34440afca0 0x7f344414c4a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f343000ea50 tx=0x7f34300090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.380+0000 7f343aa00640 1 -- 172.21.15.6:0/2809425302 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343000caa0 con 0x7f34440afca0 2024-08-17T02:26:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.380+0000 7f343aa00640 1 -- 172.21.15.6:0/2809425302 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343000cc00 con 0x7f34440afca0 2024-08-17T02:26:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.380+0000 7f343aa00640 1 -- 172.21.15.6:0/2809425302 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430013470 con 0x7f34440afca0 2024-08-17T02:26:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.380+0000 7f344a600640 1 -- 172.21.15.6:0/2809425302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f344414c9e0 con 0x7f34440afca0 2024-08-17T02:26:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.380+0000 7f344a600640 1 -- 172.21.15.6:0/2809425302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3444156480 con 0x7f34440afca0 2024-08-17T02:26:31.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.381+0000 7f344a600640 1 -- 172.21.15.6:0/2809425302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3444063fb0 con 0x7f34440afca0 2024-08-17T02:26:31.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.382+0000 7f343aa00640 1 -- 172.21.15.6:0/2809425302 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3430013860 con 0x7f34440afca0 2024-08-17T02:26:31.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.383+0000 7f343aa00640 1 --2- 172.21.15.6:0/2809425302 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3424065150 0x7f3424067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.383+0000 7f343aa00640 1 -- 172.21.15.6:0/2809425302 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f3430082740 con 0x7f34440afca0 2024-08-17T02:26:31.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.384+0000 7f3443400640 1 --2- 172.21.15.6:0/2809425302 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3424065150 0x7f3424067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.384+0000 7f3443400640 1 --2- 172.21.15.6:0/2809425302 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3424065150 0x7f3424067600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3434034000 tx=0x7f3434032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.388+0000 7f343aa00640 1 -- 172.21.15.6:0/2809425302 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3430050870 con 0x7f34440afca0 2024-08-17T02:26:31.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:31.613+0000 7f344a600640 1 -- 172.21.15.6:0/2809425302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3444067be0 con 0x7f34440afca0 2024-08-17T02:26:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.200+0000 7f343aa00640 1 -- 172.21.15.6:0/2809425302 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3430053e90 con 0x7f34440afca0 2024-08-17T02:26:32.202 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:26:32.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.206+0000 7f344a600640 1 -- 172.21.15.6:0/2809425302 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3424065150 msgr2=0x7f3424067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.206+0000 7f344a600640 1 --2- 172.21.15.6:0/2809425302 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3424065150 0x7f3424067600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3434034000 tx=0x7f3434032000 comp rx=0 tx=0).stop 2024-08-17T02:26:32.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.206+0000 7f344a600640 1 -- 172.21.15.6:0/2809425302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34440afca0 msgr2=0x7f344414c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.206+0000 7f344a600640 1 --2- 172.21.15.6:0/2809425302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34440afca0 0x7f344414c4a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f343000ea50 tx=0x7f34300090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.206+0000 7f344a600640 1 -- 172.21.15.6:0/2809425302 shutdown_connections 2024-08-17T02:26:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.206+0000 7f344a600640 1 --2- 172.21.15.6:0/2809425302 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3424065150 0x7f3424067600 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.206+0000 7f344a600640 1 --2- 172.21.15.6:0/2809425302 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34441589a0 0x7f34441573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.206+0000 7f344a600640 1 --2- 172.21.15.6:0/2809425302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34440afca0 0x7f344414c4a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.206+0000 7f344a600640 1 --2- 172.21.15.6:0/2809425302 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34440acf10 0x7f34441559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.206+0000 7f344a600640 1 -- 172.21.15.6:0/2809425302 >> 172.21.15.6:0/2809425302 conn(0x7f3444066e60 msgr2=0x7f34440ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.207+0000 7f344a600640 1 -- 172.21.15.6:0/2809425302 shutdown_connections 2024-08-17T02:26:32.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.207+0000 7f344a600640 1 -- 172.21.15.6:0/2809425302 wait complete. 2024-08-17T02:26:32.236 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:32.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.390+0000 7f4840400640 1 Processor -- start 2024-08-17T02:26:32.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.390+0000 7f4840400640 1 -- start start 2024-08-17T02:26:32.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.391+0000 7f4840400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48380ae860 0x7f483806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.391+0000 7f4840400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4838158df0 0x7f483806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.391+0000 7f4840400640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48380aed90 con 0x7f4838158a20 2024-08-17T02:26:32.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.391+0000 7f4840400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48380af070 con 0x7f4838158df0 2024-08-17T02:26:32.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.391+0000 7f4840400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48380af350 con 0x7f48380ae860 2024-08-17T02:26:32.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.392+0000 7f483d000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48380ae860 0x7f483806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.392+0000 7f483e400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4838158df0 0x7f483806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.392+0000 7f483d000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48380ae860 0x7f483806d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:58834/0 (socket says 172.21.15.6:58834) 2024-08-17T02:26:32.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.392+0000 7f483d000640 1 -- 172.21.15.6:0/761335090 learned_addr learned my addr 172.21.15.6:0/761335090 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:32.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.392+0000 7f483da00640 1 --1- 172.21.15.6:0/761335090 >> v1:172.21.15.136:6789/0 conn(0x7f4838158a20 0x7f48380a89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:58044/0 (socket says 172.21.15.6:58044) 2024-08-17T02:26:32.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.392+0000 7f4837e00640 1 -- 172.21.15.6:0/761335090 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845823994 0 0) 0x7f48380aed90 con 0x7f4838158a20 2024-08-17T02:26:32.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.392+0000 7f4837e00640 1 -- 172.21.15.6:0/761335090 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48200034e0 con 0x7f4838158a20 2024-08-17T02:26:32.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.392+0000 7f483d000640 1 -- 172.21.15.6:0/761335090 >> v2:172.21.15.136:3300/0 conn(0x7f4838158df0 msgr2=0x7f483806dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:32.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.392+0000 7f483d000640 1 --2- 172.21.15.6:0/761335090 >> v2:172.21.15.136:3300/0 conn(0x7f4838158df0 0x7f483806dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.392+0000 7f483d000640 1 -- 172.21.15.6:0/761335090 >> v1:172.21.15.136:6789/0 conn(0x7f4838158a20 legacy=0x7f48380a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.392+0000 7f483d000640 1 -- 172.21.15.6:0/761335090 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48380af630 con 0x7f48380ae860 2024-08-17T02:26:32.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.392+0000 7f483e400640 1 --2- 172.21.15.6:0/761335090 >> v2:172.21.15.136:3300/0 conn(0x7f4838158df0 0x7f483806dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:32.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.393+0000 7f483d000640 1 --2- 172.21.15.6:0/761335090 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48380ae860 0x7f483806d7d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4824009910 tx=0x7f48240091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34a80727b43c42e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.393+0000 7f4837e00640 1 -- 172.21.15.6:0/761335090 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482402ae40 con 0x7f48380ae860 2024-08-17T02:26:32.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.394+0000 7f4837e00640 1 -- 172.21.15.6:0/761335090 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4824032440 con 0x7f48380ae860 2024-08-17T02:26:32.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.394+0000 7f4837e00640 1 -- 172.21.15.6:0/761335090 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824032820 con 0x7f48380ae860 2024-08-17T02:26:32.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.394+0000 7f4840400640 1 -- 172.21.15.6:0/761335090 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48380ae860 msgr2=0x7f483806d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.394+0000 7f4840400640 1 --2- 172.21.15.6:0/761335090 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48380ae860 0x7f483806d7d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4824009910 tx=0x7f48240091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.394+0000 7f4840400640 1 -- 172.21.15.6:0/761335090 shutdown_connections 2024-08-17T02:26:32.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.394+0000 7f4840400640 1 --2- 172.21.15.6:0/761335090 >> v2:172.21.15.136:3300/0 conn(0x7f4838158df0 0x7f483806dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.394+0000 7f4840400640 1 --2- 172.21.15.6:0/761335090 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48380ae860 0x7f483806d7d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.394+0000 7f4840400640 1 -- 172.21.15.6:0/761335090 >> 172.21.15.6:0/761335090 conn(0x7f4838066e60 msgr2=0x7f4838067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.394+0000 7f4840400640 1 -- 172.21.15.6:0/761335090 shutdown_connections 2024-08-17T02:26:32.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.394+0000 7f4840400640 1 -- 172.21.15.6:0/761335090 wait complete. 2024-08-17T02:26:32.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.396+0000 7f4840400640 1 Processor -- start 2024-08-17T02:26:32.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.396+0000 7f4840400640 1 -- start start 2024-08-17T02:26:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.397+0000 7f4840400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48380ae860 0x7f483816c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.397+0000 7f4840400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4838158a20 0x7f4838151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.397+0000 7f4840400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4838158df0 0x7f4838154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.397+0000 7f4840400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483816cec0 con 0x7f4838158a20 2024-08-17T02:26:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.397+0000 7f4840400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48381569c0 con 0x7f4838158df0 2024-08-17T02:26:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.397+0000 7f4840400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483815b960 con 0x7f48380ae860 2024-08-17T02:26:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.397+0000 7f483d000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4838158a20 0x7f4838151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.397+0000 7f483d000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4838158a20 0x7f4838151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59226/0 (socket says 172.21.15.6:59226) 2024-08-17T02:26:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.397+0000 7f483d000640 1 -- 172.21.15.6:0/332785730 learned_addr learned my addr 172.21.15.6:0/332785730 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.397+0000 7f483da00640 1 --2- 172.21.15.6:0/332785730 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48380ae860 0x7f483816c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.397+0000 7f483e400640 1 --2- 172.21.15.6:0/332785730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4838158df0 0x7f4838154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.397+0000 7f483d000640 1 -- 172.21.15.6:0/332785730 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48380ae860 msgr2=0x7f483816c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.397+0000 7f483d000640 1 --2- 172.21.15.6:0/332785730 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48380ae860 0x7f483816c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.397+0000 7f483d000640 1 -- 172.21.15.6:0/332785730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4838158df0 msgr2=0x7f4838154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.397+0000 7f483d000640 1 --2- 172.21.15.6:0/332785730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4838158df0 0x7f4838154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.397+0000 7f483d000640 1 -- 172.21.15.6:0/332785730 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4830009a20 con 0x7f4838158a20 2024-08-17T02:26:32.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.398+0000 7f483d000640 1 --2- 172.21.15.6:0/332785730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4838158a20 0x7f4838151330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4824009210 tx=0x7f4824032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.398+0000 7f4834c00640 1 -- 172.21.15.6:0/332785730 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824031ae0 con 0x7f4838158a20 2024-08-17T02:26:32.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.398+0000 7f4834c00640 1 -- 172.21.15.6:0/332785730 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4824031c60 con 0x7f4838158a20 2024-08-17T02:26:32.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.398+0000 7f4840400640 1 -- 172.21.15.6:0/332785730 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4824009450 con 0x7f4838158a20 2024-08-17T02:26:32.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.398+0000 7f4834c00640 1 -- 172.21.15.6:0/332785730 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482403d420 con 0x7f4838158a20 2024-08-17T02:26:32.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.398+0000 7f4840400640 1 -- 172.21.15.6:0/332785730 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483815bf20 con 0x7f4838158a20 2024-08-17T02:26:32.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.399+0000 7f4840400640 1 -- 172.21.15.6:0/332785730 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4838156790 con 0x7f4838158a20 2024-08-17T02:26:32.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.400+0000 7f4834c00640 1 -- 172.21.15.6:0/332785730 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4824039040 con 0x7f4838158a20 2024-08-17T02:26:32.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.401+0000 7f4834c00640 1 --2- 172.21.15.6:0/332785730 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4818065150 0x7f4818067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.401+0000 7f4834c00640 1 -- 172.21.15.6:0/332785730 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f482402ae40 con 0x7f4838158a20 2024-08-17T02:26:32.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.401+0000 7f483da00640 1 --2- 172.21.15.6:0/332785730 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4818065150 0x7f4818067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.402+0000 7f483da00640 1 --2- 172.21.15.6:0/332785730 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4818065150 0x7f4818067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f482c007660 tx=0x7f482c007b10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.405+0000 7f4834c00640 1 -- 172.21.15.6:0/332785730 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4838156790 con 0x7f4838158a20 2024-08-17T02:26:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.594+0000 7f4840400640 1 -- 172.21.15.6:0/332785730 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4838156790 con 0x7f4838158a20 2024-08-17T02:26:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.595+0000 7f4834c00640 1 -- 172.21.15.6:0/332785730 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f4838156790 con 0x7f4838158a20 2024-08-17T02:26:32.596 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:32.596 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:31.615228+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:29.257601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:30.596556+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:32.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.597+0000 7f4840400640 1 -- 172.21.15.6:0/332785730 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4818065150 msgr2=0x7f4818067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.597+0000 7f4840400640 1 --2- 172.21.15.6:0/332785730 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4818065150 0x7f4818067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f482c007660 tx=0x7f482c007b10 comp rx=0 tx=0).stop 2024-08-17T02:26:32.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.597+0000 7f4840400640 1 -- 172.21.15.6:0/332785730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4838158a20 msgr2=0x7f4838151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.597+0000 7f4840400640 1 --2- 172.21.15.6:0/332785730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4838158a20 0x7f4838151330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4824009210 tx=0x7f4824032000 comp rx=0 tx=0).stop 2024-08-17T02:26:32.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.597+0000 7f4840400640 1 -- 172.21.15.6:0/332785730 shutdown_connections 2024-08-17T02:26:32.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.597+0000 7f4840400640 1 --2- 172.21.15.6:0/332785730 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4818065150 0x7f4818067600 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.598+0000 7f4840400640 1 --2- 172.21.15.6:0/332785730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4838158df0 0x7f4838154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.598+0000 7f4840400640 1 --2- 172.21.15.6:0/332785730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4838158a20 0x7f4838151330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.598+0000 7f4840400640 1 --2- 172.21.15.6:0/332785730 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48380ae860 0x7f483816c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.598+0000 7f4840400640 1 -- 172.21.15.6:0/332785730 >> 172.21.15.6:0/332785730 conn(0x7f4838066e60 msgr2=0x7f483806d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.598+0000 7f4840400640 1 -- 172.21.15.6:0/332785730 shutdown_connections 2024-08-17T02:26:32.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.598+0000 7f4840400640 1 -- 172.21.15.6:0/332785730 wait complete. 2024-08-17T02:26:32.613 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:32.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.764+0000 7fa3ede00640 1 Processor -- start 2024-08-17T02:26:32.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.764+0000 7fa3ede00640 1 -- start start 2024-08-17T02:26:32.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.765+0000 7fa3ede00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3e80ca430 0x7fa3e80adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.765+0000 7fa3ede00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa3e81552d0 0x7fa3e8155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.765+0000 7fa3ede00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e80cb180 con 0x7fa3e80ad790 2024-08-17T02:26:32.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.765+0000 7fa3ede00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e80af530 con 0x7fa3e81552d0 2024-08-17T02:26:32.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.765+0000 7fa3ede00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80ca8e0 con 0x7fa3e80ca430 2024-08-17T02:26:32.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.765+0000 7fa3eca00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa3e80ad790 0x7fa3e80c9d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60786/0 (socket says 172.21.15.6:60786) 2024-08-17T02:26:32.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.765+0000 7fa3eca00640 1 -- 172.21.15.6:0/1853900432 learned_addr learned my addr 172.21.15.6:0/1853900432 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:32.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.765+0000 7fa3e7e00640 1 --2- 172.21.15.6:0/1853900432 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3e80ca430 0x7fa3e80adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.765+0000 7fa3ed400640 1 --2- 172.21.15.6:0/1853900432 >> v2:172.21.15.136:3300/0 conn(0x7fa3e81552d0 0x7fa3e8155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3e7400640 1 -- 172.21.15.6:0/1853900432 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357575481 0 0) 0x7fa3e80cb180 con 0x7fa3e80ad790 2024-08-17T02:26:32.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3e7400640 1 -- 172.21.15.6:0/1853900432 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d00034e0 con 0x7fa3e80ad790 2024-08-17T02:26:32.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3e7400640 1 -- 172.21.15.6:0/1853900432 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2252653127 0 0) 0x7fa3d00034e0 con 0x7fa3e80ad790 2024-08-17T02:26:32.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3e7400640 1 -- 172.21.15.6:0/1853900432 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3e80ca430 msgr2=0x7fa3e80adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:32.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3e7400640 1 --2- 172.21.15.6:0/1853900432 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3e80ca430 0x7fa3e80adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3e7400640 1 -- 172.21.15.6:0/1853900432 >> v2:172.21.15.136:3300/0 conn(0x7fa3e81552d0 msgr2=0x7fa3e8155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3e7400640 1 --2- 172.21.15.6:0/1853900432 >> v2:172.21.15.136:3300/0 conn(0x7fa3e81552d0 0x7fa3e8155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3e7400640 1 -- 172.21.15.6:0/1853900432 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e80cabc0 con 0x7fa3e80ad790 2024-08-17T02:26:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3e7400640 1 -- 172.21.15.6:0/1853900432 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7fa3dc001470 con 0x7fa3e80ad790 2024-08-17T02:26:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3e7400640 1 -- 172.21.15.6:0/1853900432 >> v1:172.21.15.6:6789/0 conn(0x7fa3e80ad790 legacy=0x7fa3e80c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3e7400640 1 --2- 172.21.15.6:0/1853900432 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3e80ca430 0x7fa3d0003a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3e7400640 1 --2- 172.21.15.6:0/1853900432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3d0003fc0 0x7fa3d0004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3e7400640 1 --2- 172.21.15.6:0/1853900432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3d0004cc0 0x7fa3d0005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3e7400640 1 -- 172.21.15.6:0/1853900432 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80af530 con 0x7fa3d0003fc0 2024-08-17T02:26:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3e7400640 1 -- 172.21.15.6:0/1853900432 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80ca8e0 con 0x7fa3d0004cc0 2024-08-17T02:26:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3e7400640 1 -- 172.21.15.6:0/1853900432 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d000ba80 con 0x7fa3e80ca430 2024-08-17T02:26:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3e7e00640 1 --2- 172.21.15.6:0/1853900432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3d0003fc0 0x7fa3d0004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3eca00640 1 --2- 172.21.15.6:0/1853900432 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3e80ca430 0x7fa3d0003a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.766+0000 7fa3ed400640 1 --2- 172.21.15.6:0/1853900432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3d0004cc0 0x7fa3d0005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.767+0000 7fa3e7e00640 1 -- 172.21.15.6:0/1853900432 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3e80ca430 msgr2=0x7fa3d0003a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.767+0000 7fa3e7e00640 1 --2- 172.21.15.6:0/1853900432 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3e80ca430 0x7fa3d0003a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.767+0000 7fa3e7e00640 1 -- 172.21.15.6:0/1853900432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3d0004cc0 msgr2=0x7fa3d0005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.767+0000 7fa3e7e00640 1 --2- 172.21.15.6:0/1853900432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3d0004cc0 0x7fa3d0005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.767+0000 7fa3e7e00640 1 -- 172.21.15.6:0/1853900432 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d00034e0 con 0x7fa3d0003fc0 2024-08-17T02:26:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.767+0000 7fa3ed400640 1 --2- 172.21.15.6:0/1853900432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3d0004cc0 0x7fa3d0005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.768+0000 7fa3e7e00640 1 --2- 172.21.15.6:0/1853900432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3d0003fc0 0x7fa3d0004780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4006e70 tx=0x7fa3d40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518c0913bb213607 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.768+0000 7fa3e7400640 1 -- 172.21.15.6:0/1853900432 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4031400 con 0x7fa3d0003fc0 2024-08-17T02:26:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.768+0000 7fa3e7400640 1 -- 172.21.15.6:0/1853900432 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d402d050 con 0x7fa3d0003fc0 2024-08-17T02:26:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.768+0000 7fa3e7400640 1 -- 172.21.15.6:0/1853900432 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4031790 con 0x7fa3d0003fc0 2024-08-17T02:26:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.768+0000 7fa3ede00640 1 -- 172.21.15.6:0/1853900432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3d0003fc0 msgr2=0x7fa3d0004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.768+0000 7fa3ede00640 1 --2- 172.21.15.6:0/1853900432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3d0003fc0 0x7fa3d0004780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4006e70 tx=0x7fa3d40090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.768+0000 7fa3ed400640 1 -- 172.21.15.6:0/1853900432 reap_dead start 2024-08-17T02:26:32.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.768+0000 7fa3ede00640 1 -- 172.21.15.6:0/1853900432 shutdown_connections 2024-08-17T02:26:32.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.768+0000 7fa3ede00640 1 -- 172.21.15.6:0/1853900432 >> 172.21.15.6:0/1853900432 conn(0x7fa3e8062af0 msgr2=0x7fa3e8062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.769+0000 7fa3ede00640 1 -- 172.21.15.6:0/1853900432 shutdown_connections 2024-08-17T02:26:32.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.769+0000 7fa3ede00640 1 -- 172.21.15.6:0/1853900432 wait complete. 2024-08-17T02:26:32.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.770+0000 7fa3ede00640 1 Processor -- start 2024-08-17T02:26:32.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.770+0000 7fa3ede00640 1 -- start start 2024-08-17T02:26:32.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.771+0000 7fa3ede00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3d0003fc0 0x7fa3e81528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.771+0000 7fa3ede00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3e814f0c0 0x7fa3e8152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.771+0000 7fa3ede00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3e8153340 0x7fa3e80a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.771+0000 7fa3ede00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e81518b0 con 0x7fa3d0003fc0 2024-08-17T02:26:32.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.771+0000 7fa3ede00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e8152430 con 0x7fa3e8153340 2024-08-17T02:26:32.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.771+0000 7fa3ede00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e8151b00 con 0x7fa3e814f0c0 2024-08-17T02:26:32.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.771+0000 7fa3eca00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3d0003fc0 0x7fa3e81528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.771+0000 7fa3eca00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3d0003fc0 0x7fa3e81528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59254/0 (socket says 172.21.15.6:59254) 2024-08-17T02:26:32.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.771+0000 7fa3eca00640 1 -- 172.21.15.6:0/4186807211 learned_addr learned my addr 172.21.15.6:0/4186807211 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:32.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.771+0000 7fa3ed400640 1 --2- 172.21.15.6:0/4186807211 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3e8153340 0x7fa3e80a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.772+0000 7fa3eca00640 1 -- 172.21.15.6:0/4186807211 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3e814f0c0 msgr2=0x7fa3e8152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.772+0000 7fa3eca00640 1 --2- 172.21.15.6:0/4186807211 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3e814f0c0 0x7fa3e8152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.772+0000 7fa3eca00640 1 -- 172.21.15.6:0/4186807211 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3e8153340 msgr2=0x7fa3e80a88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.772+0000 7fa3eca00640 1 --2- 172.21.15.6:0/4186807211 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3e8153340 0x7fa3e80a88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.772+0000 7fa3eca00640 1 -- 172.21.15.6:0/4186807211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e8151de0 con 0x7fa3d0003fc0 2024-08-17T02:26:32.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.772+0000 7fa3ed400640 1 --2- 172.21.15.6:0/4186807211 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3e8153340 0x7fa3e80a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:32.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.772+0000 7fa3eca00640 1 --2- 172.21.15.6:0/4186807211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3d0003fc0 0x7fa3e81528c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc007390 tx=0x7fa3dc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.772+0000 7fa3dbe00640 1 -- 172.21.15.6:0/4186807211 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc018030 con 0x7fa3d0003fc0 2024-08-17T02:26:32.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.772+0000 7fa3dbe00640 1 -- 172.21.15.6:0/4186807211 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc001560 con 0x7fa3d0003fc0 2024-08-17T02:26:32.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.772+0000 7fa3dbe00640 1 -- 172.21.15.6:0/4186807211 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc00fb70 con 0x7fa3d0003fc0 2024-08-17T02:26:32.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.772+0000 7fa3ede00640 1 -- 172.21.15.6:0/4186807211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e81520c0 con 0x7fa3d0003fc0 2024-08-17T02:26:32.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.772+0000 7fa3ede00640 1 -- 172.21.15.6:0/4186807211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e8168ca0 con 0x7fa3d0003fc0 2024-08-17T02:26:32.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.773+0000 7fa3ede00640 1 -- 172.21.15.6:0/4186807211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e8070720 con 0x7fa3d0003fc0 2024-08-17T02:26:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.774+0000 7fa3dbe00640 1 -- 172.21.15.6:0/4186807211 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa3dc01b070 con 0x7fa3d0003fc0 2024-08-17T02:26:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.775+0000 7fa3dbe00640 1 --2- 172.21.15.6:0/4186807211 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa3c8065150 0x7fa3c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.775+0000 7fa3dbe00640 1 -- 172.21.15.6:0/4186807211 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa3dc019070 con 0x7fa3d0003fc0 2024-08-17T02:26:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.775+0000 7fa3e7e00640 1 --2- 172.21.15.6:0/4186807211 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa3c8065150 0x7fa3c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.776+0000 7fa3e7e00640 1 --2- 172.21.15.6:0/4186807211 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa3c8065150 0x7fa3c8067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4034000 tx=0x7fa3d4035000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.780+0000 7fa3dbe00640 1 -- 172.21.15.6:0/4186807211 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa3dc050470 con 0x7fa3d0003fc0 2024-08-17T02:26:32.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.966+0000 7fa3ede00640 1 -- 172.21.15.6:0/4186807211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3e80aede0 con 0x7fa3d0003fc0 2024-08-17T02:26:32.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.967+0000 7fa3dbe00640 1 -- 172.21.15.6:0/4186807211 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15315 (secure 0 0 0) 0x7fa3dc053a90 con 0x7fa3d0003fc0 2024-08-17T02:26:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:32.968 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:31.615228+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:29.257601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:30.596556+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:32.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.969+0000 7fa3ede00640 1 -- 172.21.15.6:0/4186807211 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa3c8065150 msgr2=0x7fa3c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.969+0000 7fa3ede00640 1 --2- 172.21.15.6:0/4186807211 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa3c8065150 0x7fa3c8067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4034000 tx=0x7fa3d4035000 comp rx=0 tx=0).stop 2024-08-17T02:26:32.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.969+0000 7fa3ede00640 1 -- 172.21.15.6:0/4186807211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3d0003fc0 msgr2=0x7fa3e81528c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.969+0000 7fa3ede00640 1 --2- 172.21.15.6:0/4186807211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3d0003fc0 0x7fa3e81528c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc007390 tx=0x7fa3dc001e90 comp rx=0 tx=0).stop 2024-08-17T02:26:32.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.969+0000 7fa3ede00640 1 -- 172.21.15.6:0/4186807211 shutdown_connections 2024-08-17T02:26:32.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.969+0000 7fa3ede00640 1 --2- 172.21.15.6:0/4186807211 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa3c8065150 0x7fa3c8067600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.969+0000 7fa3ede00640 1 --2- 172.21.15.6:0/4186807211 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3e8153340 0x7fa3e80a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.969+0000 7fa3ede00640 1 --2- 172.21.15.6:0/4186807211 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3e814f0c0 0x7fa3e8152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.969+0000 7fa3ede00640 1 --2- 172.21.15.6:0/4186807211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3d0003fc0 0x7fa3e81528c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.969+0000 7fa3ede00640 1 -- 172.21.15.6:0/4186807211 >> 172.21.15.6:0/4186807211 conn(0x7fa3e8062af0 msgr2=0x7fa3e80b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.969+0000 7fa3ede00640 1 -- 172.21.15.6:0/4186807211 shutdown_connections 2024-08-17T02:26:32.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:32.969+0000 7fa3ede00640 1 -- 172.21.15.6:0/4186807211 wait complete. 2024-08-17T02:26:32.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:26:33.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.137+0000 7fbcf3a00640 1 Processor -- start 2024-08-17T02:26:33.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.137+0000 7fbcf3a00640 1 -- start start 2024-08-17T02:26:33.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.138+0000 7fbcf3a00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbcec0ad960 0x7fbcec15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.138+0000 7fbcf3a00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcec15b5e0 con 0x7fbcec0add30 2024-08-17T02:26:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.138+0000 7fbcf3a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcec0cb160 con 0x7fbcec0ca050 2024-08-17T02:26:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.138+0000 7fbcf3a00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcec0b0d10 con 0x7fbcec0ad960 2024-08-17T02:26:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.138+0000 7fbcf1000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbcec0ad960 0x7fbcec15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.138+0000 7fbcf1a00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbcec0add30 0x7fbcec0aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60796/0 (socket says 172.21.15.6:60796) 2024-08-17T02:26:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.138+0000 7fbcf1000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbcec0ad960 0x7fbcec15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59268/0 (socket says 172.21.15.6:59268) 2024-08-17T02:26:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.138+0000 7fbcf1a00640 1 -- 172.21.15.6:0/3524405095 learned_addr learned my addr 172.21.15.6:0/3524405095 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.139+0000 7fbcf1000640 1 -- 172.21.15.6:0/3524405095 >> v1:172.21.15.136:6789/0 conn(0x7fbcec0ca050 legacy=0x7fbcec156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.139+0000 7fbcf1000640 1 -- 172.21.15.6:0/3524405095 >> v1:172.21.15.6:6789/0 conn(0x7fbcec0add30 legacy=0x7fbcec0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.139+0000 7fbcf1000640 1 -- 172.21.15.6:0/3524405095 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcec0ca550 con 0x7fbcec0ad960 2024-08-17T02:26:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.139+0000 7fbceb400640 1 -- 172.21.15.6:0/3524405095 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373186386 0 0) 0x7fbce4001490 con 0x7fbcec0add30 2024-08-17T02:26:33.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.140+0000 7fbcf1000640 1 --2- 172.21.15.6:0/3524405095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcec0ad960 0x7fbcec15b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009850 tx=0x7fbce00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5e99ffd029440d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.140+0000 7fbceb400640 1 -- 172.21.15.6:0/3524405095 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce002ae40 con 0x7fbcec0ad960 2024-08-17T02:26:33.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.140+0000 7fbceb400640 1 -- 172.21.15.6:0/3524405095 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce0032440 con 0x7fbcec0ad960 2024-08-17T02:26:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.140+0000 7fbceb400640 1 -- 172.21.15.6:0/3524405095 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce00327e0 con 0x7fbcec0ad960 2024-08-17T02:26:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.141+0000 7fbcf3a00640 1 -- 172.21.15.6:0/3524405095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcec0ad960 msgr2=0x7fbcec15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.141+0000 7fbcf3a00640 1 --2- 172.21.15.6:0/3524405095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcec0ad960 0x7fbcec15b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009850 tx=0x7fbce00090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.141+0000 7fbcf3a00640 1 -- 172.21.15.6:0/3524405095 shutdown_connections 2024-08-17T02:26:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.141+0000 7fbcf3a00640 1 --2- 172.21.15.6:0/3524405095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcec0ad960 0x7fbcec15b0a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.141+0000 7fbcf3a00640 1 -- 172.21.15.6:0/3524405095 >> 172.21.15.6:0/3524405095 conn(0x7fbcec066e60 msgr2=0x7fbcec067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.141+0000 7fbcf3a00640 1 -- 172.21.15.6:0/3524405095 shutdown_connections 2024-08-17T02:26:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.141+0000 7fbcf3a00640 1 -- 172.21.15.6:0/3524405095 wait complete. 2024-08-17T02:26:33.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.142+0000 7fbcf3a00640 1 Processor -- start 2024-08-17T02:26:33.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.142+0000 7fbcf3a00640 1 -- start start 2024-08-17T02:26:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.143+0000 7fbcf3a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbcec0ad960 0x7fbcec167c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.143+0000 7fbcf3a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbcec0add30 0x7fbcec147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.143+0000 7fbcf3a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcec0ca050 0x7fbcec151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.143+0000 7fbcf3a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec168150 con 0x7fbcec0ca050 2024-08-17T02:26:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.143+0000 7fbcf3a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec16a880 con 0x7fbcec0add30 2024-08-17T02:26:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.143+0000 7fbcf3a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec1476d0 con 0x7fbcec0ad960 2024-08-17T02:26:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.143+0000 7fbcf1a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcec0ca050 0x7fbcec151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.143+0000 7fbcf1000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbcec0ad960 0x7fbcec167c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.143+0000 7fbcf1000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbcec0ad960 0x7fbcec167c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:58886/0 (socket says 172.21.15.6:58886) 2024-08-17T02:26:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.143+0000 7fbcf1000640 1 -- 172.21.15.6:0/3907689573 learned_addr learned my addr 172.21.15.6:0/3907689573 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.143+0000 7fbcf1a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcec0ca050 0x7fbcec151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59282/0 (socket says 172.21.15.6:59282) 2024-08-17T02:26:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.143+0000 7fbcebe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbcec0add30 0x7fbcec147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.144+0000 7fbcf1a00640 1 -- 172.21.15.6:0/3907689573 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbcec0ad960 msgr2=0x7fbcec167c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.144+0000 7fbcf1a00640 1 --2- 172.21.15.6:0/3907689573 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbcec0ad960 0x7fbcec167c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.144+0000 7fbcf1a00640 1 -- 172.21.15.6:0/3907689573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbcec0add30 msgr2=0x7fbcec147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.144+0000 7fbcf1a00640 1 --2- 172.21.15.6:0/3907689573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbcec0add30 0x7fbcec147190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.144+0000 7fbcf1a00640 1 -- 172.21.15.6:0/3907689573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce0009390 con 0x7fbcec0ca050 2024-08-17T02:26:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.144+0000 7fbcf1000640 1 --2- 172.21.15.6:0/3907689573 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbcec0ad960 0x7fbcec167c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.144+0000 7fbcf1a00640 1 --2- 172.21.15.6:0/3907689573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcec0ca050 0x7fbcec151fe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbce400cc10 tx=0x7fbce40019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.144+0000 7fbcdfe00640 1 -- 172.21.15.6:0/3907689573 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce400ce30 con 0x7fbcec0ca050 2024-08-17T02:26:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.144+0000 7fbcdfe00640 1 -- 172.21.15.6:0/3907689573 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce400a8e0 con 0x7fbcec0ca050 2024-08-17T02:26:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.144+0000 7fbcdfe00640 1 -- 172.21.15.6:0/3907689573 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce400ad20 con 0x7fbcec0ca050 2024-08-17T02:26:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.144+0000 7fbcf3a00640 1 -- 172.21.15.6:0/3907689573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcec14e2b0 con 0x7fbcec0ca050 2024-08-17T02:26:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.144+0000 7fbcf3a00640 1 -- 172.21.15.6:0/3907689573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcec16add0 con 0x7fbcec0ca050 2024-08-17T02:26:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.145+0000 7fbcf3a00640 1 -- 172.21.15.6:0/3907689573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcec16aff0 con 0x7fbcec0ca050 2024-08-17T02:26:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.146+0000 7fbcdfe00640 1 -- 172.21.15.6:0/3907689573 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbce4007300 con 0x7fbcec0ca050 2024-08-17T02:26:33.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.148+0000 7fbcdfe00640 1 --2- 172.21.15.6:0/3907689573 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbccc065150 0x7fbccc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.148+0000 7fbcdfe00640 1 -- 172.21.15.6:0/3907689573 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbce4082390 con 0x7fbcec0ca050 2024-08-17T02:26:33.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.148+0000 7fbcf1000640 1 --2- 172.21.15.6:0/3907689573 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbccc065150 0x7fbccc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.149+0000 7fbcf1000640 1 --2- 172.21.15.6:0/3907689573 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbccc065150 0x7fbccc067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbce0035040 tx=0x7fbce0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.152+0000 7fbcdfe00640 1 -- 172.21.15.6:0/3907689573 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbce40504e0 con 0x7fbcec0ca050 2024-08-17T02:26:33.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:33.382+0000 7fbcf3a00640 1 -- 172.21.15.6:0/3907689573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbcec15b5e0 con 0x7fbcec0ca050 2024-08-17T02:26:33.986 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:33.991 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:34.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.210+0000 7fbcdfe00640 1 -- 172.21.15.6:0/3907689573 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbcec15b5e0 con 0x7fbcec0ca050 2024-08-17T02:26:34.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.213+0000 7fbcf3a00640 1 -- 172.21.15.6:0/3907689573 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbccc065150 msgr2=0x7fbccc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.213+0000 7fbcf3a00640 1 --2- 172.21.15.6:0/3907689573 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbccc065150 0x7fbccc067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbce0035040 tx=0x7fbce0032000 comp rx=0 tx=0).stop 2024-08-17T02:26:34.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.213+0000 7fbcf3a00640 1 -- 172.21.15.6:0/3907689573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcec0ca050 msgr2=0x7fbcec151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.213+0000 7fbcf3a00640 1 --2- 172.21.15.6:0/3907689573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcec0ca050 0x7fbcec151fe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbce400cc10 tx=0x7fbce40019b0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.213+0000 7fbcf3a00640 1 -- 172.21.15.6:0/3907689573 shutdown_connections 2024-08-17T02:26:34.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.213+0000 7fbcf3a00640 1 --2- 172.21.15.6:0/3907689573 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbccc065150 0x7fbccc067600 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.213+0000 7fbcf3a00640 1 --2- 172.21.15.6:0/3907689573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcec0ca050 0x7fbcec151fe0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.213+0000 7fbcf3a00640 1 --2- 172.21.15.6:0/3907689573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbcec0add30 0x7fbcec147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.213+0000 7fbcf3a00640 1 --2- 172.21.15.6:0/3907689573 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbcec0ad960 0x7fbcec167c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.213+0000 7fbcf3a00640 1 -- 172.21.15.6:0/3907689573 >> 172.21.15.6:0/3907689573 conn(0x7fbcec066e60 msgr2=0x7fbcec151340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.213+0000 7fbcf3a00640 1 -- 172.21.15.6:0/3907689573 shutdown_connections 2024-08-17T02:26:34.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.213+0000 7fbcf3a00640 1 -- 172.21.15.6:0/3907689573 wait complete. 2024-08-17T02:26:34.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:26:34.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.386+0000 7f66c6200640 1 Processor -- start 2024-08-17T02:26:34.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.386+0000 7f66c6200640 1 -- start start 2024-08-17T02:26:34.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.387+0000 7f66c6200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f66c0155040 0x7f66c0158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.387+0000 7f66c6200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f66c00abad0 0x7f66c015fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.387+0000 7f66c6200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c00aeeb0 con 0x7f66c01591c0 2024-08-17T02:26:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.387+0000 7f66c6200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c0159610 con 0x7f66c0155040 2024-08-17T02:26:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.387+0000 7f66c6200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c00aadd0 con 0x7f66c00abad0 2024-08-17T02:26:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.387+0000 7f66bf400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f66c0155040 0x7f66c0158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.388+0000 7f66bf400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f66c0155040 0x7f66c0158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59296/0 (socket says 172.21.15.6:59296) 2024-08-17T02:26:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.388+0000 7f66bf400640 1 -- 172.21.15.6:0/1705050788 learned_addr learned my addr 172.21.15.6:0/1705050788 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.388+0000 7f66bf400640 1 -- 172.21.15.6:0/1705050788 >> v2:172.21.15.136:3300/0 conn(0x7f66c00abad0 msgr2=0x7f66c015fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.388+0000 7f66bfe00640 1 --2- 172.21.15.6:0/1705050788 >> v2:172.21.15.136:3300/0 conn(0x7f66c00abad0 0x7f66c015fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.388+0000 7f66bf400640 1 --2- 172.21.15.6:0/1705050788 >> v2:172.21.15.136:3300/0 conn(0x7f66c00abad0 0x7f66c015fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.388+0000 7f66bf400640 1 -- 172.21.15.6:0/1705050788 >> v1:172.21.15.136:6789/0 conn(0x7f66c01591c0 legacy=0x7f66c00ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.388+0000 7f66bf400640 1 -- 172.21.15.6:0/1705050788 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c01597f0 con 0x7f66c0155040 2024-08-17T02:26:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.388+0000 7f66bfe00640 1 --2- 172.21.15.6:0/1705050788 >> v2:172.21.15.136:3300/0 conn(0x7f66c00abad0 0x7f66c015fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.389+0000 7f66bf400640 1 --2- 172.21.15.6:0/1705050788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66c0155040 0x7f66c0158c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f66c00ad790 tx=0x7f66b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9849289374eb9ce3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.389+0000 7f66be000640 1 -- 172.21.15.6:0/1705050788 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b002acc0 con 0x7f66c0155040 2024-08-17T02:26:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.389+0000 7f66be000640 1 -- 172.21.15.6:0/1705050788 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b002ae20 con 0x7f66c0155040 2024-08-17T02:26:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.389+0000 7f66be000640 1 -- 172.21.15.6:0/1705050788 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b0032670 con 0x7f66c0155040 2024-08-17T02:26:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.390+0000 7f66c6200640 1 -- 172.21.15.6:0/1705050788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66c0155040 msgr2=0x7f66c0158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.390+0000 7f66c6200640 1 --2- 172.21.15.6:0/1705050788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66c0155040 0x7f66c0158c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f66c00ad790 tx=0x7f66b00091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.390+0000 7f66c6200640 1 -- 172.21.15.6:0/1705050788 shutdown_connections 2024-08-17T02:26:34.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.390+0000 7f66c6200640 1 --2- 172.21.15.6:0/1705050788 >> v2:172.21.15.136:3300/0 conn(0x7f66c00abad0 0x7f66c015fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.390+0000 7f66c6200640 1 --2- 172.21.15.6:0/1705050788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66c0155040 0x7f66c0158c80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.390+0000 7f66c6200640 1 -- 172.21.15.6:0/1705050788 >> 172.21.15.6:0/1705050788 conn(0x7f66c0066e60 msgr2=0x7f66c0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.390+0000 7f66c6200640 1 -- 172.21.15.6:0/1705050788 shutdown_connections 2024-08-17T02:26:34.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.390+0000 7f66c6200640 1 -- 172.21.15.6:0/1705050788 wait complete. 2024-08-17T02:26:34.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.391+0000 7f66c6200640 1 Processor -- start 2024-08-17T02:26:34.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.391+0000 7f66c6200640 1 -- start start 2024-08-17T02:26:34.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.392+0000 7f66c6200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66c00abad0 0x7f66c016ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.392+0000 7f66c6200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f66c0155040 0x7f66c0158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.392+0000 7f66c6200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66c01591c0 0x7f66c0151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.392+0000 7f66c6200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c0153820 con 0x7f66c01591c0 2024-08-17T02:26:34.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.392+0000 7f66c6200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c006b250 con 0x7f66c00abad0 2024-08-17T02:26:34.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.392+0000 7f66c6200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c016d1f0 con 0x7f66c0155040 2024-08-17T02:26:34.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.392+0000 7f66bfe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66c01591c0 0x7f66c0151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.393+0000 7f66bfe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66c01591c0 0x7f66c0151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59304/0 (socket says 172.21.15.6:59304) 2024-08-17T02:26:34.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.393+0000 7f66bfe00640 1 -- 172.21.15.6:0/3107754122 learned_addr learned my addr 172.21.15.6:0/3107754122 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.393+0000 7f66bf400640 1 --2- 172.21.15.6:0/3107754122 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66c00abad0 0x7f66c016ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.393+0000 7f66bea00640 1 --2- 172.21.15.6:0/3107754122 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f66c0155040 0x7f66c0158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.393+0000 7f66bfe00640 1 -- 172.21.15.6:0/3107754122 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f66c0155040 msgr2=0x7f66c0158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.393+0000 7f66bfe00640 1 --2- 172.21.15.6:0/3107754122 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f66c0155040 0x7f66c0158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.393+0000 7f66bfe00640 1 -- 172.21.15.6:0/3107754122 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66c00abad0 msgr2=0x7f66c016ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.393+0000 7f66bfe00640 1 --2- 172.21.15.6:0/3107754122 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66c00abad0 0x7f66c016ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.393+0000 7f66bfe00640 1 -- 172.21.15.6:0/3107754122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b0009450 con 0x7f66c01591c0 2024-08-17T02:26:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.393+0000 7f66bfe00640 1 --2- 172.21.15.6:0/3107754122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66c01591c0 0x7f66c0151090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f66b800a380 tx=0x7f66b8007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.393+0000 7f66b6a00640 1 -- 172.21.15.6:0/3107754122 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b800d650 con 0x7f66c01591c0 2024-08-17T02:26:34.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.394+0000 7f66b6a00640 1 -- 172.21.15.6:0/3107754122 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b800d7b0 con 0x7f66c01591c0 2024-08-17T02:26:34.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.394+0000 7f66b6a00640 1 -- 172.21.15.6:0/3107754122 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b800db70 con 0x7f66c01591c0 2024-08-17T02:26:34.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.394+0000 7f66c6200640 1 -- 172.21.15.6:0/3107754122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c0153430 con 0x7f66c01591c0 2024-08-17T02:26:34.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.394+0000 7f66c6200640 1 -- 172.21.15.6:0/3107754122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c0153d50 con 0x7f66c01591c0 2024-08-17T02:26:34.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.395+0000 7f66c6200640 1 -- 172.21.15.6:0/3107754122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c0063fb0 con 0x7f66c01591c0 2024-08-17T02:26:34.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.395+0000 7f66b6a00640 1 -- 172.21.15.6:0/3107754122 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f66b801e3b0 con 0x7f66c01591c0 2024-08-17T02:26:34.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.396+0000 7f66b6a00640 1 --2- 172.21.15.6:0/3107754122 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f66a0065150 0x7f66a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.396+0000 7f66b6a00640 1 -- 172.21.15.6:0/3107754122 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f66b8082ef0 con 0x7f66c01591c0 2024-08-17T02:26:34.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.397+0000 7f66bf400640 1 --2- 172.21.15.6:0/3107754122 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f66a0065150 0x7f66a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.397+0000 7f66bf400640 1 --2- 172.21.15.6:0/3107754122 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f66a0065150 0x7f66a0067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f66b0034000 tx=0x7f66b0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.400+0000 7f66b6a00640 1 -- 172.21.15.6:0/3107754122 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f66b8050fc0 con 0x7f66c01591c0 2024-08-17T02:26:34.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:34.619+0000 7f66c6200640 1 -- 172.21.15.6:0/3107754122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f66c00687b0 con 0x7f66c01591c0 2024-08-17T02:26:35.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.210+0000 7f66b6a00640 1 -- 172.21.15.6:0/3107754122 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f66b801a0c0 con 0x7f66c01591c0 2024-08-17T02:26:35.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.213+0000 7f66c6200640 1 -- 172.21.15.6:0/3107754122 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f66a0065150 msgr2=0x7f66a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.213+0000 7f66c6200640 1 --2- 172.21.15.6:0/3107754122 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f66a0065150 0x7f66a0067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f66b0034000 tx=0x7f66b0032000 comp rx=0 tx=0).stop 2024-08-17T02:26:35.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.213+0000 7f66c6200640 1 -- 172.21.15.6:0/3107754122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66c01591c0 msgr2=0x7f66c0151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.213+0000 7f66c6200640 1 --2- 172.21.15.6:0/3107754122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66c01591c0 0x7f66c0151090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f66b800a380 tx=0x7f66b8007900 comp rx=0 tx=0).stop 2024-08-17T02:26:35.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.213+0000 7f66c6200640 1 -- 172.21.15.6:0/3107754122 shutdown_connections 2024-08-17T02:26:35.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.213+0000 7f66c6200640 1 --2- 172.21.15.6:0/3107754122 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f66a0065150 0x7f66a0067600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.213+0000 7f66c6200640 1 --2- 172.21.15.6:0/3107754122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66c01591c0 0x7f66c0151090 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.213+0000 7f66c6200640 1 --2- 172.21.15.6:0/3107754122 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f66c0155040 0x7f66c0158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.213+0000 7f66c6200640 1 --2- 172.21.15.6:0/3107754122 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66c00abad0 0x7f66c016ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.213+0000 7f66c6200640 1 -- 172.21.15.6:0/3107754122 >> 172.21.15.6:0/3107754122 conn(0x7f66c0066e60 msgr2=0x7f66c00cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.213+0000 7f66c6200640 1 -- 172.21.15.6:0/3107754122 shutdown_connections 2024-08-17T02:26:35.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.213+0000 7f66c6200640 1 -- 172.21.15.6:0/3107754122 wait complete. 2024-08-17T02:26:35.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:35.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.385+0000 7f9e87e00640 1 Processor -- start 2024-08-17T02:26:35.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.386+0000 7f9e87e00640 1 -- start start 2024-08-17T02:26:35.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.387+0000 7f9e87e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9e880b0e30 0x7f9e880b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.387+0000 7f9e87e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8815a590 0x7f9e8813fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.387+0000 7f9e87e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8806d7c0 con 0x7f9e88156f90 2024-08-17T02:26:35.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.387+0000 7f9e87e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8815ab30 con 0x7f9e880b0e30 2024-08-17T02:26:35.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.387+0000 7f9e87e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8815ae10 con 0x7f9e8815a590 2024-08-17T02:26:35.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.387+0000 7f9e86a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9e880b0e30 0x7f9e880b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.387+0000 7f9e87400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8815a590 0x7f9e8813fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.387+0000 7f9e86a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9e880b0e30 0x7f9e880b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:43804/0 (socket says 172.21.15.6:43804) 2024-08-17T02:26:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.387+0000 7f9e86a00640 1 -- 172.21.15.6:0/1532743309 learned_addr learned my addr 172.21.15.6:0/1532743309 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.388+0000 7f9e86a00640 1 -- 172.21.15.6:0/1532743309 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8815a590 msgr2=0x7f9e8813fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.388+0000 7f9e86a00640 1 --2- 172.21.15.6:0/1532743309 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8815a590 0x7f9e8813fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.388+0000 7f9e86a00640 1 -- 172.21.15.6:0/1532743309 >> v1:172.21.15.136:6789/0 conn(0x7f9e88156f90 legacy=0x7f9e880cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.388+0000 7f9e86000640 1 -- 172.21.15.6:0/1532743309 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482185175 0 0) 0x7f9e8806d7c0 con 0x7f9e88156f90 2024-08-17T02:26:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.388+0000 7f9e86a00640 1 -- 172.21.15.6:0/1532743309 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8815b0f0 con 0x7f9e880b0e30 2024-08-17T02:26:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.388+0000 7f9e87400640 1 --2- 172.21.15.6:0/1532743309 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8815a590 0x7f9e8813fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:35.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.389+0000 7f9e86a00640 1 --2- 172.21.15.6:0/1532743309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e880b0e30 0x7f9e880b1200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009910 tx=0x7f9e780091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc3ff481a49f0876 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.389+0000 7f9e86000640 1 -- 172.21.15.6:0/1532743309 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7802ae40 con 0x7f9e880b0e30 2024-08-17T02:26:35.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.389+0000 7f9e86000640 1 -- 172.21.15.6:0/1532743309 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e78032440 con 0x7f9e880b0e30 2024-08-17T02:26:35.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.389+0000 7f9e86000640 1 -- 172.21.15.6:0/1532743309 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e780327e0 con 0x7f9e880b0e30 2024-08-17T02:26:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.390+0000 7f9e87e00640 1 -- 172.21.15.6:0/1532743309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e880b0e30 msgr2=0x7f9e880b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.390+0000 7f9e87e00640 1 --2- 172.21.15.6:0/1532743309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e880b0e30 0x7f9e880b1200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009910 tx=0x7f9e780091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.390+0000 7f9e87e00640 1 -- 172.21.15.6:0/1532743309 shutdown_connections 2024-08-17T02:26:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.390+0000 7f9e87e00640 1 --2- 172.21.15.6:0/1532743309 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8815a590 0x7f9e8813fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.390+0000 7f9e87e00640 1 --2- 172.21.15.6:0/1532743309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e880b0e30 0x7f9e880b1200 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.390+0000 7f9e87e00640 1 -- 172.21.15.6:0/1532743309 >> 172.21.15.6:0/1532743309 conn(0x7f9e88062af0 msgr2=0x7f9e88062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.390+0000 7f9e87e00640 1 -- 172.21.15.6:0/1532743309 shutdown_connections 2024-08-17T02:26:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.390+0000 7f9e87e00640 1 -- 172.21.15.6:0/1532743309 wait complete. 2024-08-17T02:26:35.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.391+0000 7f9e87e00640 1 Processor -- start 2024-08-17T02:26:35.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.392+0000 7f9e87e00640 1 -- start start 2024-08-17T02:26:35.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.392+0000 7f9e87e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e880b0e30 0x7f9e881360e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.392+0000 7f9e87e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e88156f90 0x7f9e8815d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.393+0000 7f9e87e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8815a590 0x7f9e8815d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.393+0000 7f9e87e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8816d3e0 con 0x7f9e880b0e30 2024-08-17T02:26:35.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.393+0000 7f9e87e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8815cc10 con 0x7f9e88156f90 2024-08-17T02:26:35.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.393+0000 7f9e87e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8815c2e0 con 0x7f9e8815a590 2024-08-17T02:26:35.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.393+0000 7f9e86a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e880b0e30 0x7f9e881360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.393+0000 7f9e86a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e880b0e30 0x7f9e881360e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56762/0 (socket says 172.21.15.6:56762) 2024-08-17T02:26:35.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.393+0000 7f9e86a00640 1 -- 172.21.15.6:0/3328576293 learned_addr learned my addr 172.21.15.6:0/3328576293 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:35.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.393+0000 7f9e7e000640 1 --2- 172.21.15.6:0/3328576293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e88156f90 0x7f9e8815d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.393+0000 7f9e87400640 1 --2- 172.21.15.6:0/3328576293 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8815a590 0x7f9e8815d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.393+0000 7f9e86a00640 1 -- 172.21.15.6:0/3328576293 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8815a590 msgr2=0x7f9e8815d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.393+0000 7f9e86a00640 1 --2- 172.21.15.6:0/3328576293 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8815a590 0x7f9e8815d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.393+0000 7f9e86a00640 1 -- 172.21.15.6:0/3328576293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e88156f90 msgr2=0x7f9e8815d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.393+0000 7f9e86a00640 1 --2- 172.21.15.6:0/3328576293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e88156f90 0x7f9e8815d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.393+0000 7f9e86a00640 1 -- 172.21.15.6:0/3328576293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e80009a20 con 0x7f9e880b0e30 2024-08-17T02:26:35.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.394+0000 7f9e86a00640 1 --2- 172.21.15.6:0/3328576293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e880b0e30 0x7f9e881360e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009940 tx=0x7f9e78032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.394+0000 7f9e7ea00640 1 -- 172.21.15.6:0/3328576293 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e78000c40 con 0x7f9e880b0e30 2024-08-17T02:26:35.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.394+0000 7f9e7ea00640 1 -- 172.21.15.6:0/3328576293 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e78031a90 con 0x7f9e880b0e30 2024-08-17T02:26:35.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.394+0000 7f9e7ea00640 1 -- 172.21.15.6:0/3328576293 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e78031e90 con 0x7f9e880b0e30 2024-08-17T02:26:35.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.394+0000 7f9e87e00640 1 -- 172.21.15.6:0/3328576293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e78009450 con 0x7f9e880b0e30 2024-08-17T02:26:35.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.394+0000 7f9e87e00640 1 -- 172.21.15.6:0/3328576293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8815c8a0 con 0x7f9e880b0e30 2024-08-17T02:26:35.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.395+0000 7f9e87e00640 1 -- 172.21.15.6:0/3328576293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e88070720 con 0x7f9e880b0e30 2024-08-17T02:26:35.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.396+0000 7f9e7ea00640 1 -- 172.21.15.6:0/3328576293 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9e78047450 con 0x7f9e880b0e30 2024-08-17T02:26:35.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.397+0000 7f9e7ea00640 1 --2- 172.21.15.6:0/3328576293 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9e64065150 0x7f9e64067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.397+0000 7f9e7ea00640 1 -- 172.21.15.6:0/3328576293 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e7802ae40 con 0x7f9e880b0e30 2024-08-17T02:26:35.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.397+0000 7f9e7e000640 1 --2- 172.21.15.6:0/3328576293 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9e64065150 0x7f9e64067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.398+0000 7f9e7e000640 1 --2- 172.21.15.6:0/3328576293 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9e64065150 0x7f9e64067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e88159960 tx=0x7f9e70007cc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.400+0000 7f9e7ea00640 1 -- 172.21.15.6:0/3328576293 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9e78070570 con 0x7f9e880b0e30 2024-08-17T02:26:35.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.620+0000 7f9e87e00640 1 -- 172.21.15.6:0/3328576293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e880c7f30 con 0x7f9e880b0e30 2024-08-17T02:26:35.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.621+0000 7f9e7ea00640 1 -- 172.21.15.6:0/3328576293 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4582 (secure 0 0 0) 0x7f9e78073b90 con 0x7f9e880b0e30 2024-08-17T02:26:35.622 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:35.622 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/881817227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":881817227},{"type":"v1","addr":"172.21.15.6:6833","nonce":881817227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/546855411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":546855411},{"type":"v1","addr":"172.21.15.6:6835","nonce":546855411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/539185499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":539185499},{"type":"v1","addr":"172.21.15.136:6837","nonce":539185499}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:31.615645+0000","modified":"2024-08-17T02:26:35.207397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/2230598578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2230598578},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230598578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:35.622 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2024-08-17T02:26:35.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.623+0000 7f9e87e00640 1 -- 172.21.15.6:0/3328576293 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9e64065150 msgr2=0x7f9e64067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.623+0000 7f9e87e00640 1 --2- 172.21.15.6:0/3328576293 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9e64065150 0x7f9e64067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e88159960 tx=0x7f9e70007cc0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.623+0000 7f9e87e00640 1 -- 172.21.15.6:0/3328576293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e880b0e30 msgr2=0x7f9e881360e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.623+0000 7f9e87e00640 1 --2- 172.21.15.6:0/3328576293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e880b0e30 0x7f9e881360e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009940 tx=0x7f9e78032000 comp rx=0 tx=0).stop 2024-08-17T02:26:35.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.623+0000 7f9e87e00640 1 -- 172.21.15.6:0/3328576293 shutdown_connections 2024-08-17T02:26:35.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.623+0000 7f9e87e00640 1 --2- 172.21.15.6:0/3328576293 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9e64065150 0x7f9e64067600 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.623+0000 7f9e87e00640 1 --2- 172.21.15.6:0/3328576293 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e8815a590 0x7f9e8815d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.623+0000 7f9e87e00640 1 --2- 172.21.15.6:0/3328576293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e88156f90 0x7f9e8815d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.623+0000 7f9e87e00640 1 --2- 172.21.15.6:0/3328576293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e880b0e30 0x7f9e881360e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.623+0000 7f9e87e00640 1 -- 172.21.15.6:0/3328576293 >> 172.21.15.6:0/3328576293 conn(0x7f9e88062af0 msgr2=0x7f9e8815eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.623+0000 7f9e87e00640 1 -- 172.21.15.6:0/3328576293 shutdown_connections 2024-08-17T02:26:35.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.623+0000 7f9e87e00640 1 -- 172.21.15.6:0/3328576293 wait complete. 2024-08-17T02:26:35.639 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:35.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.789+0000 7f334ca00640 1 Processor -- start 2024-08-17T02:26:35.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.789+0000 7f334ca00640 1 -- start start 2024-08-17T02:26:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.790+0000 7f334ca00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f33480afca0 0x7f33480b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.790+0000 7f334ca00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f33480acf10 0x7f3348159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.790+0000 7f334ca00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f33481589a0 0x7f3348158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.790+0000 7f334ca00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33480b0980 con 0x7f33481589a0 2024-08-17T02:26:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.790+0000 7f334ca00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f334815a4e0 con 0x7f33480acf10 2024-08-17T02:26:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.790+0000 7f334ca00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33480c92b0 con 0x7f33480afca0 2024-08-17T02:26:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.791+0000 7f3346800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f33481589a0 0x7f3348158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.791+0000 7f3346800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f33481589a0 0x7f3348158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56774/0 (socket says 172.21.15.6:56774) 2024-08-17T02:26:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.791+0000 7f3346800640 1 -- 172.21.15.6:0/2509577893 learned_addr learned my addr 172.21.15.6:0/2509577893 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.791+0000 7f333fe00640 1 --2- 172.21.15.6:0/2509577893 >> v2:172.21.15.136:3300/0 conn(0x7f33480acf10 0x7f3348159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.791+0000 7f3345e00640 1 --2- 172.21.15.6:0/2509577893 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f33480afca0 0x7f33480b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.791+0000 7f3346800640 1 -- 172.21.15.6:0/2509577893 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f33480afca0 msgr2=0x7f33480b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.791+0000 7f3346800640 1 --2- 172.21.15.6:0/2509577893 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f33480afca0 0x7f33480b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.791+0000 7f3346800640 1 -- 172.21.15.6:0/2509577893 >> v2:172.21.15.136:3300/0 conn(0x7f33480acf10 msgr2=0x7f3348159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.791+0000 7f3346800640 1 --2- 172.21.15.6:0/2509577893 >> v2:172.21.15.136:3300/0 conn(0x7f33480acf10 0x7f3348159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.791+0000 7f3346800640 1 -- 172.21.15.6:0/2509577893 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3348159360 con 0x7f33481589a0 2024-08-17T02:26:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.791+0000 7f333fe00640 1 --2- 172.21.15.6:0/2509577893 >> v2:172.21.15.136:3300/0 conn(0x7f33480acf10 0x7f3348159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:35.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.792+0000 7f3346800640 1 --2- 172.21.15.6:0/2509577893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33481589a0 0x7f3348158e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3340009f20 tx=0x7f3340009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451dd6c4bf87efcb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.792+0000 7f3345400640 1 -- 172.21.15.6:0/2509577893 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340031400 con 0x7f33481589a0 2024-08-17T02:26:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.792+0000 7f3345400640 1 -- 172.21.15.6:0/2509577893 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334002d050 con 0x7f33481589a0 2024-08-17T02:26:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.792+0000 7f3345400640 1 -- 172.21.15.6:0/2509577893 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33400317d0 con 0x7f33481589a0 2024-08-17T02:26:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.793+0000 7f334ca00640 1 -- 172.21.15.6:0/2509577893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33481589a0 msgr2=0x7f3348158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.793+0000 7f334ca00640 1 --2- 172.21.15.6:0/2509577893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33481589a0 0x7f3348158e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3340009f20 tx=0x7f3340009840 comp rx=0 tx=0).stop 2024-08-17T02:26:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.793+0000 7f334ca00640 1 -- 172.21.15.6:0/2509577893 shutdown_connections 2024-08-17T02:26:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.793+0000 7f334ca00640 1 --2- 172.21.15.6:0/2509577893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33481589a0 0x7f3348158e20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.793+0000 7f334ca00640 1 --2- 172.21.15.6:0/2509577893 >> v2:172.21.15.136:3300/0 conn(0x7f33480acf10 0x7f3348159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.793+0000 7f334ca00640 1 --2- 172.21.15.6:0/2509577893 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f33480afca0 0x7f33480b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.793+0000 7f334ca00640 1 -- 172.21.15.6:0/2509577893 >> 172.21.15.6:0/2509577893 conn(0x7f3348066e60 msgr2=0x7f3348067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.793+0000 7f334ca00640 1 -- 172.21.15.6:0/2509577893 shutdown_connections 2024-08-17T02:26:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.793+0000 7f334ca00640 1 -- 172.21.15.6:0/2509577893 wait complete. 2024-08-17T02:26:35.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.794+0000 7f334ca00640 1 Processor -- start 2024-08-17T02:26:35.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.795+0000 7f334ca00640 1 -- start start 2024-08-17T02:26:35.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.795+0000 7f334ca00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33480acf10 0x7f334814b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.795+0000 7f334ca00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f33480afca0 0x7f334814bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.795+0000 7f334ca00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33481589a0 0x7f334814c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.795+0000 7f334ca00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33480c76b0 con 0x7f33480acf10 2024-08-17T02:26:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.795+0000 7f334ca00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33480c6540 con 0x7f33481589a0 2024-08-17T02:26:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.795+0000 7f334ca00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3348169340 con 0x7f33480afca0 2024-08-17T02:26:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.796+0000 7f3345e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33480acf10 0x7f334814b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.796+0000 7f3345e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33480acf10 0x7f334814b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56784/0 (socket says 172.21.15.6:56784) 2024-08-17T02:26:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.796+0000 7f3345e00640 1 -- 172.21.15.6:0/2318676301 learned_addr learned my addr 172.21.15.6:0/2318676301 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.796+0000 7f3345e00640 1 -- 172.21.15.6:0/2318676301 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f33480afca0 msgr2=0x7f334814bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.796+0000 7f3345e00640 1 --2- 172.21.15.6:0/2318676301 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f33480afca0 0x7f334814bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.796+0000 7f3345e00640 1 -- 172.21.15.6:0/2318676301 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33481589a0 msgr2=0x7f334814c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.796+0000 7f3345e00640 1 --2- 172.21.15.6:0/2318676301 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33481589a0 0x7f334814c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.796+0000 7f3345e00640 1 -- 172.21.15.6:0/2318676301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3340009ae0 con 0x7f33480acf10 2024-08-17T02:26:35.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.796+0000 7f3345e00640 1 --2- 172.21.15.6:0/2318676301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33480acf10 0x7f334814b730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f333800ea20 tx=0x7f33380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.797+0000 7f333d600640 1 -- 172.21.15.6:0/2318676301 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333800ca10 con 0x7f33480acf10 2024-08-17T02:26:35.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.797+0000 7f333d600640 1 -- 172.21.15.6:0/2318676301 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333800cb70 con 0x7f33480acf10 2024-08-17T02:26:35.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.797+0000 7f333d600640 1 -- 172.21.15.6:0/2318676301 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338013470 con 0x7f33480acf10 2024-08-17T02:26:35.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.797+0000 7f334ca00640 1 -- 172.21.15.6:0/2318676301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3348169e70 con 0x7f33480acf10 2024-08-17T02:26:35.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.797+0000 7f334ca00640 1 -- 172.21.15.6:0/2318676301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f334816a300 con 0x7f33480acf10 2024-08-17T02:26:35.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.798+0000 7f334ca00640 1 -- 172.21.15.6:0/2318676301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3348063fb0 con 0x7f33480acf10 2024-08-17T02:26:35.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.799+0000 7f333d600640 1 -- 172.21.15.6:0/2318676301 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3338013860 con 0x7f33480acf10 2024-08-17T02:26:35.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.800+0000 7f333d600640 1 --2- 172.21.15.6:0/2318676301 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3324065150 0x7f3324067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.800+0000 7f333d600640 1 -- 172.21.15.6:0/2318676301 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f33380827e0 con 0x7f33480acf10 2024-08-17T02:26:35.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.800+0000 7f333fe00640 1 --2- 172.21.15.6:0/2318676301 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3324065150 0x7f3324067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.801+0000 7f333fe00640 1 --2- 172.21.15.6:0/2318676301 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3324065150 0x7f3324067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3330006fd0 tx=0x7f3330008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.804+0000 7f333d600640 1 -- 172.21.15.6:0/2318676301 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3338050800 con 0x7f33480acf10 2024-08-17T02:26:35.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.986+0000 7f334ca00640 1 -- 172.21.15.6:0/2318676301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f334806baf0 con 0x7f33480acf10 2024-08-17T02:26:35.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.987+0000 7f333d600640 1 -- 172.21.15.6:0/2318676301 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f3338053e20 con 0x7f33480acf10 2024-08-17T02:26:35.987 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:35.988 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:33.190571+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:29.257601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:30.596556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:35.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.989+0000 7f334ca00640 1 -- 172.21.15.6:0/2318676301 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3324065150 msgr2=0x7f3324067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.989+0000 7f334ca00640 1 --2- 172.21.15.6:0/2318676301 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3324065150 0x7f3324067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3330006fd0 tx=0x7f3330008040 comp rx=0 tx=0).stop 2024-08-17T02:26:35.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.989+0000 7f334ca00640 1 -- 172.21.15.6:0/2318676301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33480acf10 msgr2=0x7f334814b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.989+0000 7f334ca00640 1 --2- 172.21.15.6:0/2318676301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33480acf10 0x7f334814b730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f333800ea20 tx=0x7f33380090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.989+0000 7f334ca00640 1 -- 172.21.15.6:0/2318676301 shutdown_connections 2024-08-17T02:26:35.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.989+0000 7f334ca00640 1 --2- 172.21.15.6:0/2318676301 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3324065150 0x7f3324067600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.989+0000 7f334ca00640 1 --2- 172.21.15.6:0/2318676301 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33481589a0 0x7f334814c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.989+0000 7f334ca00640 1 --2- 172.21.15.6:0/2318676301 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f33480afca0 0x7f334814bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.989+0000 7f334ca00640 1 --2- 172.21.15.6:0/2318676301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33480acf10 0x7f334814b730 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.989+0000 7f334ca00640 1 -- 172.21.15.6:0/2318676301 >> 172.21.15.6:0/2318676301 conn(0x7f3348066e60 msgr2=0x7f334806d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.989+0000 7f334ca00640 1 -- 172.21.15.6:0/2318676301 shutdown_connections 2024-08-17T02:26:35.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:35.989+0000 7f334ca00640 1 -- 172.21.15.6:0/2318676301 wait complete. 2024-08-17T02:26:36.006 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:26:36.006 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:36.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.156+0000 7efc86c00640 1 Processor -- start 2024-08-17T02:26:36.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.156+0000 7efc86c00640 1 -- start start 2024-08-17T02:26:36.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.157+0000 7efc86c00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efc80158c90 0x7efc800ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.157+0000 7efc86c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7efc800cadc0 0x7efc800cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.157+0000 7efc86c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efc800cca40 0x7efc800685f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.157+0000 7efc86c00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc800cf600 con 0x7efc80158c90 2024-08-17T02:26:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.157+0000 7efc86c00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc800cea90 con 0x7efc800cadc0 2024-08-17T02:26:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.157+0000 7efc86c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc800ced30 con 0x7efc800cca40 2024-08-17T02:26:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.157+0000 7efc85800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efc80158c90 0x7efc800ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.157+0000 7efc85800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efc80158c90 0x7efc800ce180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56788/0 (socket says 172.21.15.6:56788) 2024-08-17T02:26:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.157+0000 7efc85800640 1 -- 172.21.15.6:0/2821279175 learned_addr learned my addr 172.21.15.6:0/2821279175 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.157+0000 7efc84e00640 1 --2- 172.21.15.6:0/2821279175 >> v2:172.21.15.136:3300/0 conn(0x7efc800cadc0 0x7efc800cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.158+0000 7efc86200640 1 --2- 172.21.15.6:0/2821279175 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efc800cca40 0x7efc800685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.158+0000 7efc85800640 1 -- 172.21.15.6:0/2821279175 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efc800cca40 msgr2=0x7efc800685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.158+0000 7efc85800640 1 --2- 172.21.15.6:0/2821279175 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efc800cca40 0x7efc800685f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.158+0000 7efc85800640 1 -- 172.21.15.6:0/2821279175 >> v2:172.21.15.136:3300/0 conn(0x7efc800cadc0 msgr2=0x7efc800cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.158+0000 7efc85800640 1 --2- 172.21.15.6:0/2821279175 >> v2:172.21.15.136:3300/0 conn(0x7efc800cadc0 0x7efc800cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.158+0000 7efc85800640 1 -- 172.21.15.6:0/2821279175 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc800cefd0 con 0x7efc80158c90 2024-08-17T02:26:36.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.159+0000 7efc85800640 1 --2- 172.21.15.6:0/2821279175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc80158c90 0x7efc800ce180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efc800aefb0 tx=0x7efc740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac45a4f9ef905c2a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.159+0000 7efc7fe00640 1 -- 172.21.15.6:0/2821279175 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7402add0 con 0x7efc80158c90 2024-08-17T02:26:36.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.159+0000 7efc7fe00640 1 -- 172.21.15.6:0/2821279175 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc74032440 con 0x7efc80158c90 2024-08-17T02:26:36.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.159+0000 7efc7fe00640 1 -- 172.21.15.6:0/2821279175 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc74032820 con 0x7efc80158c90 2024-08-17T02:26:36.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.159+0000 7efc86c00640 1 -- 172.21.15.6:0/2821279175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc80158c90 msgr2=0x7efc800ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.159+0000 7efc86c00640 1 --2- 172.21.15.6:0/2821279175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc80158c90 0x7efc800ce180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efc800aefb0 tx=0x7efc740091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.159+0000 7efc86c00640 1 -- 172.21.15.6:0/2821279175 shutdown_connections 2024-08-17T02:26:36.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.159+0000 7efc86c00640 1 --2- 172.21.15.6:0/2821279175 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efc800cca40 0x7efc800685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.160+0000 7efc86c00640 1 --2- 172.21.15.6:0/2821279175 >> v2:172.21.15.136:3300/0 conn(0x7efc800cadc0 0x7efc800cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.160+0000 7efc86c00640 1 --2- 172.21.15.6:0/2821279175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc80158c90 0x7efc800ce180 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.160+0000 7efc86c00640 1 -- 172.21.15.6:0/2821279175 >> 172.21.15.6:0/2821279175 conn(0x7efc80087a80 msgr2=0x7efc8006e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.160+0000 7efc86c00640 1 -- 172.21.15.6:0/2821279175 shutdown_connections 2024-08-17T02:26:36.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.160+0000 7efc86c00640 1 -- 172.21.15.6:0/2821279175 wait complete. 2024-08-17T02:26:36.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.161+0000 7efc86c00640 1 Processor -- start 2024-08-17T02:26:36.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.161+0000 7efc86c00640 1 -- start start 2024-08-17T02:26:36.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.162+0000 7efc86c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc800cadc0 0x7efc801496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.162+0000 7efc86c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efc800cca40 0x7efc800c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.162+0000 7efc86c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc80158c90 0x7efc800c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.162+0000 7efc86c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc800c83b0 con 0x7efc800cadc0 2024-08-17T02:26:36.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.162+0000 7efc86c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc800c9000 con 0x7efc80158c90 2024-08-17T02:26:36.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.162+0000 7efc86c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc80149bf0 con 0x7efc800cca40 2024-08-17T02:26:36.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.162+0000 7efc85800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc800cadc0 0x7efc801496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.162+0000 7efc85800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc800cadc0 0x7efc801496b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56790/0 (socket says 172.21.15.6:56790) 2024-08-17T02:26:36.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.162+0000 7efc85800640 1 -- 172.21.15.6:0/1586507832 learned_addr learned my addr 172.21.15.6:0/1586507832 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:36.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.162+0000 7efc84e00640 1 --2- 172.21.15.6:0/1586507832 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efc800cca40 0x7efc800c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.162+0000 7efc86200640 1 --2- 172.21.15.6:0/1586507832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc80158c90 0x7efc800c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.162+0000 7efc85800640 1 -- 172.21.15.6:0/1586507832 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efc800cca40 msgr2=0x7efc800c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.162+0000 7efc85800640 1 --2- 172.21.15.6:0/1586507832 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efc800cca40 0x7efc800c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.162+0000 7efc85800640 1 -- 172.21.15.6:0/1586507832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc80158c90 msgr2=0x7efc800c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.162+0000 7efc85800640 1 --2- 172.21.15.6:0/1586507832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc80158c90 0x7efc800c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.162+0000 7efc85800640 1 -- 172.21.15.6:0/1586507832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc74009450 con 0x7efc800cadc0 2024-08-17T02:26:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.163+0000 7efc84e00640 1 --2- 172.21.15.6:0/1586507832 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efc800cca40 0x7efc800c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.163+0000 7efc86200640 1 --2- 172.21.15.6:0/1586507832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc80158c90 0x7efc800c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.163+0000 7efc85800640 1 --2- 172.21.15.6:0/1586507832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc800cadc0 0x7efc801496b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efc74009210 tx=0x7efc74032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.163+0000 7efc7cc00640 1 -- 172.21.15.6:0/1586507832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc74000d10 con 0x7efc800cadc0 2024-08-17T02:26:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.163+0000 7efc7cc00640 1 -- 172.21.15.6:0/1586507832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc74031de0 con 0x7efc800cadc0 2024-08-17T02:26:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.163+0000 7efc86c00640 1 -- 172.21.15.6:0/1586507832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc800c77a0 con 0x7efc800cadc0 2024-08-17T02:26:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.163+0000 7efc7cc00640 1 -- 172.21.15.6:0/1586507832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7403d650 con 0x7efc800cadc0 2024-08-17T02:26:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.163+0000 7efc86c00640 1 -- 172.21.15.6:0/1586507832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc800c7d60 con 0x7efc800cadc0 2024-08-17T02:26:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.164+0000 7efc86c00640 1 -- 172.21.15.6:0/1586507832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc80070720 con 0x7efc800cadc0 2024-08-17T02:26:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.165+0000 7efc7cc00640 1 -- 172.21.15.6:0/1586507832 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efc74039040 con 0x7efc800cadc0 2024-08-17T02:26:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.166+0000 7efc7cc00640 1 --2- 172.21.15.6:0/1586507832 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7efc60065150 0x7efc60067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.166+0000 7efc7cc00640 1 -- 172.21.15.6:0/1586507832 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efc740a26f0 con 0x7efc800cadc0 2024-08-17T02:26:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.166+0000 7efc84e00640 1 --2- 172.21.15.6:0/1586507832 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7efc60065150 0x7efc60067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.167+0000 7efc84e00640 1 --2- 172.21.15.6:0/1586507832 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7efc60065150 0x7efc60067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efc8016c4a0 tx=0x7efc6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.170+0000 7efc7cc00640 1 -- 172.21.15.6:0/1586507832 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efc74070710 con 0x7efc800cadc0 2024-08-17T02:26:36.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.351+0000 7efc86c00640 1 -- 172.21.15.6:0/1586507832 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc800c84f0 con 0x7efc60065150 2024-08-17T02:26:36.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.360+0000 7efc7cc00640 1 -- 172.21.15.6:0/1586507832 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264692 (secure 0 0 0) 0x7efc6c00fd30 con 0x7efc60065150 2024-08-17T02:26:36.364 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-08-17T02:26:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.364+0000 7efc86c00640 1 -- 172.21.15.6:0/1586507832 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7efc60065150 msgr2=0x7efc60067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.364+0000 7efc86c00640 1 --2- 172.21.15.6:0/1586507832 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7efc60065150 0x7efc60067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efc8016c4a0 tx=0x7efc6c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.364+0000 7efc86c00640 1 -- 172.21.15.6:0/1586507832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc800cadc0 msgr2=0x7efc801496b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.364+0000 7efc86c00640 1 --2- 172.21.15.6:0/1586507832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc800cadc0 0x7efc801496b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efc74009210 tx=0x7efc74032000 comp rx=0 tx=0).stop 2024-08-17T02:26:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.364+0000 7efc86c00640 1 -- 172.21.15.6:0/1586507832 shutdown_connections 2024-08-17T02:26:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.364+0000 7efc86c00640 1 --2- 172.21.15.6:0/1586507832 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7efc60065150 0x7efc60067600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.364+0000 7efc86c00640 1 --2- 172.21.15.6:0/1586507832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc80158c90 0x7efc800c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.364+0000 7efc86c00640 1 --2- 172.21.15.6:0/1586507832 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efc800cca40 0x7efc800c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.364+0000 7efc86c00640 1 --2- 172.21.15.6:0/1586507832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc800cadc0 0x7efc801496b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.364+0000 7efc86c00640 1 -- 172.21.15.6:0/1586507832 >> 172.21.15.6:0/1586507832 conn(0x7efc80087a80 msgr2=0x7efc801578a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.364+0000 7efc86c00640 1 -- 172.21.15.6:0/1586507832 shutdown_connections 2024-08-17T02:26:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.364+0000 7efc86c00640 1 -- 172.21.15.6:0/1586507832 wait complete. 2024-08-17T02:26:36.380 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-08-17T02:26:35.408644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381800,"kb_used_data":2908,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592920,"statfs":{"total":773094113280,"available":770655150080,"internally_reserved":0,"allocated":2977792,"data_stored":1781628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.240102"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.203459+0000","last_change":"2024-08-17T02:26:32.199441+0000","last_active":"2024-08-17T02:26:32.203459+0000","last_peered":"2024-08-17T02:26:32.203459+0000","last_clean":"2024-08-17T02:26:32.203459+0000","last_became_active":"2024-08-17T02:26:32.195327+0000","last_became_peered":"2024-08-17T02:26:32.195327+0000","last_unstale":"2024-08-17T02:26:32.203459+0000","last_undegraded":"2024-08-17T02:26:32.203459+0000","last_fullsized":"2024-08-17T02:26:32.203459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:23.907523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.202662+0000","last_change":"2024-08-17T02:26:32.199560+0000","last_active":"2024-08-17T02:26:32.202662+0000","last_peered":"2024-08-17T02:26:32.202662+0000","last_clean":"2024-08-17T02:26:32.202662+0000","last_became_active":"2024-08-17T02:26:32.199175+0000","last_became_peered":"2024-08-17T02:26:32.199175+0000","last_unstale":"2024-08-17T02:26:32.202662+0000","last_undegraded":"2024-08-17T02:26:32.202662+0000","last_fullsized":"2024-08-17T02:26:32.202662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:47.234447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.207600+0000","last_change":"2024-08-17T02:26:32.203519+0000","last_active":"2024-08-17T02:26:32.207600+0000","last_peered":"2024-08-17T02:26:32.207600+0000","last_clean":"2024-08-17T02:26:32.207600+0000","last_became_active":"2024-08-17T02:26:32.202958+0000","last_became_peered":"2024-08-17T02:26:32.202958+0000","last_unstale":"2024-08-17T02:26:32.207600+0000","last_undegraded":"2024-08-17T02:26:32.207600+0000","last_fullsized":"2024-08-17T02:26:32.207600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:18.537099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.227468+0000","last_change":"2024-08-17T02:26:32.225955+0000","last_active":"2024-08-17T02:26:32.227468+0000","last_peered":"2024-08-17T02:26:32.227468+0000","last_clean":"2024-08-17T02:26:32.227468+0000","last_became_active":"2024-08-17T02:26:32.225708+0000","last_became_peered":"2024-08-17T02:26:32.225708+0000","last_unstale":"2024-08-17T02:26:32.227468+0000","last_undegraded":"2024-08-17T02:26:32.227468+0000","last_fullsized":"2024-08-17T02:26:32.227468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:25:34.108888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.208559+0000","last_change":"2024-08-17T02:26:32.204692+0000","last_active":"2024-08-17T02:26:32.208559+0000","last_peered":"2024-08-17T02:26:32.208559+0000","last_clean":"2024-08-17T02:26:32.208559+0000","last_became_active":"2024-08-17T02:26:32.203666+0000","last_became_peered":"2024-08-17T02:26:32.203666+0000","last_unstale":"2024-08-17T02:26:32.208559+0000","last_undegraded":"2024-08-17T02:26:32.208559+0000","last_fullsized":"2024-08-17T02:26:32.208559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:25:34.108888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.214622+0000","last_change":"2024-08-17T02:26:32.209096+0000","last_active":"2024-08-17T02:26:32.214622+0000","last_peered":"2024-08-17T02:26:32.214622+0000","last_clean":"2024-08-17T02:26:32.214622+0000","last_became_active":"2024-08-17T02:26:32.208883+0000","last_became_peered":"2024-08-17T02:26:32.208883+0000","last_unstale":"2024-08-17T02:26:32.214622+0000","last_undegraded":"2024-08-17T02:26:32.214622+0000","last_fullsized":"2024-08-17T02:26:32.214622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:25.408345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.207833+0000","last_change":"2024-08-17T02:26:32.201368+0000","last_active":"2024-08-17T02:26:32.207833+0000","last_peered":"2024-08-17T02:26:32.207833+0000","last_clean":"2024-08-17T02:26:32.207833+0000","last_became_active":"2024-08-17T02:26:32.200370+0000","last_became_peered":"2024-08-17T02:26:32.200370+0000","last_unstale":"2024-08-17T02:26:32.207833+0000","last_undegraded":"2024-08-17T02:26:32.207833+0000","last_fullsized":"2024-08-17T02:26:32.207833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:15:23.868986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.220653+0000","last_change":"2024-08-17T02:26:32.215927+0000","last_active":"2024-08-17T02:26:32.220653+0000","last_peered":"2024-08-17T02:26:32.220653+0000","last_clean":"2024-08-17T02:26:32.220653+0000","last_became_active":"2024-08-17T02:26:32.215631+0000","last_became_peered":"2024-08-17T02:26:32.215631+0000","last_unstale":"2024-08-17T02:26:32.220653+0000","last_undegraded":"2024-08-17T02:26:32.220653+0000","last_fullsized":"2024-08-17T02:26:32.220653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223514+0000","last_change":"2024-08-17T02:26:32.218745+0000","last_active":"2024-08-17T02:26:32.223514+0000","last_peered":"2024-08-17T02:26:32.223514+0000","last_clean":"2024-08-17T02:26:32.223514+0000","last_became_active":"2024-08-17T02:26:32.218069+0000","last_became_peered":"2024-08-17T02:26:32.218069+0000","last_unstale":"2024-08-17T02:26:32.223514+0000","last_undegraded":"2024-08-17T02:26:32.223514+0000","last_fullsized":"2024-08-17T02:26:32.223514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:53.799652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.219488+0000","last_change":"2024-08-17T02:26:32.215519+0000","last_active":"2024-08-17T02:26:32.219488+0000","last_peered":"2024-08-17T02:26:32.219488+0000","last_clean":"2024-08-17T02:26:32.219488+0000","last_became_active":"2024-08-17T02:26:32.215218+0000","last_became_peered":"2024-08-17T02:26:32.215218+0000","last_unstale":"2024-08-17T02:26:32.219488+0000","last_undegraded":"2024-08-17T02:26:32.219488+0000","last_fullsized":"2024-08-17T02:26:32.219488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:39.950692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210439+0000","last_change":"2024-08-17T02:26:32.205449+0000","last_active":"2024-08-17T02:26:32.210439+0000","last_peered":"2024-08-17T02:26:32.210439+0000","last_clean":"2024-08-17T02:26:32.210439+0000","last_became_active":"2024-08-17T02:26:32.205156+0000","last_became_peered":"2024-08-17T02:26:32.205156+0000","last_unstale":"2024-08-17T02:26:32.210439+0000","last_undegraded":"2024-08-17T02:26:32.210439+0000","last_fullsized":"2024-08-17T02:26:32.210439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.221575+0000","last_change":"2024-08-17T02:26:32.203589+0000","last_active":"2024-08-17T02:26:32.221575+0000","last_peered":"2024-08-17T02:26:32.221575+0000","last_clean":"2024-08-17T02:26:32.221575+0000","last_became_active":"2024-08-17T02:26:32.200349+0000","last_became_peered":"2024-08-17T02:26:32.200349+0000","last_unstale":"2024-08-17T02:26:32.221575+0000","last_undegraded":"2024-08-17T02:26:32.221575+0000","last_fullsized":"2024-08-17T02:26:32.221575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:18.353263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.217316+0000","last_change":"2024-08-17T02:26:32.209097+0000","last_active":"2024-08-17T02:26:32.217316+0000","last_peered":"2024-08-17T02:26:32.217316+0000","last_clean":"2024-08-17T02:26:32.217316+0000","last_became_active":"2024-08-17T02:26:32.205693+0000","last_became_peered":"2024-08-17T02:26:32.205693+0000","last_unstale":"2024-08-17T02:26:32.217316+0000","last_undegraded":"2024-08-17T02:26:32.217316+0000","last_fullsized":"2024-08-17T02:26:32.217316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:47.234447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.206406+0000","last_change":"2024-08-17T02:26:32.202857+0000","last_active":"2024-08-17T02:26:32.206406+0000","last_peered":"2024-08-17T02:26:32.206406+0000","last_clean":"2024-08-17T02:26:32.206406+0000","last_became_active":"2024-08-17T02:26:32.202620+0000","last_became_peered":"2024-08-17T02:26:32.202620+0000","last_unstale":"2024-08-17T02:26:32.206406+0000","last_undegraded":"2024-08-17T02:26:32.206406+0000","last_fullsized":"2024-08-17T02:26:32.206406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:53.545799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.205254+0000","last_change":"2024-08-17T02:26:32.201410+0000","last_active":"2024-08-17T02:26:32.205254+0000","last_peered":"2024-08-17T02:26:32.205254+0000","last_clean":"2024-08-17T02:26:32.205254+0000","last_became_active":"2024-08-17T02:26:32.201146+0000","last_became_peered":"2024-08-17T02:26:32.201146+0000","last_unstale":"2024-08-17T02:26:32.205254+0000","last_undegraded":"2024-08-17T02:26:32.205254+0000","last_fullsized":"2024-08-17T02:26:32.205254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:39.950692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.213147+0000","last_change":"2024-08-17T02:26:32.209517+0000","last_active":"2024-08-17T02:26:32.213147+0000","last_peered":"2024-08-17T02:26:32.213147+0000","last_clean":"2024-08-17T02:26:32.213147+0000","last_became_active":"2024-08-17T02:26:32.209006+0000","last_became_peered":"2024-08-17T02:26:32.209006+0000","last_unstale":"2024-08-17T02:26:32.213147+0000","last_undegraded":"2024-08-17T02:26:32.213147+0000","last_fullsized":"2024-08-17T02:26:32.213147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:56:37.929984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.212900+0000","last_change":"2024-08-17T02:26:32.207200+0000","last_active":"2024-08-17T02:26:32.212900+0000","last_peered":"2024-08-17T02:26:32.212900+0000","last_clean":"2024-08-17T02:26:32.212900+0000","last_became_active":"2024-08-17T02:26:32.206936+0000","last_became_peered":"2024-08-17T02:26:32.206936+0000","last_unstale":"2024-08-17T02:26:32.212900+0000","last_undegraded":"2024-08-17T02:26:32.212900+0000","last_fullsized":"2024-08-17T02:26:32.212900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.201442+0000","last_change":"2024-08-17T02:26:32.197012+0000","last_active":"2024-08-17T02:26:32.201442+0000","last_peered":"2024-08-17T02:26:32.201442+0000","last_clean":"2024-08-17T02:26:32.201442+0000","last_became_active":"2024-08-17T02:26:32.196767+0000","last_became_peered":"2024-08-17T02:26:32.196767+0000","last_unstale":"2024-08-17T02:26:32.201442+0000","last_undegraded":"2024-08-17T02:26:32.201442+0000","last_fullsized":"2024-08-17T02:26:32.201442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:18.353263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.208488+0000","last_change":"2024-08-17T02:26:32.204201+0000","last_active":"2024-08-17T02:26:32.208488+0000","last_peered":"2024-08-17T02:26:32.208488+0000","last_clean":"2024-08-17T02:26:32.208488+0000","last_became_active":"2024-08-17T02:26:32.203698+0000","last_became_peered":"2024-08-17T02:26:32.203698+0000","last_unstale":"2024-08-17T02:26:32.208488+0000","last_undegraded":"2024-08-17T02:26:32.208488+0000","last_fullsized":"2024-08-17T02:26:32.208488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:19:31.787387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210386+0000","last_change":"2024-08-17T02:26:32.204316+0000","last_active":"2024-08-17T02:26:32.210386+0000","last_peered":"2024-08-17T02:26:32.210386+0000","last_clean":"2024-08-17T02:26:32.210386+0000","last_became_active":"2024-08-17T02:26:32.203847+0000","last_became_peered":"2024-08-17T02:26:32.203847+0000","last_unstale":"2024-08-17T02:26:32.210386+0000","last_undegraded":"2024-08-17T02:26:32.210386+0000","last_fullsized":"2024-08-17T02:26:32.210386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.212827+0000","last_change":"2024-08-17T02:26:32.210228+0000","last_active":"2024-08-17T02:26:32.212827+0000","last_peered":"2024-08-17T02:26:32.212827+0000","last_clean":"2024-08-17T02:26:32.212827+0000","last_became_active":"2024-08-17T02:26:32.209517+0000","last_became_peered":"2024-08-17T02:26:32.209517+0000","last_unstale":"2024-08-17T02:26:32.212827+0000","last_undegraded":"2024-08-17T02:26:32.212827+0000","last_fullsized":"2024-08-17T02:26:32.212827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.221242+0000","last_change":"2024-08-17T02:26:32.213782+0000","last_active":"2024-08-17T02:26:32.221242+0000","last_peered":"2024-08-17T02:26:32.221242+0000","last_clean":"2024-08-17T02:26:32.221242+0000","last_became_active":"2024-08-17T02:26:32.213525+0000","last_became_peered":"2024-08-17T02:26:32.213525+0000","last_unstale":"2024-08-17T02:26:32.221242+0000","last_undegraded":"2024-08-17T02:26:32.221242+0000","last_fullsized":"2024-08-17T02:26:32.221242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:59.385496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216837+0000","last_change":"2024-08-17T02:26:32.208770+0000","last_active":"2024-08-17T02:26:32.216837+0000","last_peered":"2024-08-17T02:26:32.216837+0000","last_clean":"2024-08-17T02:26:32.216837+0000","last_became_active":"2024-08-17T02:26:32.208425+0000","last_became_peered":"2024-08-17T02:26:32.208425+0000","last_unstale":"2024-08-17T02:26:32.216837+0000","last_undegraded":"2024-08-17T02:26:32.216837+0000","last_fullsized":"2024-08-17T02:26:32.216837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222669+0000","last_change":"2024-08-17T02:26:32.218955+0000","last_active":"2024-08-17T02:26:32.222669+0000","last_peered":"2024-08-17T02:26:32.222669+0000","last_clean":"2024-08-17T02:26:32.222669+0000","last_became_active":"2024-08-17T02:26:32.218670+0000","last_became_peered":"2024-08-17T02:26:32.218670+0000","last_unstale":"2024-08-17T02:26:32.222669+0000","last_undegraded":"2024-08-17T02:26:32.222669+0000","last_fullsized":"2024-08-17T02:26:32.222669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224570+0000","last_change":"2024-08-17T02:26:32.219168+0000","last_active":"2024-08-17T02:26:32.224570+0000","last_peered":"2024-08-17T02:26:32.224570+0000","last_clean":"2024-08-17T02:26:32.224570+0000","last_became_active":"2024-08-17T02:26:32.218856+0000","last_became_peered":"2024-08-17T02:26:32.218856+0000","last_unstale":"2024-08-17T02:26:32.224570+0000","last_undegraded":"2024-08-17T02:26:32.224570+0000","last_fullsized":"2024-08-17T02:26:32.224570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:12.730663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210090+0000","last_change":"2024-08-17T02:26:32.202312+0000","last_active":"2024-08-17T02:26:32.210090+0000","last_peered":"2024-08-17T02:26:32.210090+0000","last_clean":"2024-08-17T02:26:32.210090+0000","last_became_active":"2024-08-17T02:26:32.202077+0000","last_became_peered":"2024-08-17T02:26:32.202077+0000","last_unstale":"2024-08-17T02:26:32.210090+0000","last_undegraded":"2024-08-17T02:26:32.210090+0000","last_fullsized":"2024-08-17T02:26:32.210090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:12.730663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.205085+0000","last_change":"2024-08-17T02:26:32.201137+0000","last_active":"2024-08-17T02:26:32.205085+0000","last_peered":"2024-08-17T02:26:32.205085+0000","last_clean":"2024-08-17T02:26:32.205085+0000","last_became_active":"2024-08-17T02:26:32.200498+0000","last_became_peered":"2024-08-17T02:26:32.200498+0000","last_unstale":"2024-08-17T02:26:32.205085+0000","last_undegraded":"2024-08-17T02:26:32.205085+0000","last_fullsized":"2024-08-17T02:26:32.205085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:59.385496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.225211+0000","last_change":"2024-08-17T02:26:32.221220+0000","last_active":"2024-08-17T02:26:32.225211+0000","last_peered":"2024-08-17T02:26:32.225211+0000","last_clean":"2024-08-17T02:26:32.225211+0000","last_became_active":"2024-08-17T02:26:32.220959+0000","last_became_peered":"2024-08-17T02:26:32.220959+0000","last_unstale":"2024-08-17T02:26:32.225211+0000","last_undegraded":"2024-08-17T02:26:32.225211+0000","last_fullsized":"2024-08-17T02:26:32.225211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:39.950692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.202233+0000","last_change":"2024-08-17T02:26:32.199159+0000","last_active":"2024-08-17T02:26:32.202233+0000","last_peered":"2024-08-17T02:26:32.202233+0000","last_clean":"2024-08-17T02:26:32.202233+0000","last_became_active":"2024-08-17T02:26:32.198845+0000","last_became_peered":"2024-08-17T02:26:32.198845+0000","last_unstale":"2024-08-17T02:26:32.202233+0000","last_undegraded":"2024-08-17T02:26:32.202233+0000","last_fullsized":"2024-08-17T02:26:32.202233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:12.730663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222754+0000","last_change":"2024-08-17T02:26:32.218327+0000","last_active":"2024-08-17T02:26:32.222754+0000","last_peered":"2024-08-17T02:26:32.222754+0000","last_clean":"2024-08-17T02:26:32.222754+0000","last_became_active":"2024-08-17T02:26:32.218052+0000","last_became_peered":"2024-08-17T02:26:32.218052+0000","last_unstale":"2024-08-17T02:26:32.222754+0000","last_undegraded":"2024-08-17T02:26:32.222754+0000","last_fullsized":"2024-08-17T02:26:32.222754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:59.331351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.202572+0000","last_change":"2024-08-17T02:26:32.199446+0000","last_active":"2024-08-17T02:26:32.202572+0000","last_peered":"2024-08-17T02:26:32.202572+0000","last_clean":"2024-08-17T02:26:32.202572+0000","last_became_active":"2024-08-17T02:26:32.199139+0000","last_became_peered":"2024-08-17T02:26:32.199139+0000","last_unstale":"2024-08-17T02:26:32.202572+0000","last_undegraded":"2024-08-17T02:26:32.202572+0000","last_fullsized":"2024-08-17T02:26:32.202572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:08.860859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.209270+0000","last_change":"2024-08-17T02:26:32.199075+0000","last_active":"2024-08-17T02:26:32.209270+0000","last_peered":"2024-08-17T02:26:32.209270+0000","last_clean":"2024-08-17T02:26:32.209270+0000","last_became_active":"2024-08-17T02:26:32.198255+0000","last_became_peered":"2024-08-17T02:26:32.198255+0000","last_unstale":"2024-08-17T02:26:32.209270+0000","last_undegraded":"2024-08-17T02:26:32.209270+0000","last_fullsized":"2024-08-17T02:26:32.209270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:18.537099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.201883+0000","last_change":"2024-08-17T02:26:32.199005+0000","last_active":"2024-08-17T02:26:32.201883+0000","last_peered":"2024-08-17T02:26:32.201883+0000","last_clean":"2024-08-17T02:26:32.201883+0000","last_became_active":"2024-08-17T02:26:32.198711+0000","last_became_peered":"2024-08-17T02:26:32.198711+0000","last_unstale":"2024-08-17T02:26:32.201883+0000","last_undegraded":"2024-08-17T02:26:32.201883+0000","last_fullsized":"2024-08-17T02:26:32.201883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:22.633118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223675+0000","last_change":"2024-08-17T02:26:31.188549+0000","last_active":"2024-08-17T02:26:32.223675+0000","last_peered":"2024-08-17T02:26:32.223675+0000","last_clean":"2024-08-17T02:26:32.223675+0000","last_became_active":"2024-08-17T02:26:31.188272+0000","last_became_peered":"2024-08-17T02:26:31.188272+0000","last_unstale":"2024-08-17T02:26:32.223675+0000","last_undegraded":"2024-08-17T02:26:32.223675+0000","last_fullsized":"2024-08-17T02:26:32.223675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:46.029644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222700+0000","last_change":"2024-08-17T02:26:32.214370+0000","last_active":"2024-08-17T02:26:32.222700+0000","last_peered":"2024-08-17T02:26:32.222700+0000","last_clean":"2024-08-17T02:26:32.222700+0000","last_became_active":"2024-08-17T02:26:32.214126+0000","last_became_peered":"2024-08-17T02:26:32.214126+0000","last_unstale":"2024-08-17T02:26:32.222700+0000","last_undegraded":"2024-08-17T02:26:32.222700+0000","last_fullsized":"2024-08-17T02:26:32.222700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:39.950692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224831+0000","last_change":"2024-08-17T02:26:31.203526+0000","last_active":"2024-08-17T02:26:32.224831+0000","last_peered":"2024-08-17T02:26:32.224831+0000","last_clean":"2024-08-17T02:26:32.224831+0000","last_became_active":"2024-08-17T02:26:31.202971+0000","last_became_peered":"2024-08-17T02:26:31.202971+0000","last_unstale":"2024-08-17T02:26:32.224831+0000","last_undegraded":"2024-08-17T02:26:32.224831+0000","last_fullsized":"2024-08-17T02:26:32.224831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:29.752289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.191559+0000","last_change":"2024-08-17T02:26:31.200001+0000","last_active":"2024-08-17T02:26:32.191559+0000","last_peered":"2024-08-17T02:26:32.191559+0000","last_clean":"2024-08-17T02:26:32.191559+0000","last_became_active":"2024-08-17T02:26:31.199719+0000","last_became_peered":"2024-08-17T02:26:31.199719+0000","last_unstale":"2024-08-17T02:26:32.191559+0000","last_undegraded":"2024-08-17T02:26:32.191559+0000","last_fullsized":"2024-08-17T02:26:32.191559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:13:53.155805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216384+0000","last_change":"2024-08-17T02:26:32.204465+0000","last_active":"2024-08-17T02:26:32.216384+0000","last_peered":"2024-08-17T02:26:32.216384+0000","last_clean":"2024-08-17T02:26:32.216384+0000","last_became_active":"2024-08-17T02:26:32.204203+0000","last_became_peered":"2024-08-17T02:26:32.204203+0000","last_unstale":"2024-08-17T02:26:32.216384+0000","last_undegraded":"2024-08-17T02:26:32.216384+0000","last_fullsized":"2024-08-17T02:26:32.216384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:22.493908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.192718+0000","last_change":"2024-08-17T02:26:31.195728+0000","last_active":"2024-08-17T02:26:32.192718+0000","last_peered":"2024-08-17T02:26:32.192718+0000","last_clean":"2024-08-17T02:26:32.192718+0000","last_became_active":"2024-08-17T02:26:31.195461+0000","last_became_peered":"2024-08-17T02:26:31.195461+0000","last_unstale":"2024-08-17T02:26:32.192718+0000","last_undegraded":"2024-08-17T02:26:32.192718+0000","last_fullsized":"2024-08-17T02:26:32.192718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:00.267868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.205273+0000","last_change":"2024-08-17T02:26:32.201225+0000","last_active":"2024-08-17T02:26:32.205273+0000","last_peered":"2024-08-17T02:26:32.205273+0000","last_clean":"2024-08-17T02:26:32.205273+0000","last_became_active":"2024-08-17T02:26:32.200883+0000","last_became_peered":"2024-08-17T02:26:32.200883+0000","last_unstale":"2024-08-17T02:26:32.205273+0000","last_undegraded":"2024-08-17T02:26:32.205273+0000","last_fullsized":"2024-08-17T02:26:32.205273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.196667+0000","last_change":"2024-08-17T02:26:31.203729+0000","last_active":"2024-08-17T02:26:32.196667+0000","last_peered":"2024-08-17T02:26:32.196667+0000","last_clean":"2024-08-17T02:26:32.196667+0000","last_became_active":"2024-08-17T02:26:31.203402+0000","last_became_peered":"2024-08-17T02:26:31.203402+0000","last_unstale":"2024-08-17T02:26:32.196667+0000","last_undegraded":"2024-08-17T02:26:32.196667+0000","last_fullsized":"2024-08-17T02:26:32.196667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:21.626630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.214196+0000","last_change":"2024-08-17T02:26:32.209985+0000","last_active":"2024-08-17T02:26:32.214196+0000","last_peered":"2024-08-17T02:26:32.214196+0000","last_clean":"2024-08-17T02:26:32.214196+0000","last_became_active":"2024-08-17T02:26:32.209542+0000","last_became_peered":"2024-08-17T02:26:32.209542+0000","last_unstale":"2024-08-17T02:26:32.214196+0000","last_undegraded":"2024-08-17T02:26:32.214196+0000","last_fullsized":"2024-08-17T02:26:32.214196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:47.234447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.209840+0000","last_change":"2024-08-17T02:26:31.205754+0000","last_active":"2024-08-17T02:26:32.209840+0000","last_peered":"2024-08-17T02:26:32.209840+0000","last_clean":"2024-08-17T02:26:32.209840+0000","last_became_active":"2024-08-17T02:26:31.205187+0000","last_became_peered":"2024-08-17T02:26:31.205187+0000","last_unstale":"2024-08-17T02:26:32.209840+0000","last_undegraded":"2024-08-17T02:26:32.209840+0000","last_fullsized":"2024-08-17T02:26:32.209840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:36.476579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222736+0000","last_change":"2024-08-17T02:26:32.213334+0000","last_active":"2024-08-17T02:26:32.222736+0000","last_peered":"2024-08-17T02:26:32.222736+0000","last_clean":"2024-08-17T02:26:32.222736+0000","last_became_active":"2024-08-17T02:26:32.213073+0000","last_became_peered":"2024-08-17T02:26:32.213073+0000","last_unstale":"2024-08-17T02:26:32.222736+0000","last_undegraded":"2024-08-17T02:26:32.222736+0000","last_fullsized":"2024-08-17T02:26:32.222736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:16:50.112486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.226031+0000","last_change":"2024-08-17T02:26:31.193999+0000","last_active":"2024-08-17T02:26:32.226031+0000","last_peered":"2024-08-17T02:26:32.226031+0000","last_clean":"2024-08-17T02:26:32.226031+0000","last_became_active":"2024-08-17T02:26:31.193689+0000","last_became_peered":"2024-08-17T02:26:31.193689+0000","last_unstale":"2024-08-17T02:26:32.226031+0000","last_undegraded":"2024-08-17T02:26:32.226031+0000","last_fullsized":"2024-08-17T02:26:32.226031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:07.854371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.221598+0000","last_change":"2024-08-17T02:26:32.210669+0000","last_active":"2024-08-17T02:26:32.221598+0000","last_peered":"2024-08-17T02:26:32.221598+0000","last_clean":"2024-08-17T02:26:32.221598+0000","last_became_active":"2024-08-17T02:26:32.203230+0000","last_became_peered":"2024-08-17T02:26:32.203230+0000","last_unstale":"2024-08-17T02:26:32.221598+0000","last_undegraded":"2024-08-17T02:26:32.221598+0000","last_fullsized":"2024-08-17T02:26:32.221598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:35.520908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.228823+0000","last_change":"2024-08-17T02:26:31.204431+0000","last_active":"2024-08-17T02:26:32.228823+0000","last_peered":"2024-08-17T02:26:32.228823+0000","last_clean":"2024-08-17T02:26:32.228823+0000","last_became_active":"2024-08-17T02:26:31.204173+0000","last_became_peered":"2024-08-17T02:26:31.204173+0000","last_unstale":"2024-08-17T02:26:32.228823+0000","last_undegraded":"2024-08-17T02:26:32.228823+0000","last_fullsized":"2024-08-17T02:26:32.228823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:36.476579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223479+0000","last_change":"2024-08-17T02:26:32.216157+0000","last_active":"2024-08-17T02:26:32.223479+0000","last_peered":"2024-08-17T02:26:32.223479+0000","last_clean":"2024-08-17T02:26:32.223479+0000","last_became_active":"2024-08-17T02:26:32.215849+0000","last_became_peered":"2024-08-17T02:26:32.215849+0000","last_unstale":"2024-08-17T02:26:32.223479+0000","last_undegraded":"2024-08-17T02:26:32.223479+0000","last_fullsized":"2024-08-17T02:26:32.223479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:47.234447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.225699+0000","last_change":"2024-08-17T02:26:31.203059+0000","last_active":"2024-08-17T02:26:32.225699+0000","last_peered":"2024-08-17T02:26:32.225699+0000","last_clean":"2024-08-17T02:26:32.225699+0000","last_became_active":"2024-08-17T02:26:31.202794+0000","last_became_peered":"2024-08-17T02:26:31.202794+0000","last_unstale":"2024-08-17T02:26:32.225699+0000","last_undegraded":"2024-08-17T02:26:32.225699+0000","last_fullsized":"2024-08-17T02:26:32.225699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:46.029644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216333+0000","last_change":"2024-08-17T02:26:32.210912+0000","last_active":"2024-08-17T02:26:32.216333+0000","last_peered":"2024-08-17T02:26:32.216333+0000","last_clean":"2024-08-17T02:26:32.216333+0000","last_became_active":"2024-08-17T02:26:32.210509+0000","last_became_peered":"2024-08-17T02:26:32.210509+0000","last_unstale":"2024-08-17T02:26:32.216333+0000","last_undegraded":"2024-08-17T02:26:32.216333+0000","last_fullsized":"2024-08-17T02:26:32.216333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:08.860859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210217+0000","last_change":"2024-08-17T02:26:31.197665+0000","last_active":"2024-08-17T02:26:32.210217+0000","last_peered":"2024-08-17T02:26:32.210217+0000","last_clean":"2024-08-17T02:26:32.210217+0000","last_became_active":"2024-08-17T02:26:31.197429+0000","last_became_peered":"2024-08-17T02:26:31.197429+0000","last_unstale":"2024-08-17T02:26:32.210217+0000","last_undegraded":"2024-08-17T02:26:32.210217+0000","last_fullsized":"2024-08-17T02:26:32.210217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:14.675670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.208532+0000","last_change":"2024-08-17T02:26:32.204360+0000","last_active":"2024-08-17T02:26:32.208532+0000","last_peered":"2024-08-17T02:26:32.208532+0000","last_clean":"2024-08-17T02:26:32.208532+0000","last_became_active":"2024-08-17T02:26:32.197360+0000","last_became_peered":"2024-08-17T02:26:32.197360+0000","last_unstale":"2024-08-17T02:26:32.208532+0000","last_undegraded":"2024-08-17T02:26:32.208532+0000","last_fullsized":"2024-08-17T02:26:32.208532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:04:17.552404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.193585+0000","last_change":"2024-08-17T02:26:31.203360+0000","last_active":"2024-08-17T02:26:32.193585+0000","last_peered":"2024-08-17T02:26:32.193585+0000","last_clean":"2024-08-17T02:26:32.193585+0000","last_became_active":"2024-08-17T02:26:31.202988+0000","last_became_peered":"2024-08-17T02:26:31.202988+0000","last_unstale":"2024-08-17T02:26:32.193585+0000","last_undegraded":"2024-08-17T02:26:32.193585+0000","last_fullsized":"2024-08-17T02:26:32.193585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:53:03.434511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.214346+0000","last_change":"2024-08-17T02:26:32.198486+0000","last_active":"2024-08-17T02:26:32.214346+0000","last_peered":"2024-08-17T02:26:32.214346+0000","last_clean":"2024-08-17T02:26:32.214346+0000","last_became_active":"2024-08-17T02:26:32.197905+0000","last_became_peered":"2024-08-17T02:26:32.197905+0000","last_unstale":"2024-08-17T02:26:32.214346+0000","last_undegraded":"2024-08-17T02:26:32.214346+0000","last_fullsized":"2024-08-17T02:26:32.214346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:53.545799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.226669+0000","last_change":"2024-08-17T02:26:31.193931+0000","last_active":"2024-08-17T02:26:32.226669+0000","last_peered":"2024-08-17T02:26:32.226669+0000","last_clean":"2024-08-17T02:26:32.226669+0000","last_became_active":"2024-08-17T02:26:31.192003+0000","last_became_peered":"2024-08-17T02:26:31.192003+0000","last_unstale":"2024-08-17T02:26:32.226669+0000","last_undegraded":"2024-08-17T02:26:32.226669+0000","last_fullsized":"2024-08-17T02:26:32.226669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:14.675670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.209304+0000","last_change":"2024-08-17T02:26:32.206117+0000","last_active":"2024-08-17T02:26:32.209304+0000","last_peered":"2024-08-17T02:26:32.209304+0000","last_clean":"2024-08-17T02:26:32.209304+0000","last_became_active":"2024-08-17T02:26:32.205803+0000","last_became_peered":"2024-08-17T02:26:32.205803+0000","last_unstale":"2024-08-17T02:26:32.209304+0000","last_undegraded":"2024-08-17T02:26:32.209304+0000","last_fullsized":"2024-08-17T02:26:32.209304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:59.331351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224293+0000","last_change":"2024-08-17T02:26:31.198233+0000","last_active":"2024-08-17T02:26:32.224293+0000","last_peered":"2024-08-17T02:26:32.224293+0000","last_clean":"2024-08-17T02:26:32.224293+0000","last_became_active":"2024-08-17T02:26:31.197699+0000","last_became_peered":"2024-08-17T02:26:31.197699+0000","last_unstale":"2024-08-17T02:26:32.224293+0000","last_undegraded":"2024-08-17T02:26:32.224293+0000","last_fullsized":"2024-08-17T02:26:32.224293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:46.029644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210402+0000","last_change":"2024-08-17T02:26:32.207718+0000","last_active":"2024-08-17T02:26:32.210402+0000","last_peered":"2024-08-17T02:26:32.210402+0000","last_clean":"2024-08-17T02:26:32.210402+0000","last_became_active":"2024-08-17T02:26:32.204744+0000","last_became_peered":"2024-08-17T02:26:32.204744+0000","last_unstale":"2024-08-17T02:26:32.210402+0000","last_undegraded":"2024-08-17T02:26:32.210402+0000","last_fullsized":"2024-08-17T02:26:32.210402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:56:37.929984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224554+0000","last_change":"2024-08-17T02:26:31.195725+0000","last_active":"2024-08-17T02:26:32.224554+0000","last_peered":"2024-08-17T02:26:32.224554+0000","last_clean":"2024-08-17T02:26:32.224554+0000","last_became_active":"2024-08-17T02:26:31.195446+0000","last_became_peered":"2024-08-17T02:26:31.195446+0000","last_unstale":"2024-08-17T02:26:32.224554+0000","last_undegraded":"2024-08-17T02:26:32.224554+0000","last_fullsized":"2024-08-17T02:26:32.224554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:00.267868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.209351+0000","last_change":"2024-08-17T02:26:32.207003+0000","last_active":"2024-08-17T02:26:32.209351+0000","last_peered":"2024-08-17T02:26:32.209351+0000","last_clean":"2024-08-17T02:26:32.209351+0000","last_became_active":"2024-08-17T02:26:32.206741+0000","last_became_peered":"2024-08-17T02:26:32.206741+0000","last_unstale":"2024-08-17T02:26:32.209351+0000","last_undegraded":"2024-08-17T02:26:32.209351+0000","last_fullsized":"2024-08-17T02:26:32.209351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:44.277870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.225797+0000","last_change":"2024-08-17T02:26:31.188727+0000","last_active":"2024-08-17T02:26:32.225797+0000","last_peered":"2024-08-17T02:26:32.225797+0000","last_clean":"2024-08-17T02:26:32.225797+0000","last_became_active":"2024-08-17T02:26:31.187702+0000","last_became_peered":"2024-08-17T02:26:31.187702+0000","last_unstale":"2024-08-17T02:26:32.225797+0000","last_undegraded":"2024-08-17T02:26:32.225797+0000","last_fullsized":"2024-08-17T02:26:32.225797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:29.752289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.227485+0000","last_change":"2024-08-17T02:26:32.226432+0000","last_active":"2024-08-17T02:26:32.227485+0000","last_peered":"2024-08-17T02:26:32.227485+0000","last_clean":"2024-08-17T02:26:32.227485+0000","last_became_active":"2024-08-17T02:26:32.226202+0000","last_became_peered":"2024-08-17T02:26:32.226202+0000","last_unstale":"2024-08-17T02:26:32.227485+0000","last_undegraded":"2024-08-17T02:26:32.227485+0000","last_fullsized":"2024-08-17T02:26:32.227485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:19:31.787387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.188823+0000","last_change":"2024-08-17T02:26:31.196292+0000","last_active":"2024-08-17T02:26:32.188823+0000","last_peered":"2024-08-17T02:26:32.188823+0000","last_clean":"2024-08-17T02:26:32.188823+0000","last_became_active":"2024-08-17T02:26:31.196030+0000","last_became_peered":"2024-08-17T02:26:31.196030+0000","last_unstale":"2024-08-17T02:26:32.188823+0000","last_undegraded":"2024-08-17T02:26:32.188823+0000","last_fullsized":"2024-08-17T02:26:32.188823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:36.476579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223492+0000","last_change":"2024-08-17T02:26:32.217034+0000","last_active":"2024-08-17T02:26:32.223492+0000","last_peered":"2024-08-17T02:26:32.223492+0000","last_clean":"2024-08-17T02:26:32.223492+0000","last_became_active":"2024-08-17T02:26:32.215414+0000","last_became_peered":"2024-08-17T02:26:32.215414+0000","last_unstale":"2024-08-17T02:26:32.223492+0000","last_undegraded":"2024-08-17T02:26:32.223492+0000","last_fullsized":"2024-08-17T02:26:32.223492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:22.327159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.185570+0000","last_change":"2024-08-17T02:26:27.275086+0000","last_active":"2024-08-17T02:26:32.185570+0000","last_peered":"2024-08-17T02:26:32.185570+0000","last_clean":"2024-08-17T02:26:32.185570+0000","last_became_active":"2024-08-17T02:26:27.274075+0000","last_became_peered":"2024-08-17T02:26:27.274075+0000","last_unstale":"2024-08-17T02:26:32.185570+0000","last_undegraded":"2024-08-17T02:26:32.185570+0000","last_fullsized":"2024-08-17T02:26:32.185570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_clean_scrub_stamp":"2024-08-17T02:26:26.139133+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:52.161982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210441+0000","last_change":"2024-08-17T02:26:31.198699+0000","last_active":"2024-08-17T02:26:32.210441+0000","last_peered":"2024-08-17T02:26:32.210441+0000","last_clean":"2024-08-17T02:26:32.210441+0000","last_became_active":"2024-08-17T02:26:31.198462+0000","last_became_peered":"2024-08-17T02:26:31.198462+0000","last_unstale":"2024-08-17T02:26:32.210441+0000","last_undegraded":"2024-08-17T02:26:32.210441+0000","last_fullsized":"2024-08-17T02:26:32.210441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:13:53.155805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224120+0000","last_change":"2024-08-17T02:26:32.217116+0000","last_active":"2024-08-17T02:26:32.224120+0000","last_peered":"2024-08-17T02:26:32.224120+0000","last_clean":"2024-08-17T02:26:32.224120+0000","last_became_active":"2024-08-17T02:26:32.216502+0000","last_became_peered":"2024-08-17T02:26:32.216502+0000","last_unstale":"2024-08-17T02:26:32.224120+0000","last_undegraded":"2024-08-17T02:26:32.224120+0000","last_fullsized":"2024-08-17T02:26:32.224120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:59.385496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.185482+0000","last_change":"2024-08-17T02:26:31.194925+0000","last_active":"2024-08-17T02:26:32.185482+0000","last_peered":"2024-08-17T02:26:32.185482+0000","last_clean":"2024-08-17T02:26:32.185482+0000","last_became_active":"2024-08-17T02:26:31.194668+0000","last_became_peered":"2024-08-17T02:26:31.194668+0000","last_unstale":"2024-08-17T02:26:32.185482+0000","last_undegraded":"2024-08-17T02:26:32.185482+0000","last_fullsized":"2024-08-17T02:26:32.185482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:17.346775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216389+0000","last_change":"2024-08-17T02:26:32.212095+0000","last_active":"2024-08-17T02:26:32.216389+0000","last_peered":"2024-08-17T02:26:32.216389+0000","last_clean":"2024-08-17T02:26:32.216389+0000","last_became_active":"2024-08-17T02:26:32.211786+0000","last_became_peered":"2024-08-17T02:26:32.211786+0000","last_unstale":"2024-08-17T02:26:32.216389+0000","last_undegraded":"2024-08-17T02:26:32.216389+0000","last_fullsized":"2024-08-17T02:26:32.216389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:12:08.917953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.189462+0000","last_change":"2024-08-17T02:26:31.190007+0000","last_active":"2024-08-17T02:26:32.189462+0000","last_peered":"2024-08-17T02:26:32.189462+0000","last_clean":"2024-08-17T02:26:32.189462+0000","last_became_active":"2024-08-17T02:26:31.189669+0000","last_became_peered":"2024-08-17T02:26:31.189669+0000","last_unstale":"2024-08-17T02:26:32.189462+0000","last_undegraded":"2024-08-17T02:26:32.189462+0000","last_fullsized":"2024-08-17T02:26:32.189462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:13:53.155805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.201194+0000","last_change":"2024-08-17T02:26:32.195428+0000","last_active":"2024-08-17T02:26:32.201194+0000","last_peered":"2024-08-17T02:26:32.201194+0000","last_clean":"2024-08-17T02:26:32.201194+0000","last_became_active":"2024-08-17T02:26:32.195121+0000","last_became_peered":"2024-08-17T02:26:32.195121+0000","last_unstale":"2024-08-17T02:26:32.201194+0000","last_undegraded":"2024-08-17T02:26:32.201194+0000","last_fullsized":"2024-08-17T02:26:32.201194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210311+0000","last_change":"2024-08-17T02:26:31.196698+0000","last_active":"2024-08-17T02:26:32.210311+0000","last_peered":"2024-08-17T02:26:32.210311+0000","last_clean":"2024-08-17T02:26:32.210311+0000","last_became_active":"2024-08-17T02:26:31.195740+0000","last_became_peered":"2024-08-17T02:26:31.195740+0000","last_unstale":"2024-08-17T02:26:32.210311+0000","last_undegraded":"2024-08-17T02:26:32.210311+0000","last_fullsized":"2024-08-17T02:26:32.210311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:29.752289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223829+0000","last_change":"2024-08-17T02:26:32.214042+0000","last_active":"2024-08-17T02:26:32.223829+0000","last_peered":"2024-08-17T02:26:32.223829+0000","last_clean":"2024-08-17T02:26:32.223829+0000","last_became_active":"2024-08-17T02:26:32.211384+0000","last_became_peered":"2024-08-17T02:26:32.211384+0000","last_unstale":"2024-08-17T02:26:32.223829+0000","last_undegraded":"2024-08-17T02:26:32.223829+0000","last_fullsized":"2024-08-17T02:26:32.223829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:08.860859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.184099+0000","last_change":"2024-08-17T02:26:31.199414+0000","last_active":"2024-08-17T02:26:32.184099+0000","last_peered":"2024-08-17T02:26:32.184099+0000","last_clean":"2024-08-17T02:26:32.184099+0000","last_became_active":"2024-08-17T02:26:31.199123+0000","last_became_peered":"2024-08-17T02:26:31.199123+0000","last_unstale":"2024-08-17T02:26:32.184099+0000","last_undegraded":"2024-08-17T02:26:32.184099+0000","last_fullsized":"2024-08-17T02:26:32.184099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:21.626630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222976+0000","last_change":"2024-08-17T02:26:32.219444+0000","last_active":"2024-08-17T02:26:32.222976+0000","last_peered":"2024-08-17T02:26:32.222976+0000","last_clean":"2024-08-17T02:26:32.222976+0000","last_became_active":"2024-08-17T02:26:32.219214+0000","last_became_peered":"2024-08-17T02:26:32.219214+0000","last_unstale":"2024-08-17T02:26:32.222976+0000","last_undegraded":"2024-08-17T02:26:32.222976+0000","last_fullsized":"2024-08-17T02:26:32.222976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:44.277870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.189655+0000","last_change":"2024-08-17T02:26:31.200700+0000","last_active":"2024-08-17T02:26:32.189655+0000","last_peered":"2024-08-17T02:26:32.189655+0000","last_clean":"2024-08-17T02:26:32.189655+0000","last_became_active":"2024-08-17T02:26:31.200119+0000","last_became_peered":"2024-08-17T02:26:31.200119+0000","last_unstale":"2024-08-17T02:26:32.189655+0000","last_undegraded":"2024-08-17T02:26:32.189655+0000","last_fullsized":"2024-08-17T02:26:32.189655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:21.626630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.205241+0000","last_change":"2024-08-17T02:26:32.204045+0000","last_active":"2024-08-17T02:26:32.205241+0000","last_peered":"2024-08-17T02:26:32.205241+0000","last_clean":"2024-08-17T02:26:32.205241+0000","last_became_active":"2024-08-17T02:26:32.201851+0000","last_became_peered":"2024-08-17T02:26:32.201851+0000","last_unstale":"2024-08-17T02:26:32.205241+0000","last_undegraded":"2024-08-17T02:26:32.205241+0000","last_fullsized":"2024-08-17T02:26:32.205241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:16:50.112486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.184099+0000","last_change":"2024-08-17T02:26:31.201702+0000","last_active":"2024-08-17T02:26:32.184099+0000","last_peered":"2024-08-17T02:26:32.184099+0000","last_clean":"2024-08-17T02:26:32.184099+0000","last_became_active":"2024-08-17T02:26:31.201252+0000","last_became_peered":"2024-08-17T02:26:31.201252+0000","last_unstale":"2024-08-17T02:26:32.184099+0000","last_undegraded":"2024-08-17T02:26:32.184099+0000","last_fullsized":"2024-08-17T02:26:32.184099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:34.514420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216794+0000","last_change":"2024-08-17T02:26:32.209105+0000","last_active":"2024-08-17T02:26:32.216794+0000","last_peered":"2024-08-17T02:26:32.216794+0000","last_clean":"2024-08-17T02:26:32.216794+0000","last_became_active":"2024-08-17T02:26:32.208827+0000","last_became_peered":"2024-08-17T02:26:32.208827+0000","last_unstale":"2024-08-17T02:26:32.216794+0000","last_undegraded":"2024-08-17T02:26:32.216794+0000","last_fullsized":"2024-08-17T02:26:32.216794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:12:08.917953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224248+0000","last_change":"2024-08-17T02:26:31.198056+0000","last_active":"2024-08-17T02:26:32.224248+0000","last_peered":"2024-08-17T02:26:32.224248+0000","last_clean":"2024-08-17T02:26:32.224248+0000","last_became_active":"2024-08-17T02:26:31.197375+0000","last_became_peered":"2024-08-17T02:26:31.197375+0000","last_unstale":"2024-08-17T02:26:32.224248+0000","last_undegraded":"2024-08-17T02:26:32.224248+0000","last_fullsized":"2024-08-17T02:26:32.224248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:14.675670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.207777+0000","last_change":"2024-08-17T02:26:32.204547+0000","last_active":"2024-08-17T02:26:32.207777+0000","last_peered":"2024-08-17T02:26:32.207777+0000","last_clean":"2024-08-17T02:26:32.207777+0000","last_became_active":"2024-08-17T02:26:32.204234+0000","last_became_peered":"2024-08-17T02:26:32.204234+0000","last_unstale":"2024-08-17T02:26:32.207777+0000","last_undegraded":"2024-08-17T02:26:32.207777+0000","last_fullsized":"2024-08-17T02:26:32.207777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:22.493908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.185436+0000","last_change":"2024-08-17T02:26:31.199235+0000","last_active":"2024-08-17T02:26:32.185436+0000","last_peered":"2024-08-17T02:26:32.185436+0000","last_clean":"2024-08-17T02:26:32.185436+0000","last_became_active":"2024-08-17T02:26:31.198951+0000","last_became_peered":"2024-08-17T02:26:31.198951+0000","last_unstale":"2024-08-17T02:26:32.185436+0000","last_undegraded":"2024-08-17T02:26:32.185436+0000","last_fullsized":"2024-08-17T02:26:32.185436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:29.752289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.218771+0000","last_change":"2024-08-17T02:26:32.202792+0000","last_active":"2024-08-17T02:26:32.218771+0000","last_peered":"2024-08-17T02:26:32.218771+0000","last_clean":"2024-08-17T02:26:32.218771+0000","last_became_active":"2024-08-17T02:26:32.201978+0000","last_became_peered":"2024-08-17T02:26:32.201978+0000","last_unstale":"2024-08-17T02:26:32.218771+0000","last_undegraded":"2024-08-17T02:26:32.218771+0000","last_fullsized":"2024-08-17T02:26:32.218771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:25.946664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.184248+0000","last_change":"2024-08-17T02:26:31.199305+0000","last_active":"2024-08-17T02:26:32.184248+0000","last_peered":"2024-08-17T02:26:32.184248+0000","last_clean":"2024-08-17T02:26:32.184248+0000","last_became_active":"2024-08-17T02:26:31.199023+0000","last_became_peered":"2024-08-17T02:26:31.199023+0000","last_unstale":"2024-08-17T02:26:32.184248+0000","last_undegraded":"2024-08-17T02:26:32.184248+0000","last_fullsized":"2024-08-17T02:26:32.184248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:36.476579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216869+0000","last_change":"2024-08-17T02:26:32.211397+0000","last_active":"2024-08-17T02:26:32.216869+0000","last_peered":"2024-08-17T02:26:32.216869+0000","last_clean":"2024-08-17T02:26:32.216869+0000","last_became_active":"2024-08-17T02:26:32.211105+0000","last_became_peered":"2024-08-17T02:26:32.211105+0000","last_unstale":"2024-08-17T02:26:32.216869+0000","last_undegraded":"2024-08-17T02:26:32.216869+0000","last_fullsized":"2024-08-17T02:26:32.216869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:49.834790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.183924+0000","last_change":"2024-08-17T02:26:31.194944+0000","last_active":"2024-08-17T02:26:32.183924+0000","last_peered":"2024-08-17T02:26:32.183924+0000","last_clean":"2024-08-17T02:26:32.183924+0000","last_became_active":"2024-08-17T02:26:31.194583+0000","last_became_peered":"2024-08-17T02:26:31.194583+0000","last_unstale":"2024-08-17T02:26:32.183924+0000","last_undegraded":"2024-08-17T02:26:32.183924+0000","last_fullsized":"2024-08-17T02:26:32.183924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:24.940176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.217295+0000","last_change":"2024-08-17T02:26:32.208192+0000","last_active":"2024-08-17T02:26:32.217295+0000","last_peered":"2024-08-17T02:26:32.217295+0000","last_clean":"2024-08-17T02:26:32.217295+0000","last_became_active":"2024-08-17T02:26:32.205401+0000","last_became_peered":"2024-08-17T02:26:32.205401+0000","last_unstale":"2024-08-17T02:26:32.217295+0000","last_undegraded":"2024-08-17T02:26:32.217295+0000","last_fullsized":"2024-08-17T02:26:32.217295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:01:56.405892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224746+0000","last_change":"2024-08-17T02:26:31.188577+0000","last_active":"2024-08-17T02:26:32.224746+0000","last_peered":"2024-08-17T02:26:32.224746+0000","last_clean":"2024-08-17T02:26:32.224746+0000","last_became_active":"2024-08-17T02:26:31.188261+0000","last_became_peered":"2024-08-17T02:26:31.188261+0000","last_unstale":"2024-08-17T02:26:32.224746+0000","last_undegraded":"2024-08-17T02:26:32.224746+0000","last_fullsized":"2024-08-17T02:26:32.224746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:07.854371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210736+0000","last_change":"2024-08-17T02:26:32.204687+0000","last_active":"2024-08-17T02:26:32.210736+0000","last_peered":"2024-08-17T02:26:32.210736+0000","last_clean":"2024-08-17T02:26:32.210736+0000","last_became_active":"2024-08-17T02:26:32.203288+0000","last_became_peered":"2024-08-17T02:26:32.203288+0000","last_unstale":"2024-08-17T02:26:32.210736+0000","last_undegraded":"2024-08-17T02:26:32.210736+0000","last_fullsized":"2024-08-17T02:26:32.210736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:59.385496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.212562+0000","last_change":"2024-08-17T02:26:32.205101+0000","last_active":"2024-08-17T02:26:32.212562+0000","last_peered":"2024-08-17T02:26:32.212562+0000","last_clean":"2024-08-17T02:26:32.212562+0000","last_became_active":"2024-08-17T02:26:32.204789+0000","last_became_peered":"2024-08-17T02:26:32.204789+0000","last_unstale":"2024-08-17T02:26:32.212562+0000","last_undegraded":"2024-08-17T02:26:32.212562+0000","last_fullsized":"2024-08-17T02:26:32.212562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:53.799652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.226792+0000","last_change":"2024-08-17T02:26:31.192488+0000","last_active":"2024-08-17T02:26:32.226792+0000","last_peered":"2024-08-17T02:26:32.226792+0000","last_clean":"2024-08-17T02:26:32.226792+0000","last_became_active":"2024-08-17T02:26:31.191791+0000","last_became_peered":"2024-08-17T02:26:31.191791+0000","last_unstale":"2024-08-17T02:26:32.226792+0000","last_undegraded":"2024-08-17T02:26:32.226792+0000","last_fullsized":"2024-08-17T02:26:32.226792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:24.940176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222373+0000","last_change":"2024-08-17T02:26:32.214245+0000","last_active":"2024-08-17T02:26:32.222373+0000","last_peered":"2024-08-17T02:26:32.222373+0000","last_clean":"2024-08-17T02:26:32.222373+0000","last_became_active":"2024-08-17T02:26:32.212733+0000","last_became_peered":"2024-08-17T02:26:32.212733+0000","last_unstale":"2024-08-17T02:26:32.222373+0000","last_undegraded":"2024-08-17T02:26:32.222373+0000","last_fullsized":"2024-08-17T02:26:32.222373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:22.493908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.225876+0000","last_change":"2024-08-17T02:26:31.201149+0000","last_active":"2024-08-17T02:26:32.225876+0000","last_peered":"2024-08-17T02:26:32.225876+0000","last_clean":"2024-08-17T02:26:32.225876+0000","last_became_active":"2024-08-17T02:26:31.200976+0000","last_became_peered":"2024-08-17T02:26:31.200976+0000","last_unstale":"2024-08-17T02:26:32.225876+0000","last_undegraded":"2024-08-17T02:26:32.225876+0000","last_fullsized":"2024-08-17T02:26:32.225876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:34.514420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222755+0000","last_change":"2024-08-17T02:26:32.213833+0000","last_active":"2024-08-17T02:26:32.222755+0000","last_peered":"2024-08-17T02:26:32.222755+0000","last_clean":"2024-08-17T02:26:32.222755+0000","last_became_active":"2024-08-17T02:26:32.213562+0000","last_became_peered":"2024-08-17T02:26:32.213562+0000","last_unstale":"2024-08-17T02:26:32.222755+0000","last_undegraded":"2024-08-17T02:26:32.222755+0000","last_fullsized":"2024-08-17T02:26:32.222755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223551+0000","last_change":"2024-08-17T02:26:31.198494+0000","last_active":"2024-08-17T02:26:32.223551+0000","last_peered":"2024-08-17T02:26:32.223551+0000","last_clean":"2024-08-17T02:26:32.223551+0000","last_became_active":"2024-08-17T02:26:31.198155+0000","last_became_peered":"2024-08-17T02:26:31.198155+0000","last_unstale":"2024-08-17T02:26:32.223551+0000","last_undegraded":"2024-08-17T02:26:32.223551+0000","last_fullsized":"2024-08-17T02:26:32.223551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:53:03.434511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216630+0000","last_change":"2024-08-17T02:26:32.206009+0000","last_active":"2024-08-17T02:26:32.216630+0000","last_peered":"2024-08-17T02:26:32.216630+0000","last_clean":"2024-08-17T02:26:32.216630+0000","last_became_active":"2024-08-17T02:26:32.205332+0000","last_became_peered":"2024-08-17T02:26:32.205332+0000","last_unstale":"2024-08-17T02:26:32.216630+0000","last_undegraded":"2024-08-17T02:26:32.216630+0000","last_fullsized":"2024-08-17T02:26:32.216630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:25.408345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.226730+0000","last_change":"2024-08-17T02:26:31.198180+0000","last_active":"2024-08-17T02:26:32.226730+0000","last_peered":"2024-08-17T02:26:32.226730+0000","last_clean":"2024-08-17T02:26:32.226730+0000","last_became_active":"2024-08-17T02:26:31.197718+0000","last_became_peered":"2024-08-17T02:26:31.197718+0000","last_unstale":"2024-08-17T02:26:32.226730+0000","last_undegraded":"2024-08-17T02:26:32.226730+0000","last_fullsized":"2024-08-17T02:26:32.226730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:24:55.382440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":217088,"data_stored":70577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:36.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:36.522 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-08-17T02:26:36.521+0000 7f2571000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:36.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.571+0000 7f4ed8000640 1 Processor -- start 2024-08-17T02:26:36.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.571+0000 7f4ed8000640 1 -- start start 2024-08-17T02:26:36.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.572+0000 7f4ed8000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ed00afca0 0x7f4ed00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.572+0000 7f4ed8000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4ed00acf10 0x7f4ed0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.572+0000 7f4ed8000640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed015a4e0 con 0x7f4ed01589a0 2024-08-17T02:26:36.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.572+0000 7f4ed8000640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed00b0980 con 0x7f4ed00acf10 2024-08-17T02:26:36.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.572+0000 7f4ed8000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00c92b0 con 0x7f4ed00afca0 2024-08-17T02:26:36.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.572+0000 7f4ed4c00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4ed00acf10 0x7f4ed0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.572+0000 7f4ed6000640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4ed01589a0 0x7f4ed006d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38224/0 (socket says 172.21.15.6:38224) 2024-08-17T02:26:36.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.572+0000 7f4ed6000640 1 -- 172.21.15.6:0/188671898 learned_addr learned my addr 172.21.15.6:0/188671898 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:36.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.572+0000 7f4ed5600640 1 --2- 172.21.15.6:0/188671898 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ed00afca0 0x7f4ed00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.573+0000 7f4ed4c00640 1 -- 172.21.15.6:0/188671898 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ed00afca0 msgr2=0x7f4ed00b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:36.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.573+0000 7f4ed4c00640 1 --2- 172.21.15.6:0/188671898 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ed00afca0 0x7f4ed00b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.573+0000 7f4ed4c00640 1 -- 172.21.15.6:0/188671898 >> v1:172.21.15.6:6789/0 conn(0x7f4ed01589a0 legacy=0x7f4ed006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.573+0000 7f4ed4c00640 1 -- 172.21.15.6:0/188671898 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed00ad480 con 0x7f4ed00acf10 2024-08-17T02:26:36.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.573+0000 7f4ecfe00640 1 -- 172.21.15.6:0/188671898 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201038116 0 0) 0x7f4ec8001490 con 0x7f4ed01589a0 2024-08-17T02:26:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.574+0000 7f4ed4c00640 1 --2- 172.21.15.6:0/188671898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ed00acf10 0x7f4ed0159fa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009880 tx=0x7f4ebc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f298267cfbb0e21c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.574+0000 7f4ecfe00640 1 -- 172.21.15.6:0/188671898 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc02ad70 con 0x7f4ed00acf10 2024-08-17T02:26:36.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.574+0000 7f4ecfe00640 1 -- 172.21.15.6:0/188671898 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ebc032440 con 0x7f4ed00acf10 2024-08-17T02:26:36.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.574+0000 7f4ecfe00640 1 -- 172.21.15.6:0/188671898 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc0327e0 con 0x7f4ed00acf10 2024-08-17T02:26:36.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.575+0000 7f4ed8000640 1 -- 172.21.15.6:0/188671898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ed00acf10 msgr2=0x7f4ed0159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.575+0000 7f4ed8000640 1 --2- 172.21.15.6:0/188671898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ed00acf10 0x7f4ed0159fa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009880 tx=0x7f4ebc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.575+0000 7f4ed8000640 1 -- 172.21.15.6:0/188671898 shutdown_connections 2024-08-17T02:26:36.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.575+0000 7f4ed8000640 1 --2- 172.21.15.6:0/188671898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ed00acf10 0x7f4ed0159fa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.575+0000 7f4ed8000640 1 --2- 172.21.15.6:0/188671898 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ed00afca0 0x7f4ed00b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.575+0000 7f4ed8000640 1 -- 172.21.15.6:0/188671898 >> 172.21.15.6:0/188671898 conn(0x7f4ed0066e60 msgr2=0x7f4ed0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.575+0000 7f4ed8000640 1 -- 172.21.15.6:0/188671898 shutdown_connections 2024-08-17T02:26:36.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.575+0000 7f4ed8000640 1 -- 172.21.15.6:0/188671898 wait complete. 2024-08-17T02:26:36.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.576+0000 7f4ed8000640 1 Processor -- start 2024-08-17T02:26:36.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.576+0000 7f4ed8000640 1 -- start start 2024-08-17T02:26:36.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.577+0000 7f4ed8000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ed00acf10 0x7f4ed015a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.577+0000 7f4ed8000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ed00afca0 0x7f4ed00c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.577+0000 7f4ed8000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ed01589a0 0x7f4ed0146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.577+0000 7f4ed8000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed0155cc0 con 0x7f4ed00afca0 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.577+0000 7f4ed8000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00c76b0 con 0x7f4ed00acf10 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.577+0000 7f4ed8000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed01550b0 con 0x7f4ed01589a0 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.577+0000 7f4ed4c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ed00afca0 0x7f4ed00c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.577+0000 7f4ed4c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ed00afca0 0x7f4ed00c7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56806/0 (socket says 172.21.15.6:56806) 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.577+0000 7f4ed4c00640 1 -- 172.21.15.6:0/893416029 learned_addr learned my addr 172.21.15.6:0/893416029 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.577+0000 7f4ed5600640 1 --2- 172.21.15.6:0/893416029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ed00acf10 0x7f4ed015a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.577+0000 7f4ed6000640 1 --2- 172.21.15.6:0/893416029 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ed01589a0 0x7f4ed0146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.578+0000 7f4ed4c00640 1 -- 172.21.15.6:0/893416029 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ed01589a0 msgr2=0x7f4ed0146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.578+0000 7f4ed4c00640 1 --2- 172.21.15.6:0/893416029 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ed01589a0 0x7f4ed0146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.578+0000 7f4ed4c00640 1 -- 172.21.15.6:0/893416029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ed00acf10 msgr2=0x7f4ed015a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.578+0000 7f4ed4c00640 1 --2- 172.21.15.6:0/893416029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ed00acf10 0x7f4ed015a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.578+0000 7f4ed4c00640 1 -- 172.21.15.6:0/893416029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ebc009390 con 0x7f4ed00afca0 2024-08-17T02:26:36.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.578+0000 7f4ed5600640 1 --2- 172.21.15.6:0/893416029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ed00acf10 0x7f4ed015a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:36.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.578+0000 7f4ed4c00640 1 --2- 172.21.15.6:0/893416029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ed00afca0 0x7f4ed00c7170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009880 tx=0x7f4ebc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.578+0000 7f4eccc00640 1 -- 172.21.15.6:0/893416029 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc000d10 con 0x7f4ed00afca0 2024-08-17T02:26:36.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.578+0000 7f4eccc00640 1 -- 172.21.15.6:0/893416029 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ebc031e00 con 0x7f4ed00afca0 2024-08-17T02:26:36.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.578+0000 7f4ed8000640 1 -- 172.21.15.6:0/893416029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed0155390 con 0x7f4ed00afca0 2024-08-17T02:26:36.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.578+0000 7f4eccc00640 1 -- 172.21.15.6:0/893416029 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc03d670 con 0x7f4ed00afca0 2024-08-17T02:26:36.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.578+0000 7f4ed8000640 1 -- 172.21.15.6:0/893416029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed0155950 con 0x7f4ed00afca0 2024-08-17T02:26:36.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.579+0000 7f4ed8000640 1 -- 172.21.15.6:0/893416029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed0155e70 con 0x7f4ed00afca0 2024-08-17T02:26:36.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.580+0000 7f4eccc00640 1 -- 172.21.15.6:0/893416029 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4ebc039040 con 0x7f4ed00afca0 2024-08-17T02:26:36.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.581+0000 7f4eccc00640 1 --2- 172.21.15.6:0/893416029 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4eb0065150 0x7f4eb0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.581+0000 7f4eccc00640 1 -- 172.21.15.6:0/893416029 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ebc0a2800 con 0x7f4ed00afca0 2024-08-17T02:26:36.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.581+0000 7f4ed5600640 1 --2- 172.21.15.6:0/893416029 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4eb0065150 0x7f4eb0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.582+0000 7f4ed5600640 1 --2- 172.21.15.6:0/893416029 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4eb0065150 0x7f4eb0067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009cf0 tx=0x7f4ec4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.585+0000 7f4eccc00640 1 -- 172.21.15.6:0/893416029 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4ed0155e70 con 0x7f4ed00afca0 2024-08-17T02:26:36.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.762+0000 7f4ed8000640 1 -- 172.21.15.6:0/893416029 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ed0155e70 con 0x7f4eb0065150 2024-08-17T02:26:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.769+0000 7f4eccc00640 1 -- 172.21.15.6:0/893416029 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264692 (secure 0 0 0) 0x7f4ed0155e70 con 0x7f4eb0065150 2024-08-17T02:26:36.773 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-08-17T02:26:36.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.773+0000 7f4ed8000640 1 -- 172.21.15.6:0/893416029 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4eb0065150 msgr2=0x7f4eb0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.773+0000 7f4ed8000640 1 --2- 172.21.15.6:0/893416029 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4eb0065150 0x7f4eb0067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009cf0 tx=0x7f4ec4008040 comp rx=0 tx=0).stop 2024-08-17T02:26:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.773+0000 7f4ed8000640 1 -- 172.21.15.6:0/893416029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ed00afca0 msgr2=0x7f4ed00c7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.773+0000 7f4ed8000640 1 --2- 172.21.15.6:0/893416029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ed00afca0 0x7f4ed00c7170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009880 tx=0x7f4ebc032000 comp rx=0 tx=0).stop 2024-08-17T02:26:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.773+0000 7f4ed8000640 1 -- 172.21.15.6:0/893416029 shutdown_connections 2024-08-17T02:26:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.773+0000 7f4ed8000640 1 --2- 172.21.15.6:0/893416029 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4eb0065150 0x7f4eb0067600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.773+0000 7f4ed8000640 1 --2- 172.21.15.6:0/893416029 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ed01589a0 0x7f4ed0146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.773+0000 7f4ed8000640 1 --2- 172.21.15.6:0/893416029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ed00afca0 0x7f4ed00c7170 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.773+0000 7f4ed8000640 1 --2- 172.21.15.6:0/893416029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ed00acf10 0x7f4ed015a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.773+0000 7f4ed8000640 1 -- 172.21.15.6:0/893416029 >> 172.21.15.6:0/893416029 conn(0x7f4ed0066e60 msgr2=0x7f4ed00c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.773+0000 7f4ed8000640 1 -- 172.21.15.6:0/893416029 shutdown_connections 2024-08-17T02:26:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.773+0000 7f4ed8000640 1 -- 172.21.15.6:0/893416029 wait complete. 2024-08-17T02:26:36.788 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-08-17T02:26:35.408644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381800,"kb_used_data":2908,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592920,"statfs":{"total":773094113280,"available":770655150080,"internally_reserved":0,"allocated":2977792,"data_stored":1781628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.240102"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.203459+0000","last_change":"2024-08-17T02:26:32.199441+0000","last_active":"2024-08-17T02:26:32.203459+0000","last_peered":"2024-08-17T02:26:32.203459+0000","last_clean":"2024-08-17T02:26:32.203459+0000","last_became_active":"2024-08-17T02:26:32.195327+0000","last_became_peered":"2024-08-17T02:26:32.195327+0000","last_unstale":"2024-08-17T02:26:32.203459+0000","last_undegraded":"2024-08-17T02:26:32.203459+0000","last_fullsized":"2024-08-17T02:26:32.203459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:23.907523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.202662+0000","last_change":"2024-08-17T02:26:32.199560+0000","last_active":"2024-08-17T02:26:32.202662+0000","last_peered":"2024-08-17T02:26:32.202662+0000","last_clean":"2024-08-17T02:26:32.202662+0000","last_became_active":"2024-08-17T02:26:32.199175+0000","last_became_peered":"2024-08-17T02:26:32.199175+0000","last_unstale":"2024-08-17T02:26:32.202662+0000","last_undegraded":"2024-08-17T02:26:32.202662+0000","last_fullsized":"2024-08-17T02:26:32.202662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:47.234447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.207600+0000","last_change":"2024-08-17T02:26:32.203519+0000","last_active":"2024-08-17T02:26:32.207600+0000","last_peered":"2024-08-17T02:26:32.207600+0000","last_clean":"2024-08-17T02:26:32.207600+0000","last_became_active":"2024-08-17T02:26:32.202958+0000","last_became_peered":"2024-08-17T02:26:32.202958+0000","last_unstale":"2024-08-17T02:26:32.207600+0000","last_undegraded":"2024-08-17T02:26:32.207600+0000","last_fullsized":"2024-08-17T02:26:32.207600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:18.537099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.227468+0000","last_change":"2024-08-17T02:26:32.225955+0000","last_active":"2024-08-17T02:26:32.227468+0000","last_peered":"2024-08-17T02:26:32.227468+0000","last_clean":"2024-08-17T02:26:32.227468+0000","last_became_active":"2024-08-17T02:26:32.225708+0000","last_became_peered":"2024-08-17T02:26:32.225708+0000","last_unstale":"2024-08-17T02:26:32.227468+0000","last_undegraded":"2024-08-17T02:26:32.227468+0000","last_fullsized":"2024-08-17T02:26:32.227468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:25:34.108888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.208559+0000","last_change":"2024-08-17T02:26:32.204692+0000","last_active":"2024-08-17T02:26:32.208559+0000","last_peered":"2024-08-17T02:26:32.208559+0000","last_clean":"2024-08-17T02:26:32.208559+0000","last_became_active":"2024-08-17T02:26:32.203666+0000","last_became_peered":"2024-08-17T02:26:32.203666+0000","last_unstale":"2024-08-17T02:26:32.208559+0000","last_undegraded":"2024-08-17T02:26:32.208559+0000","last_fullsized":"2024-08-17T02:26:32.208559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:25:34.108888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.214622+0000","last_change":"2024-08-17T02:26:32.209096+0000","last_active":"2024-08-17T02:26:32.214622+0000","last_peered":"2024-08-17T02:26:32.214622+0000","last_clean":"2024-08-17T02:26:32.214622+0000","last_became_active":"2024-08-17T02:26:32.208883+0000","last_became_peered":"2024-08-17T02:26:32.208883+0000","last_unstale":"2024-08-17T02:26:32.214622+0000","last_undegraded":"2024-08-17T02:26:32.214622+0000","last_fullsized":"2024-08-17T02:26:32.214622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:25.408345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.207833+0000","last_change":"2024-08-17T02:26:32.201368+0000","last_active":"2024-08-17T02:26:32.207833+0000","last_peered":"2024-08-17T02:26:32.207833+0000","last_clean":"2024-08-17T02:26:32.207833+0000","last_became_active":"2024-08-17T02:26:32.200370+0000","last_became_peered":"2024-08-17T02:26:32.200370+0000","last_unstale":"2024-08-17T02:26:32.207833+0000","last_undegraded":"2024-08-17T02:26:32.207833+0000","last_fullsized":"2024-08-17T02:26:32.207833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:15:23.868986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.220653+0000","last_change":"2024-08-17T02:26:32.215927+0000","last_active":"2024-08-17T02:26:32.220653+0000","last_peered":"2024-08-17T02:26:32.220653+0000","last_clean":"2024-08-17T02:26:32.220653+0000","last_became_active":"2024-08-17T02:26:32.215631+0000","last_became_peered":"2024-08-17T02:26:32.215631+0000","last_unstale":"2024-08-17T02:26:32.220653+0000","last_undegraded":"2024-08-17T02:26:32.220653+0000","last_fullsized":"2024-08-17T02:26:32.220653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223514+0000","last_change":"2024-08-17T02:26:32.218745+0000","last_active":"2024-08-17T02:26:32.223514+0000","last_peered":"2024-08-17T02:26:32.223514+0000","last_clean":"2024-08-17T02:26:32.223514+0000","last_became_active":"2024-08-17T02:26:32.218069+0000","last_became_peered":"2024-08-17T02:26:32.218069+0000","last_unstale":"2024-08-17T02:26:32.223514+0000","last_undegraded":"2024-08-17T02:26:32.223514+0000","last_fullsized":"2024-08-17T02:26:32.223514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:53.799652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.219488+0000","last_change":"2024-08-17T02:26:32.215519+0000","last_active":"2024-08-17T02:26:32.219488+0000","last_peered":"2024-08-17T02:26:32.219488+0000","last_clean":"2024-08-17T02:26:32.219488+0000","last_became_active":"2024-08-17T02:26:32.215218+0000","last_became_peered":"2024-08-17T02:26:32.215218+0000","last_unstale":"2024-08-17T02:26:32.219488+0000","last_undegraded":"2024-08-17T02:26:32.219488+0000","last_fullsized":"2024-08-17T02:26:32.219488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:39.950692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210439+0000","last_change":"2024-08-17T02:26:32.205449+0000","last_active":"2024-08-17T02:26:32.210439+0000","last_peered":"2024-08-17T02:26:32.210439+0000","last_clean":"2024-08-17T02:26:32.210439+0000","last_became_active":"2024-08-17T02:26:32.205156+0000","last_became_peered":"2024-08-17T02:26:32.205156+0000","last_unstale":"2024-08-17T02:26:32.210439+0000","last_undegraded":"2024-08-17T02:26:32.210439+0000","last_fullsized":"2024-08-17T02:26:32.210439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.221575+0000","last_change":"2024-08-17T02:26:32.203589+0000","last_active":"2024-08-17T02:26:32.221575+0000","last_peered":"2024-08-17T02:26:32.221575+0000","last_clean":"2024-08-17T02:26:32.221575+0000","last_became_active":"2024-08-17T02:26:32.200349+0000","last_became_peered":"2024-08-17T02:26:32.200349+0000","last_unstale":"2024-08-17T02:26:32.221575+0000","last_undegraded":"2024-08-17T02:26:32.221575+0000","last_fullsized":"2024-08-17T02:26:32.221575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:18.353263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.217316+0000","last_change":"2024-08-17T02:26:32.209097+0000","last_active":"2024-08-17T02:26:32.217316+0000","last_peered":"2024-08-17T02:26:32.217316+0000","last_clean":"2024-08-17T02:26:32.217316+0000","last_became_active":"2024-08-17T02:26:32.205693+0000","last_became_peered":"2024-08-17T02:26:32.205693+0000","last_unstale":"2024-08-17T02:26:32.217316+0000","last_undegraded":"2024-08-17T02:26:32.217316+0000","last_fullsized":"2024-08-17T02:26:32.217316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:47.234447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.206406+0000","last_change":"2024-08-17T02:26:32.202857+0000","last_active":"2024-08-17T02:26:32.206406+0000","last_peered":"2024-08-17T02:26:32.206406+0000","last_clean":"2024-08-17T02:26:32.206406+0000","last_became_active":"2024-08-17T02:26:32.202620+0000","last_became_peered":"2024-08-17T02:26:32.202620+0000","last_unstale":"2024-08-17T02:26:32.206406+0000","last_undegraded":"2024-08-17T02:26:32.206406+0000","last_fullsized":"2024-08-17T02:26:32.206406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:53.545799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.205254+0000","last_change":"2024-08-17T02:26:32.201410+0000","last_active":"2024-08-17T02:26:32.205254+0000","last_peered":"2024-08-17T02:26:32.205254+0000","last_clean":"2024-08-17T02:26:32.205254+0000","last_became_active":"2024-08-17T02:26:32.201146+0000","last_became_peered":"2024-08-17T02:26:32.201146+0000","last_unstale":"2024-08-17T02:26:32.205254+0000","last_undegraded":"2024-08-17T02:26:32.205254+0000","last_fullsized":"2024-08-17T02:26:32.205254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:39.950692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.213147+0000","last_change":"2024-08-17T02:26:32.209517+0000","last_active":"2024-08-17T02:26:32.213147+0000","last_peered":"2024-08-17T02:26:32.213147+0000","last_clean":"2024-08-17T02:26:32.213147+0000","last_became_active":"2024-08-17T02:26:32.209006+0000","last_became_peered":"2024-08-17T02:26:32.209006+0000","last_unstale":"2024-08-17T02:26:32.213147+0000","last_undegraded":"2024-08-17T02:26:32.213147+0000","last_fullsized":"2024-08-17T02:26:32.213147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:56:37.929984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.212900+0000","last_change":"2024-08-17T02:26:32.207200+0000","last_active":"2024-08-17T02:26:32.212900+0000","last_peered":"2024-08-17T02:26:32.212900+0000","last_clean":"2024-08-17T02:26:32.212900+0000","last_became_active":"2024-08-17T02:26:32.206936+0000","last_became_peered":"2024-08-17T02:26:32.206936+0000","last_unstale":"2024-08-17T02:26:32.212900+0000","last_undegraded":"2024-08-17T02:26:32.212900+0000","last_fullsized":"2024-08-17T02:26:32.212900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.201442+0000","last_change":"2024-08-17T02:26:32.197012+0000","last_active":"2024-08-17T02:26:32.201442+0000","last_peered":"2024-08-17T02:26:32.201442+0000","last_clean":"2024-08-17T02:26:32.201442+0000","last_became_active":"2024-08-17T02:26:32.196767+0000","last_became_peered":"2024-08-17T02:26:32.196767+0000","last_unstale":"2024-08-17T02:26:32.201442+0000","last_undegraded":"2024-08-17T02:26:32.201442+0000","last_fullsized":"2024-08-17T02:26:32.201442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:18.353263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.208488+0000","last_change":"2024-08-17T02:26:32.204201+0000","last_active":"2024-08-17T02:26:32.208488+0000","last_peered":"2024-08-17T02:26:32.208488+0000","last_clean":"2024-08-17T02:26:32.208488+0000","last_became_active":"2024-08-17T02:26:32.203698+0000","last_became_peered":"2024-08-17T02:26:32.203698+0000","last_unstale":"2024-08-17T02:26:32.208488+0000","last_undegraded":"2024-08-17T02:26:32.208488+0000","last_fullsized":"2024-08-17T02:26:32.208488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:19:31.787387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210386+0000","last_change":"2024-08-17T02:26:32.204316+0000","last_active":"2024-08-17T02:26:32.210386+0000","last_peered":"2024-08-17T02:26:32.210386+0000","last_clean":"2024-08-17T02:26:32.210386+0000","last_became_active":"2024-08-17T02:26:32.203847+0000","last_became_peered":"2024-08-17T02:26:32.203847+0000","last_unstale":"2024-08-17T02:26:32.210386+0000","last_undegraded":"2024-08-17T02:26:32.210386+0000","last_fullsized":"2024-08-17T02:26:32.210386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.212827+0000","last_change":"2024-08-17T02:26:32.210228+0000","last_active":"2024-08-17T02:26:32.212827+0000","last_peered":"2024-08-17T02:26:32.212827+0000","last_clean":"2024-08-17T02:26:32.212827+0000","last_became_active":"2024-08-17T02:26:32.209517+0000","last_became_peered":"2024-08-17T02:26:32.209517+0000","last_unstale":"2024-08-17T02:26:32.212827+0000","last_undegraded":"2024-08-17T02:26:32.212827+0000","last_fullsized":"2024-08-17T02:26:32.212827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.221242+0000","last_change":"2024-08-17T02:26:32.213782+0000","last_active":"2024-08-17T02:26:32.221242+0000","last_peered":"2024-08-17T02:26:32.221242+0000","last_clean":"2024-08-17T02:26:32.221242+0000","last_became_active":"2024-08-17T02:26:32.213525+0000","last_became_peered":"2024-08-17T02:26:32.213525+0000","last_unstale":"2024-08-17T02:26:32.221242+0000","last_undegraded":"2024-08-17T02:26:32.221242+0000","last_fullsized":"2024-08-17T02:26:32.221242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:59.385496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216837+0000","last_change":"2024-08-17T02:26:32.208770+0000","last_active":"2024-08-17T02:26:32.216837+0000","last_peered":"2024-08-17T02:26:32.216837+0000","last_clean":"2024-08-17T02:26:32.216837+0000","last_became_active":"2024-08-17T02:26:32.208425+0000","last_became_peered":"2024-08-17T02:26:32.208425+0000","last_unstale":"2024-08-17T02:26:32.216837+0000","last_undegraded":"2024-08-17T02:26:32.216837+0000","last_fullsized":"2024-08-17T02:26:32.216837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222669+0000","last_change":"2024-08-17T02:26:32.218955+0000","last_active":"2024-08-17T02:26:32.222669+0000","last_peered":"2024-08-17T02:26:32.222669+0000","last_clean":"2024-08-17T02:26:32.222669+0000","last_became_active":"2024-08-17T02:26:32.218670+0000","last_became_peered":"2024-08-17T02:26:32.218670+0000","last_unstale":"2024-08-17T02:26:32.222669+0000","last_undegraded":"2024-08-17T02:26:32.222669+0000","last_fullsized":"2024-08-17T02:26:32.222669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224570+0000","last_change":"2024-08-17T02:26:32.219168+0000","last_active":"2024-08-17T02:26:32.224570+0000","last_peered":"2024-08-17T02:26:32.224570+0000","last_clean":"2024-08-17T02:26:32.224570+0000","last_became_active":"2024-08-17T02:26:32.218856+0000","last_became_peered":"2024-08-17T02:26:32.218856+0000","last_unstale":"2024-08-17T02:26:32.224570+0000","last_undegraded":"2024-08-17T02:26:32.224570+0000","last_fullsized":"2024-08-17T02:26:32.224570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:12.730663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210090+0000","last_change":"2024-08-17T02:26:32.202312+0000","last_active":"2024-08-17T02:26:32.210090+0000","last_peered":"2024-08-17T02:26:32.210090+0000","last_clean":"2024-08-17T02:26:32.210090+0000","last_became_active":"2024-08-17T02:26:32.202077+0000","last_became_peered":"2024-08-17T02:26:32.202077+0000","last_unstale":"2024-08-17T02:26:32.210090+0000","last_undegraded":"2024-08-17T02:26:32.210090+0000","last_fullsized":"2024-08-17T02:26:32.210090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:12.730663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.205085+0000","last_change":"2024-08-17T02:26:32.201137+0000","last_active":"2024-08-17T02:26:32.205085+0000","last_peered":"2024-08-17T02:26:32.205085+0000","last_clean":"2024-08-17T02:26:32.205085+0000","last_became_active":"2024-08-17T02:26:32.200498+0000","last_became_peered":"2024-08-17T02:26:32.200498+0000","last_unstale":"2024-08-17T02:26:32.205085+0000","last_undegraded":"2024-08-17T02:26:32.205085+0000","last_fullsized":"2024-08-17T02:26:32.205085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:59.385496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.225211+0000","last_change":"2024-08-17T02:26:32.221220+0000","last_active":"2024-08-17T02:26:32.225211+0000","last_peered":"2024-08-17T02:26:32.225211+0000","last_clean":"2024-08-17T02:26:32.225211+0000","last_became_active":"2024-08-17T02:26:32.220959+0000","last_became_peered":"2024-08-17T02:26:32.220959+0000","last_unstale":"2024-08-17T02:26:32.225211+0000","last_undegraded":"2024-08-17T02:26:32.225211+0000","last_fullsized":"2024-08-17T02:26:32.225211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:39.950692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.202233+0000","last_change":"2024-08-17T02:26:32.199159+0000","last_active":"2024-08-17T02:26:32.202233+0000","last_peered":"2024-08-17T02:26:32.202233+0000","last_clean":"2024-08-17T02:26:32.202233+0000","last_became_active":"2024-08-17T02:26:32.198845+0000","last_became_peered":"2024-08-17T02:26:32.198845+0000","last_unstale":"2024-08-17T02:26:32.202233+0000","last_undegraded":"2024-08-17T02:26:32.202233+0000","last_fullsized":"2024-08-17T02:26:32.202233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:12.730663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222754+0000","last_change":"2024-08-17T02:26:32.218327+0000","last_active":"2024-08-17T02:26:32.222754+0000","last_peered":"2024-08-17T02:26:32.222754+0000","last_clean":"2024-08-17T02:26:32.222754+0000","last_became_active":"2024-08-17T02:26:32.218052+0000","last_became_peered":"2024-08-17T02:26:32.218052+0000","last_unstale":"2024-08-17T02:26:32.222754+0000","last_undegraded":"2024-08-17T02:26:32.222754+0000","last_fullsized":"2024-08-17T02:26:32.222754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:59.331351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.202572+0000","last_change":"2024-08-17T02:26:32.199446+0000","last_active":"2024-08-17T02:26:32.202572+0000","last_peered":"2024-08-17T02:26:32.202572+0000","last_clean":"2024-08-17T02:26:32.202572+0000","last_became_active":"2024-08-17T02:26:32.199139+0000","last_became_peered":"2024-08-17T02:26:32.199139+0000","last_unstale":"2024-08-17T02:26:32.202572+0000","last_undegraded":"2024-08-17T02:26:32.202572+0000","last_fullsized":"2024-08-17T02:26:32.202572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:08.860859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.209270+0000","last_change":"2024-08-17T02:26:32.199075+0000","last_active":"2024-08-17T02:26:32.209270+0000","last_peered":"2024-08-17T02:26:32.209270+0000","last_clean":"2024-08-17T02:26:32.209270+0000","last_became_active":"2024-08-17T02:26:32.198255+0000","last_became_peered":"2024-08-17T02:26:32.198255+0000","last_unstale":"2024-08-17T02:26:32.209270+0000","last_undegraded":"2024-08-17T02:26:32.209270+0000","last_fullsized":"2024-08-17T02:26:32.209270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:18.537099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.201883+0000","last_change":"2024-08-17T02:26:32.199005+0000","last_active":"2024-08-17T02:26:32.201883+0000","last_peered":"2024-08-17T02:26:32.201883+0000","last_clean":"2024-08-17T02:26:32.201883+0000","last_became_active":"2024-08-17T02:26:32.198711+0000","last_became_peered":"2024-08-17T02:26:32.198711+0000","last_unstale":"2024-08-17T02:26:32.201883+0000","last_undegraded":"2024-08-17T02:26:32.201883+0000","last_fullsized":"2024-08-17T02:26:32.201883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:22.633118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223675+0000","last_change":"2024-08-17T02:26:31.188549+0000","last_active":"2024-08-17T02:26:32.223675+0000","last_peered":"2024-08-17T02:26:32.223675+0000","last_clean":"2024-08-17T02:26:32.223675+0000","last_became_active":"2024-08-17T02:26:31.188272+0000","last_became_peered":"2024-08-17T02:26:31.188272+0000","last_unstale":"2024-08-17T02:26:32.223675+0000","last_undegraded":"2024-08-17T02:26:32.223675+0000","last_fullsized":"2024-08-17T02:26:32.223675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:46.029644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222700+0000","last_change":"2024-08-17T02:26:32.214370+0000","last_active":"2024-08-17T02:26:32.222700+0000","last_peered":"2024-08-17T02:26:32.222700+0000","last_clean":"2024-08-17T02:26:32.222700+0000","last_became_active":"2024-08-17T02:26:32.214126+0000","last_became_peered":"2024-08-17T02:26:32.214126+0000","last_unstale":"2024-08-17T02:26:32.222700+0000","last_undegraded":"2024-08-17T02:26:32.222700+0000","last_fullsized":"2024-08-17T02:26:32.222700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:39.950692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224831+0000","last_change":"2024-08-17T02:26:31.203526+0000","last_active":"2024-08-17T02:26:32.224831+0000","last_peered":"2024-08-17T02:26:32.224831+0000","last_clean":"2024-08-17T02:26:32.224831+0000","last_became_active":"2024-08-17T02:26:31.202971+0000","last_became_peered":"2024-08-17T02:26:31.202971+0000","last_unstale":"2024-08-17T02:26:32.224831+0000","last_undegraded":"2024-08-17T02:26:32.224831+0000","last_fullsized":"2024-08-17T02:26:32.224831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:29.752289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.191559+0000","last_change":"2024-08-17T02:26:31.200001+0000","last_active":"2024-08-17T02:26:32.191559+0000","last_peered":"2024-08-17T02:26:32.191559+0000","last_clean":"2024-08-17T02:26:32.191559+0000","last_became_active":"2024-08-17T02:26:31.199719+0000","last_became_peered":"2024-08-17T02:26:31.199719+0000","last_unstale":"2024-08-17T02:26:32.191559+0000","last_undegraded":"2024-08-17T02:26:32.191559+0000","last_fullsized":"2024-08-17T02:26:32.191559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:13:53.155805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216384+0000","last_change":"2024-08-17T02:26:32.204465+0000","last_active":"2024-08-17T02:26:32.216384+0000","last_peered":"2024-08-17T02:26:32.216384+0000","last_clean":"2024-08-17T02:26:32.216384+0000","last_became_active":"2024-08-17T02:26:32.204203+0000","last_became_peered":"2024-08-17T02:26:32.204203+0000","last_unstale":"2024-08-17T02:26:32.216384+0000","last_undegraded":"2024-08-17T02:26:32.216384+0000","last_fullsized":"2024-08-17T02:26:32.216384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:22.493908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.192718+0000","last_change":"2024-08-17T02:26:31.195728+0000","last_active":"2024-08-17T02:26:32.192718+0000","last_peered":"2024-08-17T02:26:32.192718+0000","last_clean":"2024-08-17T02:26:32.192718+0000","last_became_active":"2024-08-17T02:26:31.195461+0000","last_became_peered":"2024-08-17T02:26:31.195461+0000","last_unstale":"2024-08-17T02:26:32.192718+0000","last_undegraded":"2024-08-17T02:26:32.192718+0000","last_fullsized":"2024-08-17T02:26:32.192718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:00.267868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.205273+0000","last_change":"2024-08-17T02:26:32.201225+0000","last_active":"2024-08-17T02:26:32.205273+0000","last_peered":"2024-08-17T02:26:32.205273+0000","last_clean":"2024-08-17T02:26:32.205273+0000","last_became_active":"2024-08-17T02:26:32.200883+0000","last_became_peered":"2024-08-17T02:26:32.200883+0000","last_unstale":"2024-08-17T02:26:32.205273+0000","last_undegraded":"2024-08-17T02:26:32.205273+0000","last_fullsized":"2024-08-17T02:26:32.205273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.196667+0000","last_change":"2024-08-17T02:26:31.203729+0000","last_active":"2024-08-17T02:26:32.196667+0000","last_peered":"2024-08-17T02:26:32.196667+0000","last_clean":"2024-08-17T02:26:32.196667+0000","last_became_active":"2024-08-17T02:26:31.203402+0000","last_became_peered":"2024-08-17T02:26:31.203402+0000","last_unstale":"2024-08-17T02:26:32.196667+0000","last_undegraded":"2024-08-17T02:26:32.196667+0000","last_fullsized":"2024-08-17T02:26:32.196667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:21.626630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.214196+0000","last_change":"2024-08-17T02:26:32.209985+0000","last_active":"2024-08-17T02:26:32.214196+0000","last_peered":"2024-08-17T02:26:32.214196+0000","last_clean":"2024-08-17T02:26:32.214196+0000","last_became_active":"2024-08-17T02:26:32.209542+0000","last_became_peered":"2024-08-17T02:26:32.209542+0000","last_unstale":"2024-08-17T02:26:32.214196+0000","last_undegraded":"2024-08-17T02:26:32.214196+0000","last_fullsized":"2024-08-17T02:26:32.214196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:47.234447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.209840+0000","last_change":"2024-08-17T02:26:31.205754+0000","last_active":"2024-08-17T02:26:32.209840+0000","last_peered":"2024-08-17T02:26:32.209840+0000","last_clean":"2024-08-17T02:26:32.209840+0000","last_became_active":"2024-08-17T02:26:31.205187+0000","last_became_peered":"2024-08-17T02:26:31.205187+0000","last_unstale":"2024-08-17T02:26:32.209840+0000","last_undegraded":"2024-08-17T02:26:32.209840+0000","last_fullsized":"2024-08-17T02:26:32.209840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:36.476579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222736+0000","last_change":"2024-08-17T02:26:32.213334+0000","last_active":"2024-08-17T02:26:32.222736+0000","last_peered":"2024-08-17T02:26:32.222736+0000","last_clean":"2024-08-17T02:26:32.222736+0000","last_became_active":"2024-08-17T02:26:32.213073+0000","last_became_peered":"2024-08-17T02:26:32.213073+0000","last_unstale":"2024-08-17T02:26:32.222736+0000","last_undegraded":"2024-08-17T02:26:32.222736+0000","last_fullsized":"2024-08-17T02:26:32.222736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:16:50.112486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.226031+0000","last_change":"2024-08-17T02:26:31.193999+0000","last_active":"2024-08-17T02:26:32.226031+0000","last_peered":"2024-08-17T02:26:32.226031+0000","last_clean":"2024-08-17T02:26:32.226031+0000","last_became_active":"2024-08-17T02:26:31.193689+0000","last_became_peered":"2024-08-17T02:26:31.193689+0000","last_unstale":"2024-08-17T02:26:32.226031+0000","last_undegraded":"2024-08-17T02:26:32.226031+0000","last_fullsized":"2024-08-17T02:26:32.226031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:07.854371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.221598+0000","last_change":"2024-08-17T02:26:32.210669+0000","last_active":"2024-08-17T02:26:32.221598+0000","last_peered":"2024-08-17T02:26:32.221598+0000","last_clean":"2024-08-17T02:26:32.221598+0000","last_became_active":"2024-08-17T02:26:32.203230+0000","last_became_peered":"2024-08-17T02:26:32.203230+0000","last_unstale":"2024-08-17T02:26:32.221598+0000","last_undegraded":"2024-08-17T02:26:32.221598+0000","last_fullsized":"2024-08-17T02:26:32.221598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:35.520908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.228823+0000","last_change":"2024-08-17T02:26:31.204431+0000","last_active":"2024-08-17T02:26:32.228823+0000","last_peered":"2024-08-17T02:26:32.228823+0000","last_clean":"2024-08-17T02:26:32.228823+0000","last_became_active":"2024-08-17T02:26:31.204173+0000","last_became_peered":"2024-08-17T02:26:31.204173+0000","last_unstale":"2024-08-17T02:26:32.228823+0000","last_undegraded":"2024-08-17T02:26:32.228823+0000","last_fullsized":"2024-08-17T02:26:32.228823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:36.476579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223479+0000","last_change":"2024-08-17T02:26:32.216157+0000","last_active":"2024-08-17T02:26:32.223479+0000","last_peered":"2024-08-17T02:26:32.223479+0000","last_clean":"2024-08-17T02:26:32.223479+0000","last_became_active":"2024-08-17T02:26:32.215849+0000","last_became_peered":"2024-08-17T02:26:32.215849+0000","last_unstale":"2024-08-17T02:26:32.223479+0000","last_undegraded":"2024-08-17T02:26:32.223479+0000","last_fullsized":"2024-08-17T02:26:32.223479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:47.234447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.225699+0000","last_change":"2024-08-17T02:26:31.203059+0000","last_active":"2024-08-17T02:26:32.225699+0000","last_peered":"2024-08-17T02:26:32.225699+0000","last_clean":"2024-08-17T02:26:32.225699+0000","last_became_active":"2024-08-17T02:26:31.202794+0000","last_became_peered":"2024-08-17T02:26:31.202794+0000","last_unstale":"2024-08-17T02:26:32.225699+0000","last_undegraded":"2024-08-17T02:26:32.225699+0000","last_fullsized":"2024-08-17T02:26:32.225699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:46.029644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216333+0000","last_change":"2024-08-17T02:26:32.210912+0000","last_active":"2024-08-17T02:26:32.216333+0000","last_peered":"2024-08-17T02:26:32.216333+0000","last_clean":"2024-08-17T02:26:32.216333+0000","last_became_active":"2024-08-17T02:26:32.210509+0000","last_became_peered":"2024-08-17T02:26:32.210509+0000","last_unstale":"2024-08-17T02:26:32.216333+0000","last_undegraded":"2024-08-17T02:26:32.216333+0000","last_fullsized":"2024-08-17T02:26:32.216333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:08.860859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210217+0000","last_change":"2024-08-17T02:26:31.197665+0000","last_active":"2024-08-17T02:26:32.210217+0000","last_peered":"2024-08-17T02:26:32.210217+0000","last_clean":"2024-08-17T02:26:32.210217+0000","last_became_active":"2024-08-17T02:26:31.197429+0000","last_became_peered":"2024-08-17T02:26:31.197429+0000","last_unstale":"2024-08-17T02:26:32.210217+0000","last_undegraded":"2024-08-17T02:26:32.210217+0000","last_fullsized":"2024-08-17T02:26:32.210217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:14.675670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.208532+0000","last_change":"2024-08-17T02:26:32.204360+0000","last_active":"2024-08-17T02:26:32.208532+0000","last_peered":"2024-08-17T02:26:32.208532+0000","last_clean":"2024-08-17T02:26:32.208532+0000","last_became_active":"2024-08-17T02:26:32.197360+0000","last_became_peered":"2024-08-17T02:26:32.197360+0000","last_unstale":"2024-08-17T02:26:32.208532+0000","last_undegraded":"2024-08-17T02:26:32.208532+0000","last_fullsized":"2024-08-17T02:26:32.208532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:04:17.552404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.193585+0000","last_change":"2024-08-17T02:26:31.203360+0000","last_active":"2024-08-17T02:26:32.193585+0000","last_peered":"2024-08-17T02:26:32.193585+0000","last_clean":"2024-08-17T02:26:32.193585+0000","last_became_active":"2024-08-17T02:26:31.202988+0000","last_became_peered":"2024-08-17T02:26:31.202988+0000","last_unstale":"2024-08-17T02:26:32.193585+0000","last_undegraded":"2024-08-17T02:26:32.193585+0000","last_fullsized":"2024-08-17T02:26:32.193585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:53:03.434511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.214346+0000","last_change":"2024-08-17T02:26:32.198486+0000","last_active":"2024-08-17T02:26:32.214346+0000","last_peered":"2024-08-17T02:26:32.214346+0000","last_clean":"2024-08-17T02:26:32.214346+0000","last_became_active":"2024-08-17T02:26:32.197905+0000","last_became_peered":"2024-08-17T02:26:32.197905+0000","last_unstale":"2024-08-17T02:26:32.214346+0000","last_undegraded":"2024-08-17T02:26:32.214346+0000","last_fullsized":"2024-08-17T02:26:32.214346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:53.545799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.226669+0000","last_change":"2024-08-17T02:26:31.193931+0000","last_active":"2024-08-17T02:26:32.226669+0000","last_peered":"2024-08-17T02:26:32.226669+0000","last_clean":"2024-08-17T02:26:32.226669+0000","last_became_active":"2024-08-17T02:26:31.192003+0000","last_became_peered":"2024-08-17T02:26:31.192003+0000","last_unstale":"2024-08-17T02:26:32.226669+0000","last_undegraded":"2024-08-17T02:26:32.226669+0000","last_fullsized":"2024-08-17T02:26:32.226669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:14.675670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.209304+0000","last_change":"2024-08-17T02:26:32.206117+0000","last_active":"2024-08-17T02:26:32.209304+0000","last_peered":"2024-08-17T02:26:32.209304+0000","last_clean":"2024-08-17T02:26:32.209304+0000","last_became_active":"2024-08-17T02:26:32.205803+0000","last_became_peered":"2024-08-17T02:26:32.205803+0000","last_unstale":"2024-08-17T02:26:32.209304+0000","last_undegraded":"2024-08-17T02:26:32.209304+0000","last_fullsized":"2024-08-17T02:26:32.209304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:59.331351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224293+0000","last_change":"2024-08-17T02:26:31.198233+0000","last_active":"2024-08-17T02:26:32.224293+0000","last_peered":"2024-08-17T02:26:32.224293+0000","last_clean":"2024-08-17T02:26:32.224293+0000","last_became_active":"2024-08-17T02:26:31.197699+0000","last_became_peered":"2024-08-17T02:26:31.197699+0000","last_unstale":"2024-08-17T02:26:32.224293+0000","last_undegraded":"2024-08-17T02:26:32.224293+0000","last_fullsized":"2024-08-17T02:26:32.224293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:46.029644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210402+0000","last_change":"2024-08-17T02:26:32.207718+0000","last_active":"2024-08-17T02:26:32.210402+0000","last_peered":"2024-08-17T02:26:32.210402+0000","last_clean":"2024-08-17T02:26:32.210402+0000","last_became_active":"2024-08-17T02:26:32.204744+0000","last_became_peered":"2024-08-17T02:26:32.204744+0000","last_unstale":"2024-08-17T02:26:32.210402+0000","last_undegraded":"2024-08-17T02:26:32.210402+0000","last_fullsized":"2024-08-17T02:26:32.210402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:56:37.929984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224554+0000","last_change":"2024-08-17T02:26:31.195725+0000","last_active":"2024-08-17T02:26:32.224554+0000","last_peered":"2024-08-17T02:26:32.224554+0000","last_clean":"2024-08-17T02:26:32.224554+0000","last_became_active":"2024-08-17T02:26:31.195446+0000","last_became_peered":"2024-08-17T02:26:31.195446+0000","last_unstale":"2024-08-17T02:26:32.224554+0000","last_undegraded":"2024-08-17T02:26:32.224554+0000","last_fullsized":"2024-08-17T02:26:32.224554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:00.267868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.209351+0000","last_change":"2024-08-17T02:26:32.207003+0000","last_active":"2024-08-17T02:26:32.209351+0000","last_peered":"2024-08-17T02:26:32.209351+0000","last_clean":"2024-08-17T02:26:32.209351+0000","last_became_active":"2024-08-17T02:26:32.206741+0000","last_became_peered":"2024-08-17T02:26:32.206741+0000","last_unstale":"2024-08-17T02:26:32.209351+0000","last_undegraded":"2024-08-17T02:26:32.209351+0000","last_fullsized":"2024-08-17T02:26:32.209351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:44.277870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.225797+0000","last_change":"2024-08-17T02:26:31.188727+0000","last_active":"2024-08-17T02:26:32.225797+0000","last_peered":"2024-08-17T02:26:32.225797+0000","last_clean":"2024-08-17T02:26:32.225797+0000","last_became_active":"2024-08-17T02:26:31.187702+0000","last_became_peered":"2024-08-17T02:26:31.187702+0000","last_unstale":"2024-08-17T02:26:32.225797+0000","last_undegraded":"2024-08-17T02:26:32.225797+0000","last_fullsized":"2024-08-17T02:26:32.225797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:29.752289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.227485+0000","last_change":"2024-08-17T02:26:32.226432+0000","last_active":"2024-08-17T02:26:32.227485+0000","last_peered":"2024-08-17T02:26:32.227485+0000","last_clean":"2024-08-17T02:26:32.227485+0000","last_became_active":"2024-08-17T02:26:32.226202+0000","last_became_peered":"2024-08-17T02:26:32.226202+0000","last_unstale":"2024-08-17T02:26:32.227485+0000","last_undegraded":"2024-08-17T02:26:32.227485+0000","last_fullsized":"2024-08-17T02:26:32.227485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:19:31.787387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.188823+0000","last_change":"2024-08-17T02:26:31.196292+0000","last_active":"2024-08-17T02:26:32.188823+0000","last_peered":"2024-08-17T02:26:32.188823+0000","last_clean":"2024-08-17T02:26:32.188823+0000","last_became_active":"2024-08-17T02:26:31.196030+0000","last_became_peered":"2024-08-17T02:26:31.196030+0000","last_unstale":"2024-08-17T02:26:32.188823+0000","last_undegraded":"2024-08-17T02:26:32.188823+0000","last_fullsized":"2024-08-17T02:26:32.188823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:36.476579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223492+0000","last_change":"2024-08-17T02:26:32.217034+0000","last_active":"2024-08-17T02:26:32.223492+0000","last_peered":"2024-08-17T02:26:32.223492+0000","last_clean":"2024-08-17T02:26:32.223492+0000","last_became_active":"2024-08-17T02:26:32.215414+0000","last_became_peered":"2024-08-17T02:26:32.215414+0000","last_unstale":"2024-08-17T02:26:32.223492+0000","last_undegraded":"2024-08-17T02:26:32.223492+0000","last_fullsized":"2024-08-17T02:26:32.223492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:22.327159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.185570+0000","last_change":"2024-08-17T02:26:27.275086+0000","last_active":"2024-08-17T02:26:32.185570+0000","last_peered":"2024-08-17T02:26:32.185570+0000","last_clean":"2024-08-17T02:26:32.185570+0000","last_became_active":"2024-08-17T02:26:27.274075+0000","last_became_peered":"2024-08-17T02:26:27.274075+0000","last_unstale":"2024-08-17T02:26:32.185570+0000","last_undegraded":"2024-08-17T02:26:32.185570+0000","last_fullsized":"2024-08-17T02:26:32.185570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_clean_scrub_stamp":"2024-08-17T02:26:26.139133+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:52.161982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210441+0000","last_change":"2024-08-17T02:26:31.198699+0000","last_active":"2024-08-17T02:26:32.210441+0000","last_peered":"2024-08-17T02:26:32.210441+0000","last_clean":"2024-08-17T02:26:32.210441+0000","last_became_active":"2024-08-17T02:26:31.198462+0000","last_became_peered":"2024-08-17T02:26:31.198462+0000","last_unstale":"2024-08-17T02:26:32.210441+0000","last_undegraded":"2024-08-17T02:26:32.210441+0000","last_fullsized":"2024-08-17T02:26:32.210441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:13:53.155805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224120+0000","last_change":"2024-08-17T02:26:32.217116+0000","last_active":"2024-08-17T02:26:32.224120+0000","last_peered":"2024-08-17T02:26:32.224120+0000","last_clean":"2024-08-17T02:26:32.224120+0000","last_became_active":"2024-08-17T02:26:32.216502+0000","last_became_peered":"2024-08-17T02:26:32.216502+0000","last_unstale":"2024-08-17T02:26:32.224120+0000","last_undegraded":"2024-08-17T02:26:32.224120+0000","last_fullsized":"2024-08-17T02:26:32.224120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:59.385496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.185482+0000","last_change":"2024-08-17T02:26:31.194925+0000","last_active":"2024-08-17T02:26:32.185482+0000","last_peered":"2024-08-17T02:26:32.185482+0000","last_clean":"2024-08-17T02:26:32.185482+0000","last_became_active":"2024-08-17T02:26:31.194668+0000","last_became_peered":"2024-08-17T02:26:31.194668+0000","last_unstale":"2024-08-17T02:26:32.185482+0000","last_undegraded":"2024-08-17T02:26:32.185482+0000","last_fullsized":"2024-08-17T02:26:32.185482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:17.346775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216389+0000","last_change":"2024-08-17T02:26:32.212095+0000","last_active":"2024-08-17T02:26:32.216389+0000","last_peered":"2024-08-17T02:26:32.216389+0000","last_clean":"2024-08-17T02:26:32.216389+0000","last_became_active":"2024-08-17T02:26:32.211786+0000","last_became_peered":"2024-08-17T02:26:32.211786+0000","last_unstale":"2024-08-17T02:26:32.216389+0000","last_undegraded":"2024-08-17T02:26:32.216389+0000","last_fullsized":"2024-08-17T02:26:32.216389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:12:08.917953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.189462+0000","last_change":"2024-08-17T02:26:31.190007+0000","last_active":"2024-08-17T02:26:32.189462+0000","last_peered":"2024-08-17T02:26:32.189462+0000","last_clean":"2024-08-17T02:26:32.189462+0000","last_became_active":"2024-08-17T02:26:31.189669+0000","last_became_peered":"2024-08-17T02:26:31.189669+0000","last_unstale":"2024-08-17T02:26:32.189462+0000","last_undegraded":"2024-08-17T02:26:32.189462+0000","last_fullsized":"2024-08-17T02:26:32.189462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:13:53.155805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.201194+0000","last_change":"2024-08-17T02:26:32.195428+0000","last_active":"2024-08-17T02:26:32.201194+0000","last_peered":"2024-08-17T02:26:32.201194+0000","last_clean":"2024-08-17T02:26:32.201194+0000","last_became_active":"2024-08-17T02:26:32.195121+0000","last_became_peered":"2024-08-17T02:26:32.195121+0000","last_unstale":"2024-08-17T02:26:32.201194+0000","last_undegraded":"2024-08-17T02:26:32.201194+0000","last_fullsized":"2024-08-17T02:26:32.201194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210311+0000","last_change":"2024-08-17T02:26:31.196698+0000","last_active":"2024-08-17T02:26:32.210311+0000","last_peered":"2024-08-17T02:26:32.210311+0000","last_clean":"2024-08-17T02:26:32.210311+0000","last_became_active":"2024-08-17T02:26:31.195740+0000","last_became_peered":"2024-08-17T02:26:31.195740+0000","last_unstale":"2024-08-17T02:26:32.210311+0000","last_undegraded":"2024-08-17T02:26:32.210311+0000","last_fullsized":"2024-08-17T02:26:32.210311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:29.752289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223829+0000","last_change":"2024-08-17T02:26:32.214042+0000","last_active":"2024-08-17T02:26:32.223829+0000","last_peered":"2024-08-17T02:26:32.223829+0000","last_clean":"2024-08-17T02:26:32.223829+0000","last_became_active":"2024-08-17T02:26:32.211384+0000","last_became_peered":"2024-08-17T02:26:32.211384+0000","last_unstale":"2024-08-17T02:26:32.223829+0000","last_undegraded":"2024-08-17T02:26:32.223829+0000","last_fullsized":"2024-08-17T02:26:32.223829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:08.860859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.184099+0000","last_change":"2024-08-17T02:26:31.199414+0000","last_active":"2024-08-17T02:26:32.184099+0000","last_peered":"2024-08-17T02:26:32.184099+0000","last_clean":"2024-08-17T02:26:32.184099+0000","last_became_active":"2024-08-17T02:26:31.199123+0000","last_became_peered":"2024-08-17T02:26:31.199123+0000","last_unstale":"2024-08-17T02:26:32.184099+0000","last_undegraded":"2024-08-17T02:26:32.184099+0000","last_fullsized":"2024-08-17T02:26:32.184099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:21.626630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222976+0000","last_change":"2024-08-17T02:26:32.219444+0000","last_active":"2024-08-17T02:26:32.222976+0000","last_peered":"2024-08-17T02:26:32.222976+0000","last_clean":"2024-08-17T02:26:32.222976+0000","last_became_active":"2024-08-17T02:26:32.219214+0000","last_became_peered":"2024-08-17T02:26:32.219214+0000","last_unstale":"2024-08-17T02:26:32.222976+0000","last_undegraded":"2024-08-17T02:26:32.222976+0000","last_fullsized":"2024-08-17T02:26:32.222976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:44.277870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.189655+0000","last_change":"2024-08-17T02:26:31.200700+0000","last_active":"2024-08-17T02:26:32.189655+0000","last_peered":"2024-08-17T02:26:32.189655+0000","last_clean":"2024-08-17T02:26:32.189655+0000","last_became_active":"2024-08-17T02:26:31.200119+0000","last_became_peered":"2024-08-17T02:26:31.200119+0000","last_unstale":"2024-08-17T02:26:32.189655+0000","last_undegraded":"2024-08-17T02:26:32.189655+0000","last_fullsized":"2024-08-17T02:26:32.189655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:21.626630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.205241+0000","last_change":"2024-08-17T02:26:32.204045+0000","last_active":"2024-08-17T02:26:32.205241+0000","last_peered":"2024-08-17T02:26:32.205241+0000","last_clean":"2024-08-17T02:26:32.205241+0000","last_became_active":"2024-08-17T02:26:32.201851+0000","last_became_peered":"2024-08-17T02:26:32.201851+0000","last_unstale":"2024-08-17T02:26:32.205241+0000","last_undegraded":"2024-08-17T02:26:32.205241+0000","last_fullsized":"2024-08-17T02:26:32.205241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:16:50.112486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.184099+0000","last_change":"2024-08-17T02:26:31.201702+0000","last_active":"2024-08-17T02:26:32.184099+0000","last_peered":"2024-08-17T02:26:32.184099+0000","last_clean":"2024-08-17T02:26:32.184099+0000","last_became_active":"2024-08-17T02:26:31.201252+0000","last_became_peered":"2024-08-17T02:26:31.201252+0000","last_unstale":"2024-08-17T02:26:32.184099+0000","last_undegraded":"2024-08-17T02:26:32.184099+0000","last_fullsized":"2024-08-17T02:26:32.184099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:34.514420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216794+0000","last_change":"2024-08-17T02:26:32.209105+0000","last_active":"2024-08-17T02:26:32.216794+0000","last_peered":"2024-08-17T02:26:32.216794+0000","last_clean":"2024-08-17T02:26:32.216794+0000","last_became_active":"2024-08-17T02:26:32.208827+0000","last_became_peered":"2024-08-17T02:26:32.208827+0000","last_unstale":"2024-08-17T02:26:32.216794+0000","last_undegraded":"2024-08-17T02:26:32.216794+0000","last_fullsized":"2024-08-17T02:26:32.216794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:12:08.917953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224248+0000","last_change":"2024-08-17T02:26:31.198056+0000","last_active":"2024-08-17T02:26:32.224248+0000","last_peered":"2024-08-17T02:26:32.224248+0000","last_clean":"2024-08-17T02:26:32.224248+0000","last_became_active":"2024-08-17T02:26:31.197375+0000","last_became_peered":"2024-08-17T02:26:31.197375+0000","last_unstale":"2024-08-17T02:26:32.224248+0000","last_undegraded":"2024-08-17T02:26:32.224248+0000","last_fullsized":"2024-08-17T02:26:32.224248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:14.675670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.207777+0000","last_change":"2024-08-17T02:26:32.204547+0000","last_active":"2024-08-17T02:26:32.207777+0000","last_peered":"2024-08-17T02:26:32.207777+0000","last_clean":"2024-08-17T02:26:32.207777+0000","last_became_active":"2024-08-17T02:26:32.204234+0000","last_became_peered":"2024-08-17T02:26:32.204234+0000","last_unstale":"2024-08-17T02:26:32.207777+0000","last_undegraded":"2024-08-17T02:26:32.207777+0000","last_fullsized":"2024-08-17T02:26:32.207777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:22.493908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.185436+0000","last_change":"2024-08-17T02:26:31.199235+0000","last_active":"2024-08-17T02:26:32.185436+0000","last_peered":"2024-08-17T02:26:32.185436+0000","last_clean":"2024-08-17T02:26:32.185436+0000","last_became_active":"2024-08-17T02:26:31.198951+0000","last_became_peered":"2024-08-17T02:26:31.198951+0000","last_unstale":"2024-08-17T02:26:32.185436+0000","last_undegraded":"2024-08-17T02:26:32.185436+0000","last_fullsized":"2024-08-17T02:26:32.185436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:29.752289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.218771+0000","last_change":"2024-08-17T02:26:32.202792+0000","last_active":"2024-08-17T02:26:32.218771+0000","last_peered":"2024-08-17T02:26:32.218771+0000","last_clean":"2024-08-17T02:26:32.218771+0000","last_became_active":"2024-08-17T02:26:32.201978+0000","last_became_peered":"2024-08-17T02:26:32.201978+0000","last_unstale":"2024-08-17T02:26:32.218771+0000","last_undegraded":"2024-08-17T02:26:32.218771+0000","last_fullsized":"2024-08-17T02:26:32.218771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:25.946664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.184248+0000","last_change":"2024-08-17T02:26:31.199305+0000","last_active":"2024-08-17T02:26:32.184248+0000","last_peered":"2024-08-17T02:26:32.184248+0000","last_clean":"2024-08-17T02:26:32.184248+0000","last_became_active":"2024-08-17T02:26:31.199023+0000","last_became_peered":"2024-08-17T02:26:31.199023+0000","last_unstale":"2024-08-17T02:26:32.184248+0000","last_undegraded":"2024-08-17T02:26:32.184248+0000","last_fullsized":"2024-08-17T02:26:32.184248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:36.476579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216869+0000","last_change":"2024-08-17T02:26:32.211397+0000","last_active":"2024-08-17T02:26:32.216869+0000","last_peered":"2024-08-17T02:26:32.216869+0000","last_clean":"2024-08-17T02:26:32.216869+0000","last_became_active":"2024-08-17T02:26:32.211105+0000","last_became_peered":"2024-08-17T02:26:32.211105+0000","last_unstale":"2024-08-17T02:26:32.216869+0000","last_undegraded":"2024-08-17T02:26:32.216869+0000","last_fullsized":"2024-08-17T02:26:32.216869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:49.834790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.183924+0000","last_change":"2024-08-17T02:26:31.194944+0000","last_active":"2024-08-17T02:26:32.183924+0000","last_peered":"2024-08-17T02:26:32.183924+0000","last_clean":"2024-08-17T02:26:32.183924+0000","last_became_active":"2024-08-17T02:26:31.194583+0000","last_became_peered":"2024-08-17T02:26:31.194583+0000","last_unstale":"2024-08-17T02:26:32.183924+0000","last_undegraded":"2024-08-17T02:26:32.183924+0000","last_fullsized":"2024-08-17T02:26:32.183924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:24.940176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.217295+0000","last_change":"2024-08-17T02:26:32.208192+0000","last_active":"2024-08-17T02:26:32.217295+0000","last_peered":"2024-08-17T02:26:32.217295+0000","last_clean":"2024-08-17T02:26:32.217295+0000","last_became_active":"2024-08-17T02:26:32.205401+0000","last_became_peered":"2024-08-17T02:26:32.205401+0000","last_unstale":"2024-08-17T02:26:32.217295+0000","last_undegraded":"2024-08-17T02:26:32.217295+0000","last_fullsized":"2024-08-17T02:26:32.217295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:01:56.405892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224746+0000","last_change":"2024-08-17T02:26:31.188577+0000","last_active":"2024-08-17T02:26:32.224746+0000","last_peered":"2024-08-17T02:26:32.224746+0000","last_clean":"2024-08-17T02:26:32.224746+0000","last_became_active":"2024-08-17T02:26:31.188261+0000","last_became_peered":"2024-08-17T02:26:31.188261+0000","last_unstale":"2024-08-17T02:26:32.224746+0000","last_undegraded":"2024-08-17T02:26:32.224746+0000","last_fullsized":"2024-08-17T02:26:32.224746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:07.854371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210736+0000","last_change":"2024-08-17T02:26:32.204687+0000","last_active":"2024-08-17T02:26:32.210736+0000","last_peered":"2024-08-17T02:26:32.210736+0000","last_clean":"2024-08-17T02:26:32.210736+0000","last_became_active":"2024-08-17T02:26:32.203288+0000","last_became_peered":"2024-08-17T02:26:32.203288+0000","last_unstale":"2024-08-17T02:26:32.210736+0000","last_undegraded":"2024-08-17T02:26:32.210736+0000","last_fullsized":"2024-08-17T02:26:32.210736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:59.385496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.212562+0000","last_change":"2024-08-17T02:26:32.205101+0000","last_active":"2024-08-17T02:26:32.212562+0000","last_peered":"2024-08-17T02:26:32.212562+0000","last_clean":"2024-08-17T02:26:32.212562+0000","last_became_active":"2024-08-17T02:26:32.204789+0000","last_became_peered":"2024-08-17T02:26:32.204789+0000","last_unstale":"2024-08-17T02:26:32.212562+0000","last_undegraded":"2024-08-17T02:26:32.212562+0000","last_fullsized":"2024-08-17T02:26:32.212562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:53.799652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.226792+0000","last_change":"2024-08-17T02:26:31.192488+0000","last_active":"2024-08-17T02:26:32.226792+0000","last_peered":"2024-08-17T02:26:32.226792+0000","last_clean":"2024-08-17T02:26:32.226792+0000","last_became_active":"2024-08-17T02:26:31.191791+0000","last_became_peered":"2024-08-17T02:26:31.191791+0000","last_unstale":"2024-08-17T02:26:32.226792+0000","last_undegraded":"2024-08-17T02:26:32.226792+0000","last_fullsized":"2024-08-17T02:26:32.226792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:24.940176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222373+0000","last_change":"2024-08-17T02:26:32.214245+0000","last_active":"2024-08-17T02:26:32.222373+0000","last_peered":"2024-08-17T02:26:32.222373+0000","last_clean":"2024-08-17T02:26:32.222373+0000","last_became_active":"2024-08-17T02:26:32.212733+0000","last_became_peered":"2024-08-17T02:26:32.212733+0000","last_unstale":"2024-08-17T02:26:32.222373+0000","last_undegraded":"2024-08-17T02:26:32.222373+0000","last_fullsized":"2024-08-17T02:26:32.222373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:22.493908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.225876+0000","last_change":"2024-08-17T02:26:31.201149+0000","last_active":"2024-08-17T02:26:32.225876+0000","last_peered":"2024-08-17T02:26:32.225876+0000","last_clean":"2024-08-17T02:26:32.225876+0000","last_became_active":"2024-08-17T02:26:31.200976+0000","last_became_peered":"2024-08-17T02:26:31.200976+0000","last_unstale":"2024-08-17T02:26:32.225876+0000","last_undegraded":"2024-08-17T02:26:32.225876+0000","last_fullsized":"2024-08-17T02:26:32.225876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:34.514420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222755+0000","last_change":"2024-08-17T02:26:32.213833+0000","last_active":"2024-08-17T02:26:32.222755+0000","last_peered":"2024-08-17T02:26:32.222755+0000","last_clean":"2024-08-17T02:26:32.222755+0000","last_became_active":"2024-08-17T02:26:32.213562+0000","last_became_peered":"2024-08-17T02:26:32.213562+0000","last_unstale":"2024-08-17T02:26:32.222755+0000","last_undegraded":"2024-08-17T02:26:32.222755+0000","last_fullsized":"2024-08-17T02:26:32.222755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223551+0000","last_change":"2024-08-17T02:26:31.198494+0000","last_active":"2024-08-17T02:26:32.223551+0000","last_peered":"2024-08-17T02:26:32.223551+0000","last_clean":"2024-08-17T02:26:32.223551+0000","last_became_active":"2024-08-17T02:26:31.198155+0000","last_became_peered":"2024-08-17T02:26:31.198155+0000","last_unstale":"2024-08-17T02:26:32.223551+0000","last_undegraded":"2024-08-17T02:26:32.223551+0000","last_fullsized":"2024-08-17T02:26:32.223551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:53:03.434511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216630+0000","last_change":"2024-08-17T02:26:32.206009+0000","last_active":"2024-08-17T02:26:32.216630+0000","last_peered":"2024-08-17T02:26:32.216630+0000","last_clean":"2024-08-17T02:26:32.216630+0000","last_became_active":"2024-08-17T02:26:32.205332+0000","last_became_peered":"2024-08-17T02:26:32.205332+0000","last_unstale":"2024-08-17T02:26:32.216630+0000","last_undegraded":"2024-08-17T02:26:32.216630+0000","last_fullsized":"2024-08-17T02:26:32.216630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:25.408345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.226730+0000","last_change":"2024-08-17T02:26:31.198180+0000","last_active":"2024-08-17T02:26:32.226730+0000","last_peered":"2024-08-17T02:26:32.226730+0000","last_clean":"2024-08-17T02:26:32.226730+0000","last_became_active":"2024-08-17T02:26:31.197718+0000","last_became_peered":"2024-08-17T02:26:31.197718+0000","last_unstale":"2024-08-17T02:26:32.226730+0000","last_undegraded":"2024-08-17T02:26:32.226730+0000","last_fullsized":"2024-08-17T02:26:32.226730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:24:55.382440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":217088,"data_stored":70577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:36.793 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:26:36.793 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:26:36.793 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:26:36.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:26:36.794 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:26:36.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.979+0000 7fd6ad600640 1 Processor -- start 2024-08-17T02:26:36.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.980+0000 7fd6ad600640 1 -- start start 2024-08-17T02:26:36.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.981+0000 7fd6ad600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6a80ad790 0x7fd6a80adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.981+0000 7fd6ad600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd6a80c9d20 0x7fd6a80ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.981+0000 7fd6ad600640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a80ca6b0 con 0x7fd6a81552d0 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.981+0000 7fd6ad600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a80cb180 con 0x7fd6a80ad790 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.981+0000 7fd6ad600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a80af530 con 0x7fd6a80c9d20 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.981+0000 7fd6a7e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6a80ad790 0x7fd6a80adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.981+0000 7fd6acc00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd6a81552d0 0x7fd6a8155750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38238/0 (socket says 172.21.15.6:38238) 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.981+0000 7fd6acc00640 1 -- 172.21.15.6:0/663856506 learned_addr learned my addr 172.21.15.6:0/663856506 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.981+0000 7fd6a7e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6a80ad790 0x7fd6a80adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56814/0 (socket says 172.21.15.6:56814) 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.981+0000 7fd69fe00640 1 --2- 172.21.15.6:0/663856506 >> v2:172.21.15.136:3300/0 conn(0x7fd6a80c9d20 0x7fd6a80ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.982+0000 7fd6a7e00640 1 -- 172.21.15.6:0/663856506 >> v2:172.21.15.136:3300/0 conn(0x7fd6a80c9d20 msgr2=0x7fd6a80ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.982+0000 7fd6a7e00640 1 --2- 172.21.15.6:0/663856506 >> v2:172.21.15.136:3300/0 conn(0x7fd6a80c9d20 0x7fd6a80ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.982+0000 7fd6a7e00640 1 -- 172.21.15.6:0/663856506 >> v1:172.21.15.6:6789/0 conn(0x7fd6a81552d0 legacy=0x7fd6a8155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.982+0000 7fd6a7400640 1 -- 172.21.15.6:0/663856506 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554690056 0 0) 0x7fd6a80ca6b0 con 0x7fd6a81552d0 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.982+0000 7fd6a7e00640 1 -- 172.21.15.6:0/663856506 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a80ca8e0 con 0x7fd6a80ad790 2024-08-17T02:26:36.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.983+0000 7fd6a7e00640 1 --2- 172.21.15.6:0/663856506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a80ad790 0x7fd6a80adb60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80aa9f0 tx=0x7fd69800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8de531814cd0df0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.983+0000 7fd6a7400640 1 -- 172.21.15.6:0/663856506 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd698032570 con 0x7fd6a80ad790 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.983+0000 7fd6a7400640 1 -- 172.21.15.6:0/663856506 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6980326d0 con 0x7fd6a80ad790 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.983+0000 7fd6a7400640 1 -- 172.21.15.6:0/663856506 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd698032a70 con 0x7fd6a80ad790 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.983+0000 7fd6ad600640 1 -- 172.21.15.6:0/663856506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a80ad790 msgr2=0x7fd6a80adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.983+0000 7fd6ad600640 1 --2- 172.21.15.6:0/663856506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a80ad790 0x7fd6a80adb60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80aa9f0 tx=0x7fd69800b3b0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.983+0000 7fd6ad600640 1 -- 172.21.15.6:0/663856506 shutdown_connections 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.983+0000 7fd6ad600640 1 --2- 172.21.15.6:0/663856506 >> v2:172.21.15.136:3300/0 conn(0x7fd6a80c9d20 0x7fd6a80ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.983+0000 7fd6ad600640 1 --2- 172.21.15.6:0/663856506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a80ad790 0x7fd6a80adb60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.983+0000 7fd6ad600640 1 -- 172.21.15.6:0/663856506 >> 172.21.15.6:0/663856506 conn(0x7fd6a8062af0 msgr2=0x7fd6a8062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.984+0000 7fd6ad600640 1 -- 172.21.15.6:0/663856506 shutdown_connections 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.984+0000 7fd6ad600640 1 -- 172.21.15.6:0/663856506 wait complete. 2024-08-17T02:26:36.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.985+0000 7fd6ad600640 1 Processor -- start 2024-08-17T02:26:36.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.985+0000 7fd6ad600640 1 -- start start 2024-08-17T02:26:36.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.986+0000 7fd6ad600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6a80ad790 0x7fd6a813c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.986+0000 7fd6ad600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6a80c9d20 0x7fd6a814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.986+0000 7fd6ad600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a81552d0 0x7fd6a814b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.986+0000 7fd6ad600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a813c820 con 0x7fd6a81552d0 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.986+0000 7fd6ad600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a814fc10 con 0x7fd6a80ad790 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.986+0000 7fd6ad600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a814f000 con 0x7fd6a80c9d20 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.986+0000 7fd6acc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a81552d0 0x7fd6a814b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.986+0000 7fd6acc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a81552d0 0x7fd6a814b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56828/0 (socket says 172.21.15.6:56828) 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.986+0000 7fd6acc00640 1 -- 172.21.15.6:0/4176447695 learned_addr learned my addr 172.21.15.6:0/4176447695 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.986+0000 7fd6a7e00640 1 --2- 172.21.15.6:0/4176447695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6a80ad790 0x7fd6a813c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.986+0000 7fd69fe00640 1 --2- 172.21.15.6:0/4176447695 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6a80c9d20 0x7fd6a814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.987+0000 7fd6acc00640 1 -- 172.21.15.6:0/4176447695 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6a80c9d20 msgr2=0x7fd6a814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.987+0000 7fd6acc00640 1 --2- 172.21.15.6:0/4176447695 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6a80c9d20 0x7fd6a814e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.987+0000 7fd6acc00640 1 -- 172.21.15.6:0/4176447695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6a80ad790 msgr2=0x7fd6a813c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.987+0000 7fd6acc00640 1 --2- 172.21.15.6:0/4176447695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6a80ad790 0x7fd6a813c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.987+0000 7fd6acc00640 1 -- 172.21.15.6:0/4176447695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69800b630 con 0x7fd6a81552d0 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.987+0000 7fd6acc00640 1 --2- 172.21.15.6:0/4176447695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a81552d0 0x7fd6a814b4d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000cc90 tx=0x7fd6a0001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.987+0000 7fd69f400640 1 -- 172.21.15.6:0/4176447695 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a000a850 con 0x7fd6a81552d0 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.987+0000 7fd69f400640 1 -- 172.21.15.6:0/4176447695 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a000a9b0 con 0x7fd6a81552d0 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.987+0000 7fd69f400640 1 -- 172.21.15.6:0/4176447695 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a000ad70 con 0x7fd6a81552d0 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.987+0000 7fd6ad600640 1 -- 172.21.15.6:0/4176447695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a814f2e0 con 0x7fd6a81552d0 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.987+0000 7fd6ad600640 1 -- 172.21.15.6:0/4176447695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a814f8a0 con 0x7fd6a81552d0 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.988+0000 7fd6ad600640 1 -- 172.21.15.6:0/4176447695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a8154630 con 0x7fd6a81552d0 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.989+0000 7fd69f400640 1 -- 172.21.15.6:0/4176447695 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd6a0007300 con 0x7fd6a81552d0 2024-08-17T02:26:36.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.990+0000 7fd69f400640 1 --2- 172.21.15.6:0/4176447695 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd684065150 0x7fd684067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.990+0000 7fd69f400640 1 -- 172.21.15.6:0/4176447695 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6a0082560 con 0x7fd6a81552d0 2024-08-17T02:26:36.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.990+0000 7fd6a7e00640 1 --2- 172.21.15.6:0/4176447695 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd684065150 0x7fd684067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.991+0000 7fd6a7e00640 1 --2- 172.21.15.6:0/4176447695 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd684065150 0x7fd684067600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd698037000 tx=0x7fd69803a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:36.994+0000 7fd69f400640 1 -- 172.21.15.6:0/4176447695 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd6a8154630 con 0x7fd6a81552d0 2024-08-17T02:26:37.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.219+0000 7fd6ad600640 1 -- 172.21.15.6:0/4176447695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd6a8154630 con 0x7fd6a81552d0 2024-08-17T02:26:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.222+0000 7fd69f400640 1 -- 172.21.15.6:0/4176447695 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161038 (secure 0 0 0) 0x7fd6a8154630 con 0x7fd6a81552d0 2024-08-17T02:26:37.225 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.225+0000 7fd6ad600640 1 -- 172.21.15.6:0/4176447695 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd684065150 msgr2=0x7fd684067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.225+0000 7fd6ad600640 1 --2- 172.21.15.6:0/4176447695 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd684065150 0x7fd684067600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd698037000 tx=0x7fd69803a000 comp rx=0 tx=0).stop 2024-08-17T02:26:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.225+0000 7fd6ad600640 1 -- 172.21.15.6:0/4176447695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a81552d0 msgr2=0x7fd6a814b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.225+0000 7fd6ad600640 1 --2- 172.21.15.6:0/4176447695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a81552d0 0x7fd6a814b4d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000cc90 tx=0x7fd6a0001a80 comp rx=0 tx=0).stop 2024-08-17T02:26:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.225+0000 7fd6ad600640 1 -- 172.21.15.6:0/4176447695 shutdown_connections 2024-08-17T02:26:37.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.225+0000 7fd6ad600640 1 --2- 172.21.15.6:0/4176447695 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd684065150 0x7fd684067600 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.225+0000 7fd6ad600640 1 --2- 172.21.15.6:0/4176447695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a81552d0 0x7fd6a814b4d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.225+0000 7fd6ad600640 1 --2- 172.21.15.6:0/4176447695 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6a80c9d20 0x7fd6a814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.225+0000 7fd6ad600640 1 --2- 172.21.15.6:0/4176447695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6a80ad790 0x7fd6a813c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.225+0000 7fd6ad600640 1 -- 172.21.15.6:0/4176447695 >> 172.21.15.6:0/4176447695 conn(0x7fd6a8062af0 msgr2=0x7fd6a80adb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.225+0000 7fd6ad600640 1 -- 172.21.15.6:0/4176447695 shutdown_connections 2024-08-17T02:26:37.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.225+0000 7fd6ad600640 1 -- 172.21.15.6:0/4176447695 wait complete. 2024-08-17T02:26:37.240 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":36709},{"type":"v1","addr":"172.21.15.136:6833","nonce":36709}]},"active_addr":"172.21.15.136:6833/36709","active_change":"2024-08-17T02:26:17.393254+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":1981007363}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":3572600779}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":2121851652}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":4116896251}]}]} 2024-08-17T02:26:37.244 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:26:37.244 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:26:37.244 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:37.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.395+0000 7f6103e00640 1 Processor -- start 2024-08-17T02:26:37.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.395+0000 7f6103e00640 1 -- start start 2024-08-17T02:26:37.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.397+0000 7f6103e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f61040ccc10 0x7f6104163720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.397+0000 7f6103e00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61040cf600 con 0x7f6104158c90 2024-08-17T02:26:37.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.397+0000 7f6103e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61040cea90 con 0x7f61040cadc0 2024-08-17T02:26:37.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.397+0000 7f6103e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61040ce890 con 0x7f61040ccc10 2024-08-17T02:26:37.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.397+0000 7f6102a00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6104158c90 0x7f61040ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38240/0 (socket says 172.21.15.6:38240) 2024-08-17T02:26:37.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.397+0000 7f6102a00640 1 -- 172.21.15.6:0/2623258506 learned_addr learned my addr 172.21.15.6:0/2623258506 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:37.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.397+0000 7f6101600640 1 -- 172.21.15.6:0/2623258506 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886722808 0 0) 0x7f61040cf600 con 0x7f6104158c90 2024-08-17T02:26:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.397+0000 7f6103400640 1 --2- 172.21.15.6:0/2623258506 >> v2:172.21.15.136:3300/0 conn(0x7f61040ccc10 0x7f6104163720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.397+0000 7f6101600640 1 -- 172.21.15.6:0/2623258506 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60e80034e0 con 0x7f6104158c90 2024-08-17T02:26:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6101600640 1 -- 172.21.15.6:0/2623258506 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169849979 0 0) 0x7f61040cea90 con 0x7f61040cadc0 2024-08-17T02:26:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6101600640 1 -- 172.21.15.6:0/2623258506 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61040cf600 con 0x7f61040cadc0 2024-08-17T02:26:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6101600640 1 -- 172.21.15.6:0/2623258506 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2061296983 0 0) 0x7f60e80034e0 con 0x7f6104158c90 2024-08-17T02:26:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6101600640 1 -- 172.21.15.6:0/2623258506 >> v2:172.21.15.136:3300/0 conn(0x7f61040ccc10 msgr2=0x7f6104163720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6101600640 1 --2- 172.21.15.6:0/2623258506 >> v2:172.21.15.136:3300/0 conn(0x7f61040ccc10 0x7f6104163720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6101600640 1 -- 172.21.15.6:0/2623258506 >> v1:172.21.15.136:6789/0 conn(0x7f61040cadc0 legacy=0x7f61040cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6101600640 1 -- 172.21.15.6:0/2623258506 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61040ced30 con 0x7f6104158c90 2024-08-17T02:26:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6101600640 1 -- 172.21.15.6:0/2623258506 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f60f4001470 con 0x7f6104158c90 2024-08-17T02:26:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6101600640 1 -- 172.21.15.6:0/2623258506 >> v1:172.21.15.6:6789/0 conn(0x7f6104158c90 legacy=0x7f61040ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6101600640 1 --2- 172.21.15.6:0/2623258506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e8003c20 0x7f60e8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6101600640 1 --2- 172.21.15.6:0/2623258506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e8004780 0x7f60e8004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6101600640 1 --2- 172.21.15.6:0/2623258506 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f60e80051f0 0x7f60e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6101600640 1 -- 172.21.15.6:0/2623258506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61040ce890 con 0x7f60e8003c20 2024-08-17T02:26:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6101600640 1 -- 172.21.15.6:0/2623258506 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e800c0d0 con 0x7f60e8004780 2024-08-17T02:26:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6101600640 1 -- 172.21.15.6:0/2623258506 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e800c290 con 0x7f60e80051f0 2024-08-17T02:26:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6102a00640 1 --2- 172.21.15.6:0/2623258506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e8003c20 0x7f60e8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6103400640 1 --2- 172.21.15.6:0/2623258506 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f60e80051f0 0x7f60e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.398+0000 7f6102000640 1 --2- 172.21.15.6:0/2623258506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e8004780 0x7f60e8004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.399+0000 7f6102a00640 1 -- 172.21.15.6:0/2623258506 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f60e80051f0 msgr2=0x7f60e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.399+0000 7f6102a00640 1 --2- 172.21.15.6:0/2623258506 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f60e80051f0 0x7f60e800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.399+0000 7f6102a00640 1 -- 172.21.15.6:0/2623258506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e8004780 msgr2=0x7f60e8004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.399+0000 7f6102a00640 1 --2- 172.21.15.6:0/2623258506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e8004780 0x7f60e8004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.399+0000 7f6102a00640 1 -- 172.21.15.6:0/2623258506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e80034e0 con 0x7f60e8003c20 2024-08-17T02:26:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.399+0000 7f6102000640 1 --2- 172.21.15.6:0/2623258506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e8004780 0x7f60e8004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.399+0000 7f6103400640 1 --2- 172.21.15.6:0/2623258506 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f60e80051f0 0x7f60e800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.399+0000 7f6103400640 1 -- 172.21.15.6:0/2623258506 reap_dead start 2024-08-17T02:26:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.400+0000 7f6102a00640 1 --2- 172.21.15.6:0/2623258506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e8003c20 0x7f60e8004010 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60f400c1e0 tx=0x7f610406ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf94460fc0b94254 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.400+0000 7f6101600640 1 -- 172.21.15.6:0/2623258506 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4005890 con 0x7f60e8003c20 2024-08-17T02:26:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.400+0000 7f6101600640 1 -- 172.21.15.6:0/2623258506 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f402d070 con 0x7f60e8003c20 2024-08-17T02:26:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.400+0000 7f6101600640 1 -- 172.21.15.6:0/2623258506 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4005a50 con 0x7f60e8003c20 2024-08-17T02:26:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.400+0000 7f6103e00640 1 -- 172.21.15.6:0/2623258506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e8003c20 msgr2=0x7f60e8004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.400+0000 7f6103e00640 1 --2- 172.21.15.6:0/2623258506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e8003c20 0x7f60e8004010 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60f400c1e0 tx=0x7f610406ef40 comp rx=0 tx=0).stop 2024-08-17T02:26:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.400+0000 7f6103e00640 1 -- 172.21.15.6:0/2623258506 shutdown_connections 2024-08-17T02:26:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.400+0000 7f6103e00640 1 --2- 172.21.15.6:0/2623258506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e8003c20 0x7f60e8004010 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.400+0000 7f6103e00640 1 -- 172.21.15.6:0/2623258506 >> 172.21.15.6:0/2623258506 conn(0x7f6104087a80 msgr2=0x7f610406e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.400+0000 7f6103e00640 1 -- 172.21.15.6:0/2623258506 shutdown_connections 2024-08-17T02:26:37.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.401+0000 7f6103e00640 1 -- 172.21.15.6:0/2623258506 wait complete. 2024-08-17T02:26:37.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.402+0000 7f6103e00640 1 Processor -- start 2024-08-17T02:26:37.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.402+0000 7f6103e00640 1 -- start start 2024-08-17T02:26:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.403+0000 7f6103e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e8003c20 0x7f6104141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.403+0000 7f6103e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f610416d450 0x7f6104159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.403+0000 7f6103e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f610406e590 0x7f610406ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.403+0000 7f6103e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61041416a0 con 0x7f610416d450 2024-08-17T02:26:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.403+0000 7f6103e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610406ef70 con 0x7f60e8003c20 2024-08-17T02:26:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.403+0000 7f6103e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610416a400 con 0x7f610406e590 2024-08-17T02:26:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.403+0000 7f6102000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f610416d450 0x7f6104159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.403+0000 7f6102000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f610416d450 0x7f6104159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56848/0 (socket says 172.21.15.6:56848) 2024-08-17T02:26:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.403+0000 7f6102000640 1 -- 172.21.15.6:0/725321729 learned_addr learned my addr 172.21.15.6:0/725321729 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.403+0000 7f6102a00640 1 --2- 172.21.15.6:0/725321729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e8003c20 0x7f6104141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.403+0000 7f6103400640 1 --2- 172.21.15.6:0/725321729 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f610406e590 0x7f610406ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.403+0000 7f6102000640 1 -- 172.21.15.6:0/725321729 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f610406e590 msgr2=0x7f610406ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.403+0000 7f6102000640 1 --2- 172.21.15.6:0/725321729 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f610406e590 0x7f610406ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.403+0000 7f6102000640 1 -- 172.21.15.6:0/725321729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e8003c20 msgr2=0x7f6104141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.403+0000 7f6102000640 1 --2- 172.21.15.6:0/725321729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e8003c20 0x7f6104141160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.403+0000 7f6102000640 1 -- 172.21.15.6:0/725321729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610416a080 con 0x7f610416d450 2024-08-17T02:26:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.403+0000 7f6102a00640 1 --2- 172.21.15.6:0/725321729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e8003c20 0x7f6104141160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.404+0000 7f6102000640 1 --2- 172.21.15.6:0/725321729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f610416d450 0x7f6104159060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f60f000e870 tx=0x7f60f0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.404+0000 7f60fa000640 1 -- 172.21.15.6:0/725321729 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f000ee60 con 0x7f610416d450 2024-08-17T02:26:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.404+0000 7f60fa000640 1 -- 172.21.15.6:0/725321729 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f0007020 con 0x7f610416d450 2024-08-17T02:26:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.404+0000 7f60fa000640 1 -- 172.21.15.6:0/725321729 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f00073e0 con 0x7f610416d450 2024-08-17T02:26:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.404+0000 7f6103e00640 1 -- 172.21.15.6:0/725321729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6104169470 con 0x7f610416d450 2024-08-17T02:26:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.404+0000 7f6103e00640 1 -- 172.21.15.6:0/725321729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6104169a30 con 0x7f610416d450 2024-08-17T02:26:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.405+0000 7f6103e00640 1 -- 172.21.15.6:0/725321729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610416a210 con 0x7f610416d450 2024-08-17T02:26:37.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.406+0000 7f60fa000640 1 -- 172.21.15.6:0/725321729 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f60f000c7f0 con 0x7f610416d450 2024-08-17T02:26:37.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.407+0000 7f60fa000640 1 --2- 172.21.15.6:0/725321729 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f60e4065150 0x7f60e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.407+0000 7f60fa000640 1 -- 172.21.15.6:0/725321729 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f60f0082690 con 0x7f610416d450 2024-08-17T02:26:37.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.407+0000 7f6102a00640 1 --2- 172.21.15.6:0/725321729 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f60e4065150 0x7f60e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.408+0000 7f6102a00640 1 --2- 172.21.15.6:0/725321729 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f60e4065150 0x7f60e4067600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f60f4032000 tx=0x7f60f4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.411+0000 7f60fa000640 1 -- 172.21.15.6:0/725321729 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f60f00506b0 con 0x7f610416d450 2024-08-17T02:26:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.600+0000 7f6103e00640 1 -- 172.21.15.6:0/725321729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6104070720 con 0x7f610416d450 2024-08-17T02:26:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.601+0000 7f60fa000640 1 -- 172.21.15.6:0/725321729 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f60f0053cd0 con 0x7f610416d450 2024-08-17T02:26:37.601 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:37.601 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:33.190571+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:29.257601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:30.596556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:37.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.603+0000 7f6103e00640 1 -- 172.21.15.6:0/725321729 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f60e4065150 msgr2=0x7f60e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.603+0000 7f6103e00640 1 --2- 172.21.15.6:0/725321729 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f60e4065150 0x7f60e4067600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f60f4032000 tx=0x7f60f4030000 comp rx=0 tx=0).stop 2024-08-17T02:26:37.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.603+0000 7f6103e00640 1 -- 172.21.15.6:0/725321729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f610416d450 msgr2=0x7f6104159060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.603+0000 7f6103e00640 1 --2- 172.21.15.6:0/725321729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f610416d450 0x7f6104159060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f60f000e870 tx=0x7f60f0009040 comp rx=0 tx=0).stop 2024-08-17T02:26:37.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.603+0000 7f6103e00640 1 -- 172.21.15.6:0/725321729 shutdown_connections 2024-08-17T02:26:37.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.603+0000 7f6103e00640 1 --2- 172.21.15.6:0/725321729 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f60e4065150 0x7f60e4067600 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.603+0000 7f6103e00640 1 --2- 172.21.15.6:0/725321729 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f610406e590 0x7f610406ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.603+0000 7f6103e00640 1 --2- 172.21.15.6:0/725321729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f610416d450 0x7f6104159060 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.603+0000 7f6103e00640 1 --2- 172.21.15.6:0/725321729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e8003c20 0x7f6104141160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.603+0000 7f6103e00640 1 -- 172.21.15.6:0/725321729 >> 172.21.15.6:0/725321729 conn(0x7f6104087a80 msgr2=0x7f61041556c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.603+0000 7f6103e00640 1 -- 172.21.15.6:0/725321729 shutdown_connections 2024-08-17T02:26:37.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.603+0000 7f6103e00640 1 -- 172.21.15.6:0/725321729 wait complete. 2024-08-17T02:26:37.618 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:26:37.619 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:37.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.771+0000 7fc7ea600640 1 Processor -- start 2024-08-17T02:26:37.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.771+0000 7fc7ea600640 1 -- start start 2024-08-17T02:26:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.772+0000 7fc7ea600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc7e41590b0 0x7fc7e40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.772+0000 7fc7ea600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7e40acf10 0x7fc7e4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.772+0000 7fc7ea600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e415a4e0 con 0x7fc7e40afca0 2024-08-17T02:26:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.772+0000 7fc7ea600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e40b0980 con 0x7fc7e40acf10 2024-08-17T02:26:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.772+0000 7fc7ea600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e40c92b0 con 0x7fc7e41590b0 2024-08-17T02:26:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.773+0000 7fc7e3e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7e40acf10 0x7fc7e4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.773+0000 7fc7e3e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7e40acf10 0x7fc7e4159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56862/0 (socket says 172.21.15.6:56862) 2024-08-17T02:26:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.773+0000 7fc7e3e00640 1 -- 172.21.15.6:0/367902173 learned_addr learned my addr 172.21.15.6:0/367902173 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.773+0000 7fc7e2a00640 1 --2- 172.21.15.6:0/367902173 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc7e41590b0 0x7fc7e40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.773+0000 7fc7e3e00640 1 -- 172.21.15.6:0/367902173 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc7e41590b0 msgr2=0x7fc7e40b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.773+0000 7fc7e3e00640 1 --2- 172.21.15.6:0/367902173 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc7e41590b0 0x7fc7e40b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.773+0000 7fc7e3e00640 1 -- 172.21.15.6:0/367902173 >> v1:172.21.15.136:6789/0 conn(0x7fc7e40afca0 legacy=0x7fc7e41589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.773+0000 7fc7e3e00640 1 -- 172.21.15.6:0/367902173 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e40ad480 con 0x7fc7e40acf10 2024-08-17T02:26:37.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.774+0000 7fc7e3e00640 1 --2- 172.21.15.6:0/367902173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e40acf10 0x7fc7e4159fa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00d1a0 tx=0x7fc7dc00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28ea2453a478f00 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.774+0000 7fc7e2000640 1 -- 172.21.15.6:0/367902173 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00b2e0 con 0x7fc7e40acf10 2024-08-17T02:26:37.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.774+0000 7fc7e2000640 1 -- 172.21.15.6:0/367902173 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc00b440 con 0x7fc7e40acf10 2024-08-17T02:26:37.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.774+0000 7fc7e2000640 1 -- 172.21.15.6:0/367902173 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc009840 con 0x7fc7e40acf10 2024-08-17T02:26:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.775+0000 7fc7ea600640 1 -- 172.21.15.6:0/367902173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e40acf10 msgr2=0x7fc7e4159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.775+0000 7fc7ea600640 1 --2- 172.21.15.6:0/367902173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e40acf10 0x7fc7e4159fa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00d1a0 tx=0x7fc7dc00ba50 comp rx=0 tx=0).stop 2024-08-17T02:26:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.775+0000 7fc7ea600640 1 -- 172.21.15.6:0/367902173 shutdown_connections 2024-08-17T02:26:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.775+0000 7fc7ea600640 1 --2- 172.21.15.6:0/367902173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e40acf10 0x7fc7e4159fa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.775+0000 7fc7ea600640 1 --2- 172.21.15.6:0/367902173 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc7e41590b0 0x7fc7e40b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.775+0000 7fc7ea600640 1 -- 172.21.15.6:0/367902173 >> 172.21.15.6:0/367902173 conn(0x7fc7e4066e60 msgr2=0x7fc7e4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.775+0000 7fc7ea600640 1 -- 172.21.15.6:0/367902173 shutdown_connections 2024-08-17T02:26:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.775+0000 7fc7ea600640 1 -- 172.21.15.6:0/367902173 wait complete. 2024-08-17T02:26:37.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.776+0000 7fc7ea600640 1 Processor -- start 2024-08-17T02:26:37.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.776+0000 7fc7ea600640 1 -- start start 2024-08-17T02:26:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.777+0000 7fc7ea600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e40acf10 0x7fc7e413cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.777+0000 7fc7ea600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7e40afca0 0x7fc7e414bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.777+0000 7fc7ea600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc7e41590b0 0x7fc7e414c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.777+0000 7fc7ea600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e413d1d0 con 0x7fc7e40acf10 2024-08-17T02:26:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.777+0000 7fc7ea600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e4152f70 con 0x7fc7e40afca0 2024-08-17T02:26:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.777+0000 7fc7ea600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e414eda0 con 0x7fc7e41590b0 2024-08-17T02:26:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.778+0000 7fc7e3400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e40acf10 0x7fc7e413cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.778+0000 7fc7e3400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e40acf10 0x7fc7e413cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56872/0 (socket says 172.21.15.6:56872) 2024-08-17T02:26:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.778+0000 7fc7e3400640 1 -- 172.21.15.6:0/1405011180 learned_addr learned my addr 172.21.15.6:0/1405011180 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.778+0000 7fc7e2a00640 1 --2- 172.21.15.6:0/1405011180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7e40afca0 0x7fc7e414bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.778+0000 7fc7e3e00640 1 --2- 172.21.15.6:0/1405011180 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc7e41590b0 0x7fc7e414c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.778+0000 7fc7e3400640 1 -- 172.21.15.6:0/1405011180 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc7e41590b0 msgr2=0x7fc7e414c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.778+0000 7fc7e3400640 1 --2- 172.21.15.6:0/1405011180 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc7e41590b0 0x7fc7e414c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.778+0000 7fc7e3400640 1 -- 172.21.15.6:0/1405011180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7e40afca0 msgr2=0x7fc7e414bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.778+0000 7fc7e3400640 1 --2- 172.21.15.6:0/1405011180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7e40afca0 0x7fc7e414bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.778+0000 7fc7e3400640 1 -- 172.21.15.6:0/1405011180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc00bcf0 con 0x7fc7e40acf10 2024-08-17T02:26:37.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.778+0000 7fc7e3400640 1 --2- 172.21.15.6:0/1405011180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e40acf10 0x7fc7e413cc90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400c560 tx=0x7fc7d4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.778+0000 7fc7daa00640 1 -- 172.21.15.6:0/1405011180 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4011590 con 0x7fc7e40acf10 2024-08-17T02:26:37.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.779+0000 7fc7daa00640 1 -- 172.21.15.6:0/1405011180 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d4011710 con 0x7fc7e40acf10 2024-08-17T02:26:37.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.779+0000 7fc7daa00640 1 -- 172.21.15.6:0/1405011180 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4011ad0 con 0x7fc7e40acf10 2024-08-17T02:26:37.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.779+0000 7fc7ea600640 1 -- 172.21.15.6:0/1405011180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e414f080 con 0x7fc7e40acf10 2024-08-17T02:26:37.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.779+0000 7fc7ea600640 1 -- 172.21.15.6:0/1405011180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e4169ec0 con 0x7fc7e40acf10 2024-08-17T02:26:37.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.780+0000 7fc7ea600640 1 -- 172.21.15.6:0/1405011180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e4152a60 con 0x7fc7e40acf10 2024-08-17T02:26:37.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.780+0000 7fc7daa00640 1 -- 172.21.15.6:0/1405011180 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc7d401b3b0 con 0x7fc7e40acf10 2024-08-17T02:26:37.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.781+0000 7fc7daa00640 1 --2- 172.21.15.6:0/1405011180 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc7c4065150 0x7fc7c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.781+0000 7fc7daa00640 1 -- 172.21.15.6:0/1405011180 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc7d40817e0 con 0x7fc7e40acf10 2024-08-17T02:26:37.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.782+0000 7fc7e2a00640 1 --2- 172.21.15.6:0/1405011180 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc7c4065150 0x7fc7c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.782+0000 7fc7e2a00640 1 --2- 172.21.15.6:0/1405011180 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc7c4065150 0x7fc7c4067600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4157fe0 tx=0x7fc7d00090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.785+0000 7fc7daa00640 1 -- 172.21.15.6:0/1405011180 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc7e4152a60 con 0x7fc7e40acf10 2024-08-17T02:26:37.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.969+0000 7fc7ea600640 1 -- 172.21.15.6:0/1405011180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7e415a4e0 con 0x7fc7e40acf10 2024-08-17T02:26:37.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.970+0000 7fc7daa00640 1 -- 172.21.15.6:0/1405011180 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fc7e415a4e0 con 0x7fc7e40acf10 2024-08-17T02:26:37.971 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:37.971 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:33.190571+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:29.257601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:30.596556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.973+0000 7fc7ea600640 1 -- 172.21.15.6:0/1405011180 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc7c4065150 msgr2=0x7fc7c4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.973+0000 7fc7ea600640 1 --2- 172.21.15.6:0/1405011180 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc7c4065150 0x7fc7c4067600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4157fe0 tx=0x7fc7d00090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.973+0000 7fc7ea600640 1 -- 172.21.15.6:0/1405011180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e40acf10 msgr2=0x7fc7e413cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.973+0000 7fc7ea600640 1 --2- 172.21.15.6:0/1405011180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e40acf10 0x7fc7e413cc90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400c560 tx=0x7fc7d4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.973+0000 7fc7ea600640 1 -- 172.21.15.6:0/1405011180 shutdown_connections 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.973+0000 7fc7ea600640 1 --2- 172.21.15.6:0/1405011180 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc7c4065150 0x7fc7c4067600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.973+0000 7fc7ea600640 1 --2- 172.21.15.6:0/1405011180 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc7e41590b0 0x7fc7e414c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.973+0000 7fc7ea600640 1 --2- 172.21.15.6:0/1405011180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7e40afca0 0x7fc7e414bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.973+0000 7fc7ea600640 1 --2- 172.21.15.6:0/1405011180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e40acf10 0x7fc7e413cc90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.973+0000 7fc7ea600640 1 -- 172.21.15.6:0/1405011180 >> 172.21.15.6:0/1405011180 conn(0x7fc7e4066e60 msgr2=0x7fc7e40ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.973+0000 7fc7ea600640 1 -- 172.21.15.6:0/1405011180 shutdown_connections 2024-08-17T02:26:37.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:37.973+0000 7fc7ea600640 1 -- 172.21.15.6:0/1405011180 wait complete. 2024-08-17T02:26:37.989 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:26:37.989 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:26:37.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:26:37.991 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:26:37.991 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:26:37.992 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:26:37.992 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:26:37.993 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:26:38.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.264+0000 7ff817e00640 1 Processor -- start 2024-08-17T02:26:38.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.264+0000 7f065fe00640 1 Processor -- start 2024-08-17T02:26:38.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.265+0000 7f065fe00640 1 -- start start 2024-08-17T02:26:38.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.265+0000 7ff817e00640 1 -- start start 2024-08-17T02:26:38.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.267+0000 7ff817e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff81806dcf0 0x7ff8180b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.267+0000 7f065fe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0660160430 0x7f06600afb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.267+0000 7f065fe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0660160800 0x7f06600683e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.267+0000 7f065fe00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06600b29c0 con 0x7f0660068920 2024-08-17T02:26:38.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.267+0000 7f065fe00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0660068d60 con 0x7f0660160800 2024-08-17T02:26:38.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.267+0000 7f065fe00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06600b04d0 con 0x7f0660160430 2024-08-17T02:26:38.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.268+0000 7f065ea00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0660160430 0x7f06600afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.268+0000 7f065ea00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0660160430 0x7f06600afb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:43926/0 (socket says 172.21.15.6:43926) 2024-08-17T02:26:38.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.268+0000 7f065ea00640 1 -- 172.21.15.6:0/2233113220 learned_addr learned my addr 172.21.15.6:0/2233113220 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.268+0000 7f065e000640 1 --2- 172.21.15.6:0/2233113220 >> v2:172.21.15.6:3300/0 conn(0x7f0660160800 0x7f06600683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.267+0000 7ff817e00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8180aee60 con 0x7ff81815cdd0 2024-08-17T02:26:38.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.267+0000 7ff817e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8180afcb0 con 0x7ff8180b0140 2024-08-17T02:26:38.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.267+0000 7ff817e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8180b0ae0 con 0x7ff81806dcf0 2024-08-17T02:26:38.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.268+0000 7ff816000640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7ff8180b0140 0x7ff81806d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:56564/0 (socket says 172.21.15.6:56564) 2024-08-17T02:26:38.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.268+0000 7ff816000640 1 -- 172.21.15.6:0/325894376 learned_addr learned my addr 172.21.15.6:0/325894376 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:38.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.269+0000 7f065d600640 1 -- 172.21.15.6:0/2233113220 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198963412 0 0) 0x7f06600b29c0 con 0x7f0660068920 2024-08-17T02:26:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.269+0000 7f065d600640 1 -- 172.21.15.6:0/2233113220 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06440034e0 con 0x7f0660068920 2024-08-17T02:26:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.269+0000 7f065ea00640 1 -- 172.21.15.6:0/2233113220 >> v2:172.21.15.6:3300/0 conn(0x7f0660160800 msgr2=0x7f06600683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.269+0000 7f065ea00640 1 --2- 172.21.15.6:0/2233113220 >> v2:172.21.15.6:3300/0 conn(0x7f0660160800 0x7f06600683e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.269+0000 7f065ea00640 1 -- 172.21.15.6:0/2233113220 >> v1:172.21.15.136:6789/0 conn(0x7f0660068920 legacy=0x7f06600ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.269+0000 7f065ea00640 1 -- 172.21.15.6:0/2233113220 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06600b07b0 con 0x7f0660160430 2024-08-17T02:26:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.269+0000 7ff817400640 1 --2- 172.21.15.6:0/325894376 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff81806dcf0 0x7ff8180b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.269+0000 7ff815600640 1 -- 172.21.15.6:0/325894376 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390222962 0 0) 0x7ff8180afcb0 con 0x7ff8180b0140 2024-08-17T02:26:38.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.269+0000 7ff815600640 1 -- 172.21.15.6:0/325894376 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7fc0034e0 con 0x7ff8180b0140 2024-08-17T02:26:38.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.270+0000 7ff815600640 1 -- 172.21.15.6:0/325894376 <== mon.1 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2445782148 0 0) 0x7ff7fc0034e0 con 0x7ff8180b0140 2024-08-17T02:26:38.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.270+0000 7ff815600640 1 -- 172.21.15.6:0/325894376 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff81806dcf0 msgr2=0x7ff8180b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.270+0000 7ff815600640 1 --2- 172.21.15.6:0/325894376 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff81806dcf0 0x7ff8180b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.270+0000 7ff815600640 1 -- 172.21.15.6:0/325894376 >> v1:172.21.15.6:6789/0 conn(0x7ff81815cdd0 legacy=0x7ff8180ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.270+0000 7fe9d6800640 1 Processor -- start 2024-08-17T02:26:38.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.270+0000 7fe9d6800640 1 -- start start 2024-08-17T02:26:38.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.270+0000 7f065ea00640 1 --2- 172.21.15.6:0/2233113220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0660160430 0x7f06600afb50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f06600d0bf0 tx=0x7f064c0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aadb9401c04f1c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.270+0000 7ff815600640 1 -- 172.21.15.6:0/325894376 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8180af0a0 con 0x7ff8180b0140 2024-08-17T02:26:38.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.270+0000 7ff815600640 1 -- 172.21.15.6:0/325894376 <== mon.1 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7ff804001470 con 0x7ff8180b0140 2024-08-17T02:26:38.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.271+0000 7ff815600640 1 -- 172.21.15.6:0/325894376 >> v1:172.21.15.136:6789/0 conn(0x7ff8180b0140 legacy=0x7ff81806d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.271+0000 7ff815600640 1 --2- 172.21.15.6:0/325894376 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff81806dcf0 0x7ff7fc003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.271+0000 7ff815600640 1 --2- 172.21.15.6:0/325894376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7fc003f90 0x7ff7fc004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.271+0000 7ff815600640 1 --2- 172.21.15.6:0/325894376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7fc004cc0 0x7ff7fc005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.271+0000 7ff815600640 1 -- 172.21.15.6:0/325894376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8180b0ae0 con 0x7ff7fc004cc0 2024-08-17T02:26:38.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.271+0000 7ff815600640 1 -- 172.21.15.6:0/325894376 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc00bb60 con 0x7ff7fc003f90 2024-08-17T02:26:38.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.271+0000 7ff815600640 1 -- 172.21.15.6:0/325894376 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc00bd20 con 0x7ff81806dcf0 2024-08-17T02:26:38.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.271+0000 7ff816000640 1 --2- 172.21.15.6:0/325894376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7fc003f90 0x7ff7fc004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.271+0000 7f065d600640 1 -- 172.21.15.6:0/2233113220 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c02f510 con 0x7f0660160430 2024-08-17T02:26:38.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.271+0000 7f065d600640 1 -- 172.21.15.6:0/2233113220 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c02d050 con 0x7f0660160430 2024-08-17T02:26:38.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.271+0000 7f065d600640 1 -- 172.21.15.6:0/2233113220 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c02f510 con 0x7f0660160430 2024-08-17T02:26:38.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.272+0000 7ff816a00640 1 --2- 172.21.15.6:0/325894376 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff81806dcf0 0x7ff7fc003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.272+0000 7ff816000640 1 -- 172.21.15.6:0/325894376 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff81806dcf0 msgr2=0x7ff7fc003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.272+0000 7ff816000640 1 --2- 172.21.15.6:0/325894376 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff81806dcf0 0x7ff7fc003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.272+0000 7ff816000640 1 -- 172.21.15.6:0/325894376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7fc004cc0 msgr2=0x7ff7fc005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.272+0000 7ff816000640 1 --2- 172.21.15.6:0/325894376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7fc004cc0 0x7ff7fc005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.272+0000 7ff816a00640 1 --2- 172.21.15.6:0/325894376 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff81806dcf0 0x7ff7fc003a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:38.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.272+0000 7ff816000640 1 -- 172.21.15.6:0/325894376 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8180af0a0 con 0x7ff7fc003f90 2024-08-17T02:26:38.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.272+0000 7fe9d6800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe9d00cfc10 0x7fe9d00d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.272+0000 7fe9d6800640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d00d05b0 con 0x7fe9d014fe00 2024-08-17T02:26:38.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.272+0000 7fe9d6800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d00cdef0 con 0x7fe9d00ce380 2024-08-17T02:26:38.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.272+0000 7fe9d6800640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d00af8e0 con 0x7fe9d00cfc10 2024-08-17T02:26:38.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.272+0000 7f065fe00640 1 -- 172.21.15.6:0/2233113220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0660160430 msgr2=0x7f06600afb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.272+0000 7f065fe00640 1 --2- 172.21.15.6:0/2233113220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0660160430 0x7f06600afb50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f06600d0bf0 tx=0x7f064c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.273+0000 7f065fe00640 1 -- 172.21.15.6:0/2233113220 shutdown_connections 2024-08-17T02:26:38.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.273+0000 7f065fe00640 1 --2- 172.21.15.6:0/2233113220 >> v2:172.21.15.6:3300/0 conn(0x7f0660160800 0x7f06600683e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.273+0000 7f065fe00640 1 --2- 172.21.15.6:0/2233113220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0660160430 0x7f06600afb50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.273+0000 7f065fe00640 1 -- 172.21.15.6:0/2233113220 >> 172.21.15.6:0/2233113220 conn(0x7f06600cfb80 msgr2=0x7f06600cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.273+0000 7f065fe00640 1 -- 172.21.15.6:0/2233113220 shutdown_connections 2024-08-17T02:26:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.273+0000 7f2ff6e00640 1 Processor -- start 2024-08-17T02:26:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.274+0000 7fe9c6a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe9d00cfc10 0x7fe9d00d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.274+0000 7fe9c6a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe9d00cfc10 0x7fe9d00d0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:43952/0 (socket says 172.21.15.6:43952) 2024-08-17T02:26:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.274+0000 7fe9c6a00640 1 -- 172.21.15.6:0/115762085 learned_addr learned my addr 172.21.15.6:0/115762085 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.274+0000 7f2ff6e00640 1 -- start start 2024-08-17T02:26:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.273+0000 7f065fe00640 1 -- 172.21.15.6:0/2233113220 wait complete. 2024-08-17T02:26:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.274+0000 7fe9c6a00640 1 -- 172.21.15.6:0/115762085 >> v1:172.21.15.136:6789/0 conn(0x7fe9d00ce380 legacy=0x7fe9d00ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.274+0000 7fe9c6a00640 1 -- 172.21.15.6:0/115762085 >> v1:172.21.15.6:6789/0 conn(0x7fe9d014fe00 legacy=0x7fe9d00cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.274+0000 7fe9c6a00640 1 -- 172.21.15.6:0/115762085 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d00ccf10 con 0x7fe9d00cfc10 2024-08-17T02:26:38.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.274+0000 7ff816000640 1 --2- 172.21.15.6:0/325894376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7fc003f90 0x7ff7fc004780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff80400c2f0 tx=0x7ff804001e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b929753cbcfce5c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.275+0000 7ff815600640 1 -- 172.21.15.6:0/325894376 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804005890 con 0x7ff7fc003f90 2024-08-17T02:26:38.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.275+0000 7ff815600640 1 -- 172.21.15.6:0/325894376 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8040059f0 con 0x7ff7fc003f90 2024-08-17T02:26:38.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.275+0000 7f065fe00640 1 Processor -- start 2024-08-17T02:26:38.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.276+0000 7f065fe00640 1 -- start start 2024-08-17T02:26:38.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.276+0000 7ff815600640 1 -- 172.21.15.6:0/325894376 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804005890 con 0x7ff7fc003f90 2024-08-17T02:26:38.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.276+0000 7f2ff6e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2ff015cdc0 0x7f2ff00ae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.276+0000 7f2ff6e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2ff00aeda0 0x7f2ff00b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.276+0000 7f2ff6e00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff00aff30 con 0x7f2ff00b0900 2024-08-17T02:26:38.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.276+0000 7f2ff6e00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff00af320 con 0x7f2ff00aeda0 2024-08-17T02:26:38.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.276+0000 7f2ff6e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff00af600 con 0x7f2ff015cdc0 2024-08-17T02:26:38.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.276+0000 7ff817e00640 1 -- 172.21.15.6:0/325894376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7fc003f90 msgr2=0x7ff7fc004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.276+0000 7ff817e00640 1 --2- 172.21.15.6:0/325894376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7fc003f90 0x7ff7fc004780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff80400c2f0 tx=0x7ff804001e20 comp rx=0 tx=0).stop 2024-08-17T02:26:38.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.276+0000 7ff817400640 1 -- 172.21.15.6:0/325894376 reap_dead start 2024-08-17T02:26:38.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.276+0000 7fe9c6a00640 1 --2- 172.21.15.6:0/115762085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9d00cfc10 0x7fe9d00d0070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009910 tx=0x7fe9b80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=883d5126c24593c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.277+0000 7fe9cea00640 1 -- 172.21.15.6:0/115762085 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b802ad70 con 0x7fe9d00cfc10 2024-08-17T02:26:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.277+0000 7f065fe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0660068920 0x7f066016e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.277+0000 7f065fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0660160430 0x7f06600b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.277+0000 7f065fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0660160800 0x7f06600c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.277+0000 7f2fefe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2ff015cdc0 0x7f2ff00ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.277+0000 7fe9cea00640 1 -- 172.21.15.6:0/115762085 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b8032440 con 0x7fe9d00cfc10 2024-08-17T02:26:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.277+0000 7fe9cea00640 1 -- 172.21.15.6:0/115762085 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b80327e0 con 0x7fe9d00cfc10 2024-08-17T02:26:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.277+0000 7f2ff4e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2ff00b0900 0x7f2ff006d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38282/0 (socket says 172.21.15.6:38282) 2024-08-17T02:26:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.277+0000 7f2ff4e00640 1 -- 172.21.15.6:0/32481062 learned_addr learned my addr 172.21.15.6:0/32481062 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.278+0000 7f2fef400640 1 --2- 172.21.15.6:0/32481062 >> v2:172.21.15.6:3300/0 conn(0x7f2ff00aeda0 0x7f2ff00b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.277+0000 7ff817e00640 1 -- 172.21.15.6:0/325894376 shutdown_connections 2024-08-17T02:26:38.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.278+0000 7ff817e00640 1 -- 172.21.15.6:0/325894376 >> 172.21.15.6:0/325894376 conn(0x7ff818066e60 msgr2=0x7ff818067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.278+0000 7fe9d6800640 1 -- 172.21.15.6:0/115762085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9d00cfc10 msgr2=0x7fe9d00d0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.278+0000 7fe9d6800640 1 --2- 172.21.15.6:0/115762085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9d00cfc10 0x7fe9d00d0070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009910 tx=0x7fe9b80091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.278+0000 7fd6d2e00640 1 Processor -- start 2024-08-17T02:26:38.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.278+0000 7fd6d2e00640 1 -- start start 2024-08-17T02:26:38.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.278+0000 7ff817e00640 1 -- 172.21.15.6:0/325894376 shutdown_connections 2024-08-17T02:26:38.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.278+0000 7f065f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0660160800 0x7f06600c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.278+0000 7f065e000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0660160430 0x7f06600b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.279+0000 7f2fef400640 1 -- 172.21.15.6:0/32481062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2ff015cdc0 msgr2=0x7f2ff00ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.279+0000 7f065ea00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0660068920 0x7f066016e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.279+0000 7f065e000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0660160430 0x7f06600b5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:43956/0 (socket says 172.21.15.6:43956) 2024-08-17T02:26:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.279+0000 7f065ea00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0660068920 0x7f066016e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49288/0 (socket says 172.21.15.6:49288) 2024-08-17T02:26:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.279+0000 7f065f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0660160800 0x7f06600c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56896/0 (socket says 172.21.15.6:56896) 2024-08-17T02:26:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.280+0000 7f065e000640 1 -- 172.21.15.6:0/1207865470 learned_addr learned my addr 172.21.15.6:0/1207865470 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.280+0000 7f065fe00640 1 -- 172.21.15.6:0/1207865470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06600b5ac0 con 0x7f0660160800 2024-08-17T02:26:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.280+0000 7f065fe00640 1 -- 172.21.15.6:0/1207865470 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06600c8e00 con 0x7f0660160430 2024-08-17T02:26:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.280+0000 7f065fe00640 1 -- 172.21.15.6:0/1207865470 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06600c9080 con 0x7f0660068920 2024-08-17T02:26:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.279+0000 7fe9d6800640 1 -- 172.21.15.6:0/115762085 shutdown_connections 2024-08-17T02:26:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.279+0000 7fe9d6800640 1 --2- 172.21.15.6:0/115762085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9d00cfc10 0x7fe9d00d0070 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.279+0000 7fe9d6800640 1 -- 172.21.15.6:0/115762085 >> 172.21.15.6:0/115762085 conn(0x7fe9d0068680 msgr2=0x7fe9d0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.279+0000 7f2fef400640 1 --2- 172.21.15.6:0/32481062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2ff015cdc0 0x7f2ff00ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.279+0000 7f2fef400640 1 -- 172.21.15.6:0/32481062 >> v1:172.21.15.6:6789/0 conn(0x7f2ff00b0900 legacy=0x7f2ff006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.279+0000 7f2fef400640 1 -- 172.21.15.6:0/32481062 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff00af8e0 con 0x7f2ff00aeda0 2024-08-17T02:26:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.279+0000 7ff817e00640 1 -- 172.21.15.6:0/325894376 wait complete. 2024-08-17T02:26:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.279+0000 7fe9d6800640 1 -- 172.21.15.6:0/115762085 shutdown_connections 2024-08-17T02:26:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.279+0000 7fe9d6800640 1 -- 172.21.15.6:0/115762085 wait complete. 2024-08-17T02:26:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7f065f400640 1 -- 172.21.15.6:0/1207865470 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0660068920 msgr2=0x7f066016e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7ff817e00640 1 Processor -- start 2024-08-17T02:26:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7f2fef400640 1 --2- 172.21.15.6:0/32481062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ff00aeda0 0x7f2ff00b03c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009850 tx=0x7f2fdc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51b66fd5fa34b55 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7f1776200640 1 Processor -- start 2024-08-17T02:26:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7f1776200640 1 -- start start 2024-08-17T02:26:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7fe9d6800640 1 Processor -- start 2024-08-17T02:26:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7f065f400640 1 --2- 172.21.15.6:0/1207865470 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0660068920 0x7f066016e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7f065f400640 1 -- 172.21.15.6:0/1207865470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0660160430 msgr2=0x7f06600b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7f065f400640 1 --2- 172.21.15.6:0/1207865470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0660160430 0x7f06600b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7f065f400640 1 -- 172.21.15.6:0/1207865470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c009450 con 0x7f0660160800 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7f065e000640 1 --2- 172.21.15.6:0/1207865470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0660160430 0x7f06600b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7fe9d6800640 1 -- start start 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.282+0000 7f2feea00640 1 -- 172.21.15.6:0/32481062 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc02ad00 con 0x7f2ff00aeda0 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.282+0000 7f2feea00640 1 -- 172.21.15.6:0/32481062 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc02ae60 con 0x7f2ff00aeda0 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.282+0000 7f2feea00640 1 -- 172.21.15.6:0/32481062 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc032670 con 0x7f2ff00aeda0 2024-08-17T02:26:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.282+0000 7f065f400640 1 --2- 172.21.15.6:0/1207865470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0660160800 0x7f06600c88c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f065800c740 tx=0x7f06580025c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7ff817e00640 1 -- start start 2024-08-17T02:26:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7ff817e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7fc003f90 0x7ff8181553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.280+0000 7fd6d2e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6cc0cd760 0x7fd6cc0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.280+0000 7fd6d2e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd6cc15d2c0 0x7fd6cc0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.280+0000 7fd6d2e00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6cc0cc810 con 0x7fd6cc0ccca0 2024-08-17T02:26:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7f0656000640 1 -- 172.21.15.6:0/1207865470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658002030 con 0x7f0660160800 2024-08-17T02:26:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.280+0000 7fd6d2e00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6cc0cbc00 con 0x7fd6cc0cd760 2024-08-17T02:26:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.280+0000 7fd6d2e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6cc0cbee0 con 0x7fd6cc15d2c0 2024-08-17T02:26:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7fd6d1000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd6cc15d2c0 0x7fd6cc0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7fd6d1000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd6cc15d2c0 0x7fd6cc0cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:43972/0 (socket says 172.21.15.6:43972) 2024-08-17T02:26:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7fd6d1000640 1 -- 172.21.15.6:0/680323723 learned_addr learned my addr 172.21.15.6:0/680323723 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7fd6d1000640 1 -- 172.21.15.6:0/680323723 >> v2:172.21.15.6:3300/0 conn(0x7fd6cc0cd760 msgr2=0x7fd6cc0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7fe9d6800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9d00ce380 0x7fe9d014a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7fe9d6800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe9d00cfc10 0x7fe9d00c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7fe9d6800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9d014fe00 0x7fe9d00c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7fe9d6800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d00c93e0 con 0x7fe9d00ce380 2024-08-17T02:26:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7fe9d6800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d00c84f0 con 0x7fe9d014fe00 2024-08-17T02:26:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7fd6d1000640 1 --2- 172.21.15.6:0/680323723 >> v2:172.21.15.6:3300/0 conn(0x7fd6cc0cd760 0x7fd6cc0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7fd6d1000640 1 -- 172.21.15.6:0/680323723 >> v1:172.21.15.6:6789/0 conn(0x7fd6cc0ccca0 legacy=0x7fd6cc0b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.281+0000 7fd6d1000640 1 -- 172.21.15.6:0/680323723 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc0cc1c0 con 0x7fd6cc15d2c0 2024-08-17T02:26:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7fe9d6800640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d00c87d0 con 0x7fe9d00cfc10 2024-08-17T02:26:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7fe9cf400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9d00ce380 0x7fe9d014a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7ff817e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff818155910 0x7ff818151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7fe9cf400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9d00ce380 0x7fe9d014a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56918/0 (socket says 172.21.15.6:56918) 2024-08-17T02:26:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7fe9cf400640 1 -- 172.21.15.6:0/3771769874 learned_addr learned my addr 172.21.15.6:0/3771769874 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7f2ff6e00640 1 -- 172.21.15.6:0/32481062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ff00aeda0 msgr2=0x7f2ff00b03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7f1776200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1768033c20 0x7f17680d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7f1776200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1768054130 con 0x7f176800c040 2024-08-17T02:26:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7f1776200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17680344d0 con 0x7f1768033850 2024-08-17T02:26:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7f2ff6e00640 1 --2- 172.21.15.6:0/32481062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ff00aeda0 0x7f2ff00b03c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009850 tx=0x7f2fdc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7f1776200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1768034080 con 0x7f1768033c20 2024-08-17T02:26:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7f0656000640 1 -- 172.21.15.6:0/1207865470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06580021b0 con 0x7f0660160800 2024-08-17T02:26:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7f0656000640 1 -- 172.21.15.6:0/1207865470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658012630 con 0x7f0660160800 2024-08-17T02:26:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.283+0000 7ff817e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff818152340 0x7ff81813f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7ff816a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7fc003f90 0x7ff8181553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7ff817e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff818140260 con 0x7ff7fc003f90 2024-08-17T02:26:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7ff817e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff818153ec0 con 0x7ff818155910 2024-08-17T02:26:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7ff816a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7fc003f90 0x7ff8181553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56932/0 (socket says 172.21.15.6:56932) 2024-08-17T02:26:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7ff817e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8181527a0 con 0x7ff818152340 2024-08-17T02:26:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7ff816a00640 1 -- 172.21.15.6:0/3841882189 learned_addr learned my addr 172.21.15.6:0/3841882189 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7fe9cf400640 1 -- 172.21.15.6:0/3771769874 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe9d00cfc10 msgr2=0x7fe9d00c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7fe9cfe00640 1 --2- 172.21.15.6:0/3771769874 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9d014fe00 0x7fe9d00c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7f1775800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1768033c20 0x7f17680d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7f1775800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1768033c20 0x7f17680d4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49296/0 (socket says 172.21.15.6:49296) 2024-08-17T02:26:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7f1775800640 1 -- 172.21.15.6:0/803118256 learned_addr learned my addr 172.21.15.6:0/803118256 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7fe9c6a00640 1 --2- 172.21.15.6:0/3771769874 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe9d00cfc10 0x7fe9d00c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7fe9cf400640 1 --2- 172.21.15.6:0/3771769874 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe9d00cfc10 0x7fe9d00c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7fe9cf400640 1 -- 172.21.15.6:0/3771769874 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9d014fe00 msgr2=0x7fe9d00c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7fe9cf400640 1 --2- 172.21.15.6:0/3771769874 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9d014fe00 0x7fe9d00c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7fe9cf400640 1 -- 172.21.15.6:0/3771769874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b8009450 con 0x7fe9d00ce380 2024-08-17T02:26:38.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7ff817400640 1 --2- 172.21.15.6:0/3841882189 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff818152340 0x7ff81813f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7fe9cfe00640 1 --2- 172.21.15.6:0/3771769874 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9d014fe00 0x7fe9d00c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7fd6d1000640 1 --2- 172.21.15.6:0/680323723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc15d2c0 0x7fd6cc0cdb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0b26f0 tx=0x7fd6b80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e6049fbadb2cea9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7ff816000640 1 --2- 172.21.15.6:0/3841882189 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff818155910 0x7ff818151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.284+0000 7fe9c6a00640 1 --2- 172.21.15.6:0/3771769874 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe9d00cfc10 0x7fe9d00c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7ff817400640 1 -- 172.21.15.6:0/3841882189 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff818155910 msgr2=0x7ff818151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7f2ff6e00640 1 -- 172.21.15.6:0/32481062 shutdown_connections 2024-08-17T02:26:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7f2ff6e00640 1 --2- 172.21.15.6:0/32481062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ff00aeda0 0x7f2ff00b03c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7f2ff6e00640 1 --2- 172.21.15.6:0/32481062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2ff015cdc0 0x7f2ff00ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7f2ff6e00640 1 -- 172.21.15.6:0/32481062 >> 172.21.15.6:0/32481062 conn(0x7f2ff0066e60 msgr2=0x7f2ff0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7f1775800640 1 -- 172.21.15.6:0/803118256 >> v1:172.21.15.136:6789/0 conn(0x7f1768033850 legacy=0x7f1768005e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7ff817400640 1 --2- 172.21.15.6:0/3841882189 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff818155910 0x7ff818151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7ff817400640 1 -- 172.21.15.6:0/3841882189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7fc003f90 msgr2=0x7ff8181553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7ff817400640 1 --2- 172.21.15.6:0/3841882189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7fc003f90 0x7ff8181553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7ff817400640 1 -- 172.21.15.6:0/3841882189 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff818153590 con 0x7ff818152340 2024-08-17T02:26:38.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7f2ff6e00640 1 -- 172.21.15.6:0/32481062 shutdown_connections 2024-08-17T02:26:38.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7f065fe00640 1 -- 172.21.15.6:0/1207865470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06600b2e40 con 0x7f0660160800 2024-08-17T02:26:38.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7f065fe00640 1 -- 172.21.15.6:0/1207865470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06600b3400 con 0x7f0660160800 2024-08-17T02:26:38.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7f1775800640 1 -- 172.21.15.6:0/803118256 >> v1:172.21.15.6:6789/0 conn(0x7f176800c040 legacy=0x7f1768053020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7f1775800640 1 -- 172.21.15.6:0/803118256 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1768053b70 con 0x7f1768033c20 2024-08-17T02:26:38.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7ff817400640 1 --2- 172.21.15.6:0/3841882189 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff818152340 0x7ff81813f610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff81806baf0 tx=0x7ff81000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7ff80e000640 1 -- 172.21.15.6:0/3841882189 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff810014690 con 0x7ff818152340 2024-08-17T02:26:38.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.286+0000 7ff80e000640 1 -- 172.21.15.6:0/3841882189 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81000f040 con 0x7ff818152340 2024-08-17T02:26:38.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.286+0000 7ff80e000640 1 -- 172.21.15.6:0/3841882189 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff810014a40 con 0x7ff818152340 2024-08-17T02:26:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.286+0000 7fd6cbe00640 1 -- 172.21.15.6:0/680323723 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b803bd80 con 0x7fd6cc15d2c0 2024-08-17T02:26:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.286+0000 7fd6cbe00640 1 -- 172.21.15.6:0/680323723 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b8043440 con 0x7fd6cc15d2c0 2024-08-17T02:26:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.286+0000 7fd6cbe00640 1 -- 172.21.15.6:0/680323723 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8043820 con 0x7fd6cc15d2c0 2024-08-17T02:26:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.286+0000 7f065fe00640 1 -- 172.21.15.6:0/1207865470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0660070720 con 0x7f0660160800 2024-08-17T02:26:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.286+0000 7fe9cf400640 1 --2- 172.21.15.6:0/3771769874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9d00ce380 0x7fe9d014a850 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000bc30 tx=0x7fe9c0009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.286+0000 7ff817e00640 1 -- 172.21.15.6:0/3841882189 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff818153870 con 0x7ff818152340 2024-08-17T02:26:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.287+0000 7fe9c7400640 1 -- 172.21.15.6:0/3771769874 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c000ca70 con 0x7fe9d00ce380 2024-08-17T02:26:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.287+0000 7fe9c7400640 1 -- 172.21.15.6:0/3771769874 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c000cc10 con 0x7fe9d00ce380 2024-08-17T02:26:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.287+0000 7fe9c7400640 1 -- 172.21.15.6:0/3771769874 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0014410 con 0x7fe9d00ce380 2024-08-17T02:26:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.286+0000 7ff817e00640 1 -- 172.21.15.6:0/3841882189 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff818154350 con 0x7ff818152340 2024-08-17T02:26:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.287+0000 7fd6d2e00640 1 -- 172.21.15.6:0/680323723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc15d2c0 msgr2=0x7fd6cc0cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.287+0000 7fd6d2e00640 1 --2- 172.21.15.6:0/680323723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc15d2c0 0x7fd6cc0cdb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0b26f0 tx=0x7fd6b80091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.287+0000 7fe9d6800640 1 -- 172.21.15.6:0/3771769874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d00c8ab0 con 0x7fe9d00ce380 2024-08-17T02:26:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.287+0000 7fe9d6800640 1 -- 172.21.15.6:0/3771769874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d00c9070 con 0x7fe9d00ce380 2024-08-17T02:26:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.285+0000 7f2ff6e00640 1 -- 172.21.15.6:0/32481062 wait complete. 2024-08-17T02:26:38.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.287+0000 7f2ff6e00640 1 Processor -- start 2024-08-17T02:26:38.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.287+0000 7f1775800640 1 --2- 172.21.15.6:0/803118256 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1768033c20 0x7f17680d4ac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1770064f60 tx=0x7f1770064990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f5f6839a3eb99aa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.288+0000 7fd6d2e00640 1 -- 172.21.15.6:0/680323723 shutdown_connections 2024-08-17T02:26:38.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.288+0000 7fd6d2e00640 1 --2- 172.21.15.6:0/680323723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc15d2c0 0x7fd6cc0cdb30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.288+0000 7fd6d2e00640 1 --2- 172.21.15.6:0/680323723 >> v2:172.21.15.6:3300/0 conn(0x7fd6cc0cd760 0x7fd6cc0cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.288+0000 7fd6d2e00640 1 -- 172.21.15.6:0/680323723 >> 172.21.15.6:0/680323723 conn(0x7fd6cc0684a0 msgr2=0x7fd6cc0688a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.288+0000 7f2ff6e00640 1 -- start start 2024-08-17T02:26:38.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.288+0000 7f176f400640 1 -- 172.21.15.6:0/803118256 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17700a1e50 con 0x7f1768033c20 2024-08-17T02:26:38.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.288+0000 7f176f400640 1 -- 172.21.15.6:0/803118256 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17700a93f0 con 0x7f1768033c20 2024-08-17T02:26:38.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.288+0000 7f176f400640 1 -- 172.21.15.6:0/803118256 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17700a9830 con 0x7f1768033c20 2024-08-17T02:26:38.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.289+0000 7fe9d6800640 1 -- 172.21.15.6:0/3771769874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe9d0063fb0 con 0x7fe9d00ce380 2024-08-17T02:26:38.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.289+0000 7f1776200640 1 -- 172.21.15.6:0/803118256 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1768033c20 msgr2=0x7f17680d4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.289+0000 7f1776200640 1 --2- 172.21.15.6:0/803118256 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1768033c20 0x7f17680d4ac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1770064f60 tx=0x7f1770064990 comp rx=0 tx=0).stop 2024-08-17T02:26:38.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.289+0000 7ff817e00640 1 -- 172.21.15.6:0/3841882189 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff818070720 con 0x7ff818152340 2024-08-17T02:26:38.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.289+0000 7fd6d2e00640 1 -- 172.21.15.6:0/680323723 shutdown_connections 2024-08-17T02:26:38.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.289+0000 7fd6d2e00640 1 -- 172.21.15.6:0/680323723 wait complete. 2024-08-17T02:26:38.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.290+0000 7fee0e800640 1 Processor -- start 2024-08-17T02:26:38.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.290+0000 7f7566200640 1 Processor -- start 2024-08-17T02:26:38.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.290+0000 7f0656000640 1 -- 172.21.15.6:0/1207865470 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0658012a80 con 0x7f0660160800 2024-08-17T02:26:38.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.290+0000 7f2ff6e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ff00aeda0 0x7f2ff0156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.290+0000 7fee0e800640 1 -- start start 2024-08-17T02:26:38.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.290+0000 7f1776200640 1 -- 172.21.15.6:0/803118256 shutdown_connections 2024-08-17T02:26:38.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.290+0000 7f1776200640 1 --2- 172.21.15.6:0/803118256 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1768033c20 0x7f17680d4ac0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.290+0000 7f1776200640 1 -- 172.21.15.6:0/803118256 >> 172.21.15.6:0/803118256 conn(0x7f1768054b90 msgr2=0x7f1768054f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.290+0000 7f2ff6e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ff00b0900 0x7f2ff0164e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.291+0000 7f2ff6e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2ff015cdc0 0x7f2ff0165380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.291+0000 7ff80e000640 1 -- 172.21.15.6:0/3841882189 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff81001e410 con 0x7ff818152340 2024-08-17T02:26:38.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.291+0000 7fe9c7400640 1 -- 172.21.15.6:0/3771769874 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe9c0014840 con 0x7fe9d00ce380 2024-08-17T02:26:38.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.291+0000 7f1776200640 1 -- 172.21.15.6:0/803118256 shutdown_connections 2024-08-17T02:26:38.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.291+0000 7f7566200640 1 -- start start 2024-08-17T02:26:38.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.291+0000 7f2ff6e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff0167350 con 0x7f2ff00aeda0 2024-08-17T02:26:38.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.291+0000 7f2ff6e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff0166a60 con 0x7f2ff00b0900 2024-08-17T02:26:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.291+0000 7f2ff6e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff01649b0 con 0x7f2ff015cdc0 2024-08-17T02:26:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.291+0000 7f2fefe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ff00aeda0 0x7f2ff0156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.291+0000 7f2ff4e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2ff015cdc0 0x7f2ff0165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.291+0000 7f2fefe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ff00aeda0 0x7f2ff0156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56940/0 (socket says 172.21.15.6:56940) 2024-08-17T02:26:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.291+0000 7f2fefe00640 1 -- 172.21.15.6:0/1062741701 learned_addr learned my addr 172.21.15.6:0/1062741701 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7f2fef400640 1 --2- 172.21.15.6:0/1062741701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ff00b0900 0x7f2ff0164e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7f0656000640 1 --2- 172.21.15.6:0/1207865470 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0640065220 0x7f06400676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7f0656000640 1 -- 172.21.15.6:0/1207865470 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0658082aa0 con 0x7f0660160800 2024-08-17T02:26:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7f0656000640 1 --2- 172.21.15.6:0/1207865470 >> [v2:172.21.15.6:6823/36885,v1:172.21.15.6:6825/36885] conn(0x7f064006d430 0x7f064006f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7f0656000640 1 -- 172.21.15.6:0/1207865470 --> [v2:172.21.15.6:6823/36885,v1:172.21.15.6:6825/36885] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f064006fef0 con 0x7f064006d430 2024-08-17T02:26:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7f0656000640 1 -- 172.21.15.6:0/1207865470 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0658082e70 con 0x7f0660160800 2024-08-17T02:26:38.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7f2fefe00640 1 -- 172.21.15.6:0/1062741701 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2ff015cdc0 msgr2=0x7f2ff0165380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7f2fefe00640 1 --2- 172.21.15.6:0/1062741701 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2ff015cdc0 0x7f2ff0165380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7f2fefe00640 1 -- 172.21.15.6:0/1062741701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ff00b0900 msgr2=0x7f2ff0164e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7f2fefe00640 1 --2- 172.21.15.6:0/1062741701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ff00b0900 0x7f2ff0164e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7f2fefe00640 1 -- 172.21.15.6:0/1062741701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc009390 con 0x7f2ff00aeda0 2024-08-17T02:26:38.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.291+0000 7f1776200640 1 -- 172.21.15.6:0/803118256 wait complete. 2024-08-17T02:26:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7fee0e800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fee08067970 0x7fee080abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7fee0e800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee08159320 0x7fee0806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7fee0e800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0806e140 con 0x7fee0806dd10 2024-08-17T02:26:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7fee0e800640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee08155860 con 0x7fee08159320 2024-08-17T02:26:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7fee0e800640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0815bc90 con 0x7fee08067970 2024-08-17T02:26:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7fe9c7400640 1 --2- 172.21.15.6:0/3771769874 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe9ac0652a0 0x7fe9ac067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7fe9c7400640 1 -- 172.21.15.6:0/3771769874 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe9c00825a0 con 0x7fe9d00ce380 2024-08-17T02:26:38.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7fe9c7400640 1 --2- 172.21.15.6:0/3771769874 >> [v2:172.21.15.6:6816/36884,v1:172.21.15.6:6817/36884] conn(0x7fe9ac06d4b0 0x7fe9ac06f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.293+0000 7fe9c7400640 1 -- 172.21.15.6:0/3771769874 --> [v2:172.21.15.6:6816/36884,v1:172.21.15.6:6817/36884] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe9ac06ff70 con 0x7fe9ac06d4b0 2024-08-17T02:26:38.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.293+0000 7fe9c7400640 1 -- 172.21.15.6:0/3771769874 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9c0084b20 con 0x7fe9d00ce380 2024-08-17T02:26:38.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.293+0000 7f065ea00640 1 --2- 172.21.15.6:0/1207865470 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0640065220 0x7f06400676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.293+0000 7f1776200640 1 Processor -- start 2024-08-17T02:26:38.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.293+0000 7fee07400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fee08067970 0x7fee080abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.293+0000 7fee07400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fee08067970 0x7fee080abef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49318/0 (socket says 172.21.15.6:49318) 2024-08-17T02:26:38.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.293+0000 7fee07400640 1 -- 172.21.15.6:0/2509358509 learned_addr learned my addr 172.21.15.6:0/2509358509 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.293+0000 7fee06a00640 1 --2- 172.21.15.6:0/2509358509 >> v2:172.21.15.6:3300/0 conn(0x7fee08159320 0x7fee0806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7fe9cfe00640 1 --2- 172.21.15.6:0/3771769874 >> [v2:172.21.15.6:6816/36884,v1:172.21.15.6:6817/36884] conn(0x7fe9ac06d4b0 0x7fe9ac06f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.293+0000 7f2fefe00640 1 --2- 172.21.15.6:0/1062741701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ff00aeda0 0x7f2ff0156c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000e900 tx=0x7f2fe00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7fd6d2e00640 1 Processor -- start 2024-08-17T02:26:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7f1776200640 1 -- start start 2024-08-17T02:26:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7f065e000640 1 --2- 172.21.15.6:0/1207865470 >> [v2:172.21.15.6:6823/36885,v1:172.21.15.6:6825/36885] conn(0x7f064006d430 0x7f064006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7f7566200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f75601589e0 0x7f7560158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7fd6d2e00640 1 -- start start 2024-08-17T02:26:38.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7f7566200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f75600ce140 0x7f75600cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7f065ea00640 1 --2- 172.21.15.6:0/1207865470 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0640065220 0x7f06400676d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f064c034000 tx=0x7f064c035000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7f2fe7400640 1 -- 172.21.15.6:0/1062741701 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000c8e0 con 0x7f2ff00aeda0 2024-08-17T02:26:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7fee07400640 1 -- 172.21.15.6:0/2509358509 >> v2:172.21.15.6:3300/0 conn(0x7fee08159320 msgr2=0x7fee0806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7fee07400640 1 --2- 172.21.15.6:0/2509358509 >> v2:172.21.15.6:3300/0 conn(0x7fee08159320 0x7fee0806d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7fee07400640 1 -- 172.21.15.6:0/2509358509 >> v1:172.21.15.136:6789/0 conn(0x7fee0806dd10 legacy=0x7fee080b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7fee07400640 1 -- 172.21.15.6:0/2509358509 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee080ac4f0 con 0x7fee08067970 2024-08-17T02:26:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7fee06000640 1 -- 172.21.15.6:0/2509358509 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992804332 0 0) 0x7fee0806e140 con 0x7fee0806dd10 2024-08-17T02:26:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7f7566200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75600af9a0 con 0x7f75600ca9c0 2024-08-17T02:26:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7f7566200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75600af810 con 0x7f75601589e0 2024-08-17T02:26:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7f7566200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75600cb340 con 0x7f75600ce140 2024-08-17T02:26:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7f755ea00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f75600ca9c0 0x7f75600cda30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:56596/0 (socket says 172.21.15.6:56596) 2024-08-17T02:26:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.294+0000 7f755ea00640 1 -- 172.21.15.6:0/3593677380 learned_addr learned my addr 172.21.15.6:0/3593677380 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.295+0000 7f755f400640 1 --2- 172.21.15.6:0/3593677380 >> v2:172.21.15.6:3300/0 conn(0x7f75601589e0 0x7f7560158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.295+0000 7f755fe00640 1 --2- 172.21.15.6:0/3593677380 >> v2:172.21.15.136:3300/0 conn(0x7f75600ce140 0x7f75600cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7ff80e000640 1 --2- 172.21.15.6:0/3841882189 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff7f80652a0 0x7ff7f8067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.292+0000 7ff80e000640 1 -- 172.21.15.6:0/3841882189 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff810082290 con 0x7ff818152340 2024-08-17T02:26:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.293+0000 7ff80e000640 1 --2- 172.21.15.6:0/3841882189 >> [v2:172.21.15.6:6808/36882,v1:172.21.15.6:6809/36882] conn(0x7ff7f806d4b0 0x7ff7f806f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.293+0000 7ff80e000640 1 -- 172.21.15.6:0/3841882189 --> [v2:172.21.15.6:6808/36882,v1:172.21.15.6:6809/36882] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff7f806ff70 con 0x7ff7f806d4b0 2024-08-17T02:26:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.293+0000 7ff80e000640 1 -- 172.21.15.6:0/3841882189 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff810084830 con 0x7ff818152340 2024-08-17T02:26:38.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.295+0000 7f755e000640 1 -- 172.21.15.6:0/3593677380 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418357239 0 0) 0x7f75600af9a0 con 0x7f75600ca9c0 2024-08-17T02:26:38.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.295+0000 7f755e000640 1 -- 172.21.15.6:0/3593677380 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75440034e0 con 0x7f75600ca9c0 2024-08-17T02:26:38.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.295+0000 7f2fe7400640 1 -- 172.21.15.6:0/1062741701 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe000ca40 con 0x7f2ff00aeda0 2024-08-17T02:26:38.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.295+0000 7f2fe7400640 1 -- 172.21.15.6:0/1062741701 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000cdc0 con 0x7f2ff00aeda0 2024-08-17T02:26:38.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.295+0000 7f2ff6e00640 1 -- 172.21.15.6:0/1062741701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff0166d00 con 0x7f2ff00aeda0 2024-08-17T02:26:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.295+0000 7f755f400640 1 -- 172.21.15.6:0/3593677380 >> v2:172.21.15.136:3300/0 conn(0x7f75600ce140 msgr2=0x7f75600cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.295+0000 7f755f400640 1 --2- 172.21.15.6:0/3593677380 >> v2:172.21.15.136:3300/0 conn(0x7f75600ce140 0x7f75600cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.295+0000 7f755f400640 1 -- 172.21.15.6:0/3593677380 >> v1:172.21.15.136:6789/0 conn(0x7f75600ca9c0 legacy=0x7f75600cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.295+0000 7f755f400640 1 -- 172.21.15.6:0/3593677380 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75600ce740 con 0x7f75601589e0 2024-08-17T02:26:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.295+0000 7f065e000640 1 --2- 172.21.15.6:0/1207865470 >> [v2:172.21.15.6:6823/36885,v1:172.21.15.6:6825/36885] conn(0x7f064006d430 0x7f064006f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7fe9c6a00640 1 --2- 172.21.15.6:0/3771769874 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe9ac0652a0 0x7fe9ac067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.295+0000 7f2ff6e00640 1 -- 172.21.15.6:0/1062741701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff0157180 con 0x7f2ff00aeda0 2024-08-17T02:26:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7f1776200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f176800c040 0x7f176803a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7f1776200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1768033850 0x7f17680f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7f1776200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1768033c20 0x7f17680d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7f1776200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17680fee40 con 0x7f1768033c20 2024-08-17T02:26:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7f1776200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1768039220 con 0x7f1768033850 2024-08-17T02:26:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7f1776200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17680f5f20 con 0x7f176800c040 2024-08-17T02:26:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7fd6d2e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6cc0ccca0 0x7fd6cc0b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7fd6d2e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6cc0cd760 0x7fd6cc0b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7fd6d2e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc15d2c0 0x7fd6cc1543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7fd6d2e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc0b4210 con 0x7fd6cc0ccca0 2024-08-17T02:26:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7fd6d2e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc0b3600 con 0x7fd6cc15d2c0 2024-08-17T02:26:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7fd6d2e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc0b38e0 con 0x7fd6cc0cd760 2024-08-17T02:26:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7fee07400640 1 --2- 172.21.15.6:0/2509358509 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fee08067970 0x7fee080abef0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fee00009f20 tx=0x7fee00009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4844db6da031c6e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7fee06000640 1 -- 172.21.15.6:0/2509358509 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee000090d0 con 0x7fee08067970 2024-08-17T02:26:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.297+0000 7fee06000640 1 -- 172.21.15.6:0/2509358509 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0002d070 con 0x7fee08067970 2024-08-17T02:26:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.297+0000 7fee06000640 1 -- 172.21.15.6:0/2509358509 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00031630 con 0x7fee08067970 2024-08-17T02:26:38.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7f1774e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f176800c040 0x7f176803a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.297+0000 7f176fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1768033850 0x7f17680f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.297+0000 7f176fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1768033850 0x7f17680f59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:44014/0 (socket says 172.21.15.6:44014) 2024-08-17T02:26:38.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.297+0000 7f176fe00640 1 -- 172.21.15.6:0/1637937308 learned_addr learned my addr 172.21.15.6:0/1637937308 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.297+0000 7fd6d1a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6cc0ccca0 0x7fd6cc0b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.297+0000 7fd6d2400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc15d2c0 0x7fd6cc1543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.297+0000 7fd6d2400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc15d2c0 0x7fd6cc1543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:44018/0 (socket says 172.21.15.6:44018) 2024-08-17T02:26:38.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.297+0000 7fd6d2400640 1 -- 172.21.15.6:0/817563356 learned_addr learned my addr 172.21.15.6:0/817563356 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7f2ff6e00640 1 -- 172.21.15.6:0/1062741701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2fc8000fd0 con 0x7f2ff00aeda0 2024-08-17T02:26:38.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7ff816a00640 1 --2- 172.21.15.6:0/3841882189 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff7f80652a0 0x7ff7f8067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.296+0000 7ff816000640 1 --2- 172.21.15.6:0/3841882189 >> [v2:172.21.15.6:6808/36882,v1:172.21.15.6:6809/36882] conn(0x7ff7f806d4b0 0x7ff7f806f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.297+0000 7f1775800640 1 --2- 172.21.15.6:0/1637937308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1768033c20 0x7f17680d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.297+0000 7ff816a00640 1 --2- 172.21.15.6:0/3841882189 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff7f80652a0 0x7ff7f8067750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff808007fd0 tx=0x7ff808009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.297+0000 7fd6d1000640 1 --2- 172.21.15.6:0/817563356 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6cc0cd760 0x7fd6cc0b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.298+0000 7fd6d2400640 1 -- 172.21.15.6:0/817563356 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6cc0cd760 msgr2=0x7fd6cc0b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.298+0000 7fd6d2400640 1 --2- 172.21.15.6:0/817563356 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6cc0cd760 0x7fd6cc0b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.298+0000 7fd6d2400640 1 -- 172.21.15.6:0/817563356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6cc0ccca0 msgr2=0x7fd6cc0b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.298+0000 7fd6d2400640 1 --2- 172.21.15.6:0/817563356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6cc0ccca0 0x7fd6cc0b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.298+0000 7fd6d2400640 1 -- 172.21.15.6:0/817563356 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b8009450 con 0x7fd6cc15d2c0 2024-08-17T02:26:38.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.298+0000 7fee0e800640 1 -- 172.21.15.6:0/2509358509 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fee08067970 msgr2=0x7fee080abef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.298+0000 7fee0e800640 1 --2- 172.21.15.6:0/2509358509 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fee08067970 0x7fee080abef0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fee00009f20 tx=0x7fee00009840 comp rx=0 tx=0).stop 2024-08-17T02:26:38.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.298+0000 7fe9cfe00640 1 --2- 172.21.15.6:0/3771769874 >> [v2:172.21.15.6:6816/36884,v1:172.21.15.6:6817/36884] conn(0x7fe9ac06d4b0 0x7fe9ac06f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.298+0000 7f176fe00640 1 -- 172.21.15.6:0/1637937308 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f176800c040 msgr2=0x7f176803a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.298+0000 7f176fe00640 1 --2- 172.21.15.6:0/1637937308 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f176800c040 0x7f176803a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.298+0000 7f176fe00640 1 -- 172.21.15.6:0/1637937308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1768033c20 msgr2=0x7f17680d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.298+0000 7f176fe00640 1 --2- 172.21.15.6:0/1637937308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1768033c20 0x7f17680d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.298+0000 7f176fe00640 1 -- 172.21.15.6:0/1637937308 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177004c200 con 0x7f1768033850 2024-08-17T02:26:38.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.298+0000 7fd6d2400640 1 --2- 172.21.15.6:0/817563356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc15d2c0 0x7fd6cc1543f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000c490 tx=0x7fd6c0007ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.298+0000 7f755f400640 1 --2- 172.21.15.6:0/3593677380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75601589e0 0x7f7560158db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f75600ca6a0 tx=0x7f75580090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d8125af9da95bb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.298+0000 7f0656000640 1 -- 172.21.15.6:0/1207865470 <== osd.0 v2:172.21.15.6:6823/36885 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f064006fef0 con 0x7f064006d430 2024-08-17T02:26:38.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.299+0000 7fd6c8c00640 1 -- 172.21.15.6:0/817563356 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0011590 con 0x7fd6cc15d2c0 2024-08-17T02:26:38.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.299+0000 7fd6c8c00640 1 -- 172.21.15.6:0/817563356 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c00116f0 con 0x7fd6cc15d2c0 2024-08-17T02:26:38.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.299+0000 7fd6c8c00640 1 -- 172.21.15.6:0/817563356 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0011ad0 con 0x7fd6cc15d2c0 2024-08-17T02:26:38.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.298+0000 7ff816000640 1 --2- 172.21.15.6:0/3841882189 >> [v2:172.21.15.6:6808/36882,v1:172.21.15.6:6809/36882] conn(0x7ff7f806d4b0 0x7ff7f806f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.299+0000 7fd6d2e00640 1 -- 172.21.15.6:0/817563356 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6cc0b3bc0 con 0x7fd6cc15d2c0 2024-08-17T02:26:38.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.299+0000 7fd6d2e00640 1 -- 172.21.15.6:0/817563356 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6cc0b3310 con 0x7fd6cc15d2c0 2024-08-17T02:26:38.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.299+0000 7f755e000640 1 -- 172.21.15.6:0/3593677380 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755802adb0 con 0x7f75601589e0 2024-08-17T02:26:38.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.299+0000 7f755e000640 1 -- 172.21.15.6:0/3593677380 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7558032440 con 0x7f75601589e0 2024-08-17T02:26:38.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.299+0000 7f755e000640 1 -- 172.21.15.6:0/3593677380 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7558032820 con 0x7f75601589e0 2024-08-17T02:26:38.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7f176fe00640 1 --2- 172.21.15.6:0/1637937308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1768033850 0x7f17680f59e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f175c00b4c0 tx=0x7f175c009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7ff80e000640 1 -- 172.21.15.6:0/3841882189 <== osd.1 v2:172.21.15.6:6808/36882 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff7f806ff70 con 0x7ff7f806d4b0 2024-08-17T02:26:38.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7fe9c6a00640 1 --2- 172.21.15.6:0/3771769874 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe9ac0652a0 0x7fe9ac067750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8034000 tx=0x7fe9b8032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7fd6d2e00640 1 -- 172.21.15.6:0/817563356 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6cc070720 con 0x7fd6cc15d2c0 2024-08-17T02:26:38.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7f1763e00640 1 -- 172.21.15.6:0/1637937308 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c00f510 con 0x7f1768033850 2024-08-17T02:26:38.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7f1763e00640 1 -- 172.21.15.6:0/1637937308 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c00f670 con 0x7f1768033850 2024-08-17T02:26:38.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7f1763e00640 1 -- 172.21.15.6:0/1637937308 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c00fa30 con 0x7f1768033850 2024-08-17T02:26:38.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7f1776200640 1 -- 172.21.15.6:0/1637937308 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1768039450 con 0x7f1768033850 2024-08-17T02:26:38.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7fe9c7400640 1 -- 172.21.15.6:0/3771769874 <== osd.2 v2:172.21.15.6:6816/36884 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe9ac06ff70 con 0x7fe9ac06d4b0 2024-08-17T02:26:38.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7f7566200640 1 -- 172.21.15.6:0/3593677380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75601589e0 msgr2=0x7f7560158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7f7566200640 1 --2- 172.21.15.6:0/3593677380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75601589e0 0x7f7560158db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f75600ca6a0 tx=0x7f75580090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7fee0e800640 1 -- 172.21.15.6:0/2509358509 shutdown_connections 2024-08-17T02:26:38.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7fee0e800640 1 --2- 172.21.15.6:0/2509358509 >> v2:172.21.15.6:3300/0 conn(0x7fee08159320 0x7fee0806d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7fee0e800640 1 --2- 172.21.15.6:0/2509358509 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fee08067970 0x7fee080abef0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7fee0e800640 1 -- 172.21.15.6:0/2509358509 >> 172.21.15.6:0/2509358509 conn(0x7fee08066e60 msgr2=0x7fee08067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7f1776200640 1 -- 172.21.15.6:0/1637937308 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1768039cf0 con 0x7f1768033850 2024-08-17T02:26:38.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.301+0000 7f7566200640 1 -- 172.21.15.6:0/3593677380 shutdown_connections 2024-08-17T02:26:38.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.301+0000 7f7566200640 1 --2- 172.21.15.6:0/3593677380 >> v2:172.21.15.136:3300/0 conn(0x7f75600ce140 0x7f75600cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.301+0000 7f7566200640 1 --2- 172.21.15.6:0/3593677380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75601589e0 0x7f7560158db0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.301+0000 7f7566200640 1 -- 172.21.15.6:0/3593677380 >> 172.21.15.6:0/3593677380 conn(0x7f756006e590 msgr2=0x7f756006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.301+0000 7f7566200640 1 -- 172.21.15.6:0/3593677380 shutdown_connections 2024-08-17T02:26:38.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.301+0000 7f7566200640 1 -- 172.21.15.6:0/3593677380 wait complete. 2024-08-17T02:26:38.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.302+0000 7f1776200640 1 -- 172.21.15.6:0/1637937308 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f174c000fd0 con 0x7f1768033850 2024-08-17T02:26:38.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.303+0000 7f7566200640 1 Processor -- start 2024-08-17T02:26:38.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.303+0000 7f7566200640 1 -- start start 2024-08-17T02:26:38.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7f2fe7400640 1 -- 172.21.15.6:0/1062741701 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2fe0013680 con 0x7f2ff00aeda0 2024-08-17T02:26:38.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.302+0000 7f2fe7400640 1 --2- 172.21.15.6:0/1062741701 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2fd00651d0 0x7f2fd0067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.302+0000 7f2fe7400640 1 -- 172.21.15.6:0/1062741701 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2fe0082a10 con 0x7f2ff00aeda0 2024-08-17T02:26:38.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.302+0000 7f2fe7400640 1 --2- 172.21.15.6:0/1062741701 >> [v2:172.21.15.136:6800/37291,v1:172.21.15.136:6801/37291] conn(0x7f2fd006d3e0 0x7f2fd006f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.302+0000 7f2fe7400640 1 -- 172.21.15.6:0/1062741701 --> [v2:172.21.15.136:6800/37291,v1:172.21.15.136:6801/37291] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2fd006fea0 con 0x7f2fd006d3e0 2024-08-17T02:26:38.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.302+0000 7f2fe7400640 1 -- 172.21.15.6:0/1062741701 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fe0082d40 con 0x7f2ff00aeda0 2024-08-17T02:26:38.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.300+0000 7fee0e800640 1 -- 172.21.15.6:0/2509358509 shutdown_connections 2024-08-17T02:26:38.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.301+0000 7fee0e800640 1 -- 172.21.15.6:0/2509358509 wait complete. 2024-08-17T02:26:38.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.303+0000 7fee0e800640 1 Processor -- start 2024-08-17T02:26:38.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.303+0000 7fee0e800640 1 -- start start 2024-08-17T02:26:38.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.304+0000 7f7566200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75600ca9c0 0x7f75600b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.304+0000 7f7566200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75600ce140 0x7f7560152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.304+0000 7f7566200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75601589e0 0x7f75600b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.304+0000 7f7566200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7560150290 con 0x7f75600ce140 2024-08-17T02:26:38.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.304+0000 7f7566200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756016d450 con 0x7f75600ca9c0 2024-08-17T02:26:38.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.304+0000 7f7566200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756016d730 con 0x7f75601589e0 2024-08-17T02:26:38.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.304+0000 7f2fef400640 1 --2- 172.21.15.6:0/1062741701 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2fd00651d0 0x7f2fd0067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.304+0000 7f755ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75600ce140 0x7f7560152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.304+0000 7f755ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75600ce140 0x7f7560152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56980/0 (socket says 172.21.15.6:56980) 2024-08-17T02:26:38.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.304+0000 7f755ea00640 1 -- 172.21.15.6:0/2771683275 learned_addr learned my addr 172.21.15.6:0/2771683275 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.304+0000 7f755f400640 1 --2- 172.21.15.6:0/2771683275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75600ca9c0 0x7f75600b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.304+0000 7fee0e800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee08067970 0x7fee0815a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.304+0000 7fee0e800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee0806dd10 0x7fee08138d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.304+0000 7f2ff4e00640 1 --2- 172.21.15.6:0/1062741701 >> [v2:172.21.15.136:6800/37291,v1:172.21.15.136:6801/37291] conn(0x7f2fd006d3e0 0x7f2fd006f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.305+0000 7fee07400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee08067970 0x7fee0815a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.305+0000 7fee07400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee08067970 0x7fee0815a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:44036/0 (socket says 172.21.15.6:44036) 2024-08-17T02:26:38.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.305+0000 7fee07400640 1 -- 172.21.15.6:0/2972406520 learned_addr learned my addr 172.21.15.6:0/2972406520 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.305+0000 7fee06a00640 1 --2- 172.21.15.6:0/2972406520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee0806dd10 0x7fee08138d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.305+0000 7f755ea00640 1 -- 172.21.15.6:0/2771683275 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75601589e0 msgr2=0x7f75600b39c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:26:38.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.305+0000 7f755ea00640 1 --2- 172.21.15.6:0/2771683275 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75601589e0 0x7f75600b39c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.305+0000 7f755ea00640 1 -- 172.21.15.6:0/2771683275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75600ca9c0 msgr2=0x7f75600b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.305+0000 7f755ea00640 1 --2- 172.21.15.6:0/2771683275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75600ca9c0 0x7f75600b0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.305+0000 7fee0e800640 1 --2- 172.21.15.6:0/2972406520 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fee08159320 0x7fee08144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.305+0000 7f755ea00640 1 -- 172.21.15.6:0/2771683275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7558009390 con 0x7f75600ce140 2024-08-17T02:26:38.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.305+0000 7f755ea00640 1 --2- 172.21.15.6:0/2771683275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75600ce140 0x7f7560152cd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f755000cc40 tx=0x7f7550001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.305+0000 7fee0e800640 1 -- 172.21.15.6:0/2972406520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee08146c30 con 0x7fee0806dd10 2024-08-17T02:26:38.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.305+0000 7fee0e800640 1 -- 172.21.15.6:0/2972406520 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee08146020 con 0x7fee08067970 2024-08-17T02:26:38.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.306+0000 7fee0e800640 1 -- 172.21.15.6:0/2972406520 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee08146300 con 0x7fee08159320 2024-08-17T02:26:38.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.306+0000 7f2ff4e00640 1 --2- 172.21.15.6:0/1062741701 >> [v2:172.21.15.136:6800/37291,v1:172.21.15.136:6801/37291] conn(0x7f2fd006d3e0 0x7f2fd006f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.306+0000 7f2fef400640 1 --2- 172.21.15.6:0/1062741701 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2fd00651d0 0x7f2fd0067680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc034000 tx=0x7f2fdc032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.306+0000 7fee07e00640 1 --2- 172.21.15.6:0/2972406520 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fee08159320 0x7fee08144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.306+0000 7fee07400640 1 -- 172.21.15.6:0/2972406520 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fee08159320 msgr2=0x7fee08144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.306+0000 7f1763e00640 1 -- 172.21.15.6:0/1637937308 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f175c01a400 con 0x7f1768033850 2024-08-17T02:26:38.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.306+0000 7fee07400640 1 --2- 172.21.15.6:0/2972406520 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fee08159320 0x7fee08144fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.306+0000 7fee07400640 1 -- 172.21.15.6:0/2972406520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee0806dd10 msgr2=0x7fee08138d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.306+0000 7fee07400640 1 --2- 172.21.15.6:0/2972406520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee0806dd10 0x7fee08138d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.307+0000 7f7556a00640 1 -- 172.21.15.6:0/2771683275 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755000ce60 con 0x7f75600ce140 2024-08-17T02:26:38.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.306+0000 7fee07400640 1 -- 172.21.15.6:0/2972406520 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee00009ae0 con 0x7fee08067970 2024-08-17T02:26:38.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.307+0000 7f7556a00640 1 -- 172.21.15.6:0/2771683275 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755000a850 con 0x7f75600ce140 2024-08-17T02:26:38.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.307+0000 7fee07400640 1 --2- 172.21.15.6:0/2972406520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee08067970 0x7fee0815a990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fee0002ae10 tx=0x7fee00037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.303+0000 7fd6c8c00640 1 -- 172.21.15.6:0/817563356 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd6c001c460 con 0x7fd6cc15d2c0 2024-08-17T02:26:38.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.304+0000 7fd6c8c00640 1 --2- 172.21.15.6:0/817563356 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd6ac0651a0 0x7fd6ac067650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.304+0000 7fd6c8c00640 1 -- 172.21.15.6:0/817563356 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6c0082cb0 con 0x7fd6cc15d2c0 2024-08-17T02:26:38.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.308+0000 7fd6c8c00640 1 --2- 172.21.15.6:0/817563356 >> [v2:172.21.15.6:6800/36883,v1:172.21.15.6:6801/36883] conn(0x7fd6ac06d3b0 0x7fd6ac06f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.308+0000 7fd6c8c00640 1 -- 172.21.15.6:0/817563356 --> [v2:172.21.15.6:6800/36883,v1:172.21.15.6:6801/36883] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6ac06fe70 con 0x7fd6ac06d3b0 2024-08-17T02:26:38.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.308+0000 7fd6c8c00640 1 -- 172.21.15.6:0/817563356 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6c0082fa0 con 0x7fd6cc15d2c0 2024-08-17T02:26:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.307+0000 7f7566200640 1 -- 172.21.15.6:0/2771683275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756016da10 con 0x7f75600ce140 2024-08-17T02:26:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.307+0000 7f7566200640 1 -- 172.21.15.6:0/2771683275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75600b0db0 con 0x7f75600ce140 2024-08-17T02:26:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.308+0000 7f7556a00640 1 -- 172.21.15.6:0/2771683275 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755000abf0 con 0x7f75600ce140 2024-08-17T02:26:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.308+0000 7fedfea00640 1 -- 172.21.15.6:0/2972406520 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00001040 con 0x7fee08067970 2024-08-17T02:26:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.308+0000 7fedfea00640 1 -- 172.21.15.6:0/2972406520 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0003c630 con 0x7fee08067970 2024-08-17T02:26:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.308+0000 7fedfea00640 1 -- 172.21.15.6:0/2972406520 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0003c9d0 con 0x7fee08067970 2024-08-17T02:26:38.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.308+0000 7f7566200640 1 -- 172.21.15.6:0/2771683275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7538000fd0 con 0x7f75600ce140 2024-08-17T02:26:38.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.308+0000 7f1763e00640 1 --2- 172.21.15.6:0/1637937308 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f17500652a0 0x7f1750067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.308+0000 7f1763e00640 1 -- 172.21.15.6:0/1637937308 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f175c081d60 con 0x7f1768033850 2024-08-17T02:26:38.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.309+0000 7f2fe7400640 1 -- 172.21.15.6:0/1062741701 <== osd.4 v2:172.21.15.136:6800/37291 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f2fd006fea0 con 0x7f2fd006d3e0 2024-08-17T02:26:38.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.308+0000 7fee0e800640 1 -- 172.21.15.6:0/2972406520 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee081465e0 con 0x7fee08067970 2024-08-17T02:26:38.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.309+0000 7fee0e800640 1 -- 172.21.15.6:0/2972406520 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0815aed0 con 0x7fee08067970 2024-08-17T02:26:38.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.308+0000 7fd6d1a00640 1 --2- 172.21.15.6:0/817563356 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd6ac0651a0 0x7fd6ac067650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.309+0000 7fd6d1000640 1 --2- 172.21.15.6:0/817563356 >> [v2:172.21.15.6:6800/36883,v1:172.21.15.6:6801/36883] conn(0x7fd6ac06d3b0 0x7fd6ac06f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.309+0000 7fee0e800640 1 -- 172.21.15.6:0/2972406520 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fede0000fd0 con 0x7fee08067970 2024-08-17T02:26:38.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.310+0000 7fd6d1a00640 1 --2- 172.21.15.6:0/817563356 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd6ac0651a0 0x7fd6ac067650 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc160670 tx=0x7fd6c4009620 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.310+0000 7fd6d1000640 1 --2- 172.21.15.6:0/817563356 >> [v2:172.21.15.6:6800/36883,v1:172.21.15.6:6801/36883] conn(0x7fd6ac06d3b0 0x7fd6ac06f7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.311+0000 7f1774e00640 1 --2- 172.21.15.6:0/1637937308 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f17500652a0 0x7f1750067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.311+0000 7f7556a00640 1 -- 172.21.15.6:0/2771683275 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f75500070f0 con 0x7f75600ce140 2024-08-17T02:26:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.311+0000 7f1763e00640 1 --2- 172.21.15.6:0/1637937308 >> [v2:172.21.15.136:6805/37290,v1:172.21.15.136:6806/37290] conn(0x7f175006d4b0 0x7f175006f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.311+0000 7f1763e00640 1 -- 172.21.15.6:0/1637937308 --> [v2:172.21.15.136:6805/37290,v1:172.21.15.136:6806/37290] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f175006ff70 con 0x7f175006d4b0 2024-08-17T02:26:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.311+0000 7f1763e00640 1 -- 172.21.15.6:0/1637937308 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f175c084300 con 0x7f1768033850 2024-08-17T02:26:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.311+0000 7fd6c8c00640 1 -- 172.21.15.6:0/817563356 <== osd.3 v2:172.21.15.6:6800/36883 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd6ac06fe70 con 0x7fd6ac06d3b0 2024-08-17T02:26:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.311+0000 7f1775800640 1 --2- 172.21.15.6:0/1637937308 >> [v2:172.21.15.136:6805/37290,v1:172.21.15.136:6806/37290] conn(0x7f175006d4b0 0x7f175006f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.312+0000 7fedfea00640 1 -- 172.21.15.6:0/2972406520 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fee0003a3b0 con 0x7fee08067970 2024-08-17T02:26:38.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.312+0000 7f1774e00640 1 --2- 172.21.15.6:0/1637937308 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f17500652a0 0x7f1750067750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1764009a20 tx=0x7f1764006f30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.312+0000 7f1775800640 1 --2- 172.21.15.6:0/1637937308 >> [v2:172.21.15.136:6805/37290,v1:172.21.15.136:6806/37290] conn(0x7f175006d4b0 0x7f175006f8c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.313+0000 7f1763e00640 1 -- 172.21.15.6:0/1637937308 <== osd.5 v2:172.21.15.136:6805/37290 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f175006ff70 con 0x7f175006d4b0 2024-08-17T02:26:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.313+0000 7f7556a00640 1 --2- 172.21.15.6:0/2771683275 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f753c0651d0 0x7f753c067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.314+0000 7f7556a00640 1 -- 172.21.15.6:0/2771683275 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f75500825d0 con 0x7f75600ce140 2024-08-17T02:26:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.314+0000 7f7556a00640 1 --2- 172.21.15.6:0/2771683275 >> [v2:172.21.15.136:6816/37292,v1:172.21.15.136:6818/37292] conn(0x7f753c06d3e0 0x7f753c06f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.314+0000 7f7556a00640 1 -- 172.21.15.6:0/2771683275 --> [v2:172.21.15.136:6816/37292,v1:172.21.15.136:6818/37292] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f753c06fea0 con 0x7f753c06d3e0 2024-08-17T02:26:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.314+0000 7f7556a00640 1 -- 172.21.15.6:0/2771683275 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7550084b70 con 0x7f75600ce140 2024-08-17T02:26:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.314+0000 7f755f400640 1 --2- 172.21.15.6:0/2771683275 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f753c0651d0 0x7f753c067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.315+0000 7f755fe00640 1 --2- 172.21.15.6:0/2771683275 >> [v2:172.21.15.136:6816/37292,v1:172.21.15.136:6818/37292] conn(0x7f753c06d3e0 0x7f753c06f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.314+0000 7fedfea00640 1 --2- 172.21.15.6:0/2972406520 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fede80652a0 0x7fede8067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.315+0000 7fedfea00640 1 -- 172.21.15.6:0/2972406520 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee000a39b0 con 0x7fee08067970 2024-08-17T02:26:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.315+0000 7fee06a00640 1 --2- 172.21.15.6:0/2972406520 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fede80652a0 0x7fede8067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.315+0000 7fedfea00640 1 --2- 172.21.15.6:0/2972406520 >> [v2:172.21.15.136:6817/37309,v1:172.21.15.136:6819/37309] conn(0x7fede806d4b0 0x7fede806f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.315+0000 7fedfea00640 1 -- 172.21.15.6:0/2972406520 --> [v2:172.21.15.136:6817/37309,v1:172.21.15.136:6819/37309] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fede806ff70 con 0x7fede806d4b0 2024-08-17T02:26:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.315+0000 7fedfea00640 1 -- 172.21.15.6:0/2972406520 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee000a3ce0 con 0x7fee08067970 2024-08-17T02:26:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.316+0000 7fee07e00640 1 --2- 172.21.15.6:0/2972406520 >> [v2:172.21.15.136:6817/37309,v1:172.21.15.136:6819/37309] conn(0x7fede806d4b0 0x7fede806f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.316+0000 7f755f400640 1 --2- 172.21.15.6:0/2771683275 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f753c0651d0 0x7f753c067680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7558034000 tx=0x7f7558032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.316+0000 7f755fe00640 1 --2- 172.21.15.6:0/2771683275 >> [v2:172.21.15.136:6816/37292,v1:172.21.15.136:6818/37292] conn(0x7f753c06d3e0 0x7f753c06f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.316+0000 7fee06a00640 1 --2- 172.21.15.6:0/2972406520 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fede80652a0 0x7fede8067750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fee08069a20 tx=0x7fedf8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.317+0000 7f7556a00640 1 -- 172.21.15.6:0/2771683275 <== osd.6 v2:172.21.15.136:6816/37292 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f753c06fea0 con 0x7f753c06d3e0 2024-08-17T02:26:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.317+0000 7fee07e00640 1 --2- 172.21.15.6:0/2972406520 >> [v2:172.21.15.136:6817/37309,v1:172.21.15.136:6819/37309] conn(0x7fede806d4b0 0x7fede806f8c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.318+0000 7fedfea00640 1 -- 172.21.15.6:0/2972406520 <== osd.7 v2:172.21.15.136:6817/37309 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fede806ff70 con 0x7fede806d4b0 2024-08-17T02:26:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.325+0000 7f065fe00640 1 -- 172.21.15.6:0/1207865470 --> [v2:172.21.15.6:6823/36885,v1:172.21.15.6:6825/36885] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0660067420 con 0x7f064006d430 2024-08-17T02:26:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.326+0000 7f0656000640 1 -- 172.21.15.6:0/1207865470 <== osd.0 v2:172.21.15.6:6823/36885 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0660067420 con 0x7f064006d430 2024-08-17T02:26:38.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.327+0000 7f065fe00640 1 -- 172.21.15.6:0/1207865470 >> [v2:172.21.15.6:6823/36885,v1:172.21.15.6:6825/36885] conn(0x7f064006d430 msgr2=0x7f064006f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.327+0000 7f065fe00640 1 --2- 172.21.15.6:0/1207865470 >> [v2:172.21.15.6:6823/36885,v1:172.21.15.6:6825/36885] conn(0x7f064006d430 0x7f064006f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.328+0000 7f065fe00640 1 -- 172.21.15.6:0/1207865470 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0640065220 msgr2=0x7f06400676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.328+0000 7f065fe00640 1 --2- 172.21.15.6:0/1207865470 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0640065220 0x7f06400676d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f064c034000 tx=0x7f064c035000 comp rx=0 tx=0).stop 2024-08-17T02:26:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.328+0000 7f065fe00640 1 -- 172.21.15.6:0/1207865470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0660160800 msgr2=0x7f06600c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.328+0000 7f065fe00640 1 --2- 172.21.15.6:0/1207865470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0660160800 0x7f06600c88c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f065800c740 tx=0x7f06580025c0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.328+0000 7f065f400640 1 -- 172.21.15.6:0/1207865470 reap_dead start 2024-08-17T02:26:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.329+0000 7f065fe00640 1 -- 172.21.15.6:0/1207865470 shutdown_connections 2024-08-17T02:26:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.329+0000 7f065fe00640 1 -- 172.21.15.6:0/1207865470 >> 172.21.15.6:0/1207865470 conn(0x7f06600cfb80 msgr2=0x7f06600cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.329+0000 7f065fe00640 1 -- 172.21.15.6:0/1207865470 shutdown_connections 2024-08-17T02:26:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.330+0000 7f065fe00640 1 -- 172.21.15.6:0/1207865470 wait complete. 2024-08-17T02:26:38.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.333+0000 7fe9d6800640 1 -- 172.21.15.6:0/3771769874 --> [v2:172.21.15.6:6816/36884,v1:172.21.15.6:6817/36884] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe9d00ca8d0 con 0x7fe9ac06d4b0 2024-08-17T02:26:38.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.334+0000 7fe9c7400640 1 -- 172.21.15.6:0/3771769874 <== osd.2 v2:172.21.15.6:6816/36884 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe9d00ca8d0 con 0x7fe9ac06d4b0 2024-08-17T02:26:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.336+0000 7fe9bfe00640 1 -- 172.21.15.6:0/3771769874 >> [v2:172.21.15.6:6816/36884,v1:172.21.15.6:6817/36884] conn(0x7fe9ac06d4b0 msgr2=0x7fe9ac06f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.336+0000 7fe9bfe00640 1 --2- 172.21.15.6:0/3771769874 >> [v2:172.21.15.6:6816/36884,v1:172.21.15.6:6817/36884] conn(0x7fe9ac06d4b0 0x7fe9ac06f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.336+0000 7fe9bfe00640 1 -- 172.21.15.6:0/3771769874 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe9ac0652a0 msgr2=0x7fe9ac067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.336+0000 7fe9bfe00640 1 --2- 172.21.15.6:0/3771769874 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe9ac0652a0 0x7fe9ac067750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8034000 tx=0x7fe9b8032000 comp rx=0 tx=0).stop 2024-08-17T02:26:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.336+0000 7fe9bfe00640 1 -- 172.21.15.6:0/3771769874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9d00ce380 msgr2=0x7fe9d014a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.336+0000 7fe9bfe00640 1 --2- 172.21.15.6:0/3771769874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9d00ce380 0x7fe9d014a850 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000bc30 tx=0x7fe9c0009820 comp rx=0 tx=0).stop 2024-08-17T02:26:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.336+0000 7fe9cfe00640 1 -- 172.21.15.6:0/3771769874 reap_dead start 2024-08-17T02:26:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.337+0000 7fe9bfe00640 1 -- 172.21.15.6:0/3771769874 shutdown_connections 2024-08-17T02:26:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.337+0000 7fe9bfe00640 1 -- 172.21.15.6:0/3771769874 >> 172.21.15.6:0/3771769874 conn(0x7fe9d0068680 msgr2=0x7fe9d014b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.337+0000 7fe9bfe00640 1 -- 172.21.15.6:0/3771769874 shutdown_connections 2024-08-17T02:26:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.338+0000 7fe9bfe00640 1 -- 172.21.15.6:0/3771769874 wait complete. 2024-08-17T02:26:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.338+0000 7ff817e00640 1 -- 172.21.15.6:0/3841882189 --> [v2:172.21.15.6:6808/36882,v1:172.21.15.6:6809/36882] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff81806b8d0 con 0x7ff7f806d4b0 2024-08-17T02:26:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.339+0000 7ff80e000640 1 -- 172.21.15.6:0/3841882189 <== osd.1 v2:172.21.15.6:6808/36882 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff81806b8d0 con 0x7ff7f806d4b0 2024-08-17T02:26:38.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.340+0000 7fd6d2e00640 1 -- 172.21.15.6:0/817563356 --> [v2:172.21.15.6:6800/36883,v1:172.21.15.6:6801/36883] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd6cc088b20 con 0x7fd6ac06d3b0 2024-08-17T02:26:38.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.340+0000 7fd6c8c00640 1 -- 172.21.15.6:0/817563356 <== osd.3 v2:172.21.15.6:6800/36883 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd6cc088b20 con 0x7fd6ac06d3b0 2024-08-17T02:26:38.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.341+0000 7ff817e00640 1 -- 172.21.15.6:0/3841882189 >> [v2:172.21.15.6:6808/36882,v1:172.21.15.6:6809/36882] conn(0x7ff7f806d4b0 msgr2=0x7ff7f806f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.341+0000 7ff817e00640 1 --2- 172.21.15.6:0/3841882189 >> [v2:172.21.15.6:6808/36882,v1:172.21.15.6:6809/36882] conn(0x7ff7f806d4b0 0x7ff7f806f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.341+0000 7f1776200640 1 -- 172.21.15.6:0/1637937308 --> [v2:172.21.15.136:6805/37290,v1:172.21.15.136:6806/37290] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f174c002ca0 con 0x7f175006d4b0 2024-08-17T02:26:38.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.341+0000 7fd6d2e00640 1 -- 172.21.15.6:0/817563356 >> [v2:172.21.15.6:6800/36883,v1:172.21.15.6:6801/36883] conn(0x7fd6ac06d3b0 msgr2=0x7fd6ac06f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.341+0000 7fd6d2e00640 1 --2- 172.21.15.6:0/817563356 >> [v2:172.21.15.6:6800/36883,v1:172.21.15.6:6801/36883] conn(0x7fd6ac06d3b0 0x7fd6ac06f7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.341+0000 7ff817e00640 1 -- 172.21.15.6:0/3841882189 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff7f80652a0 msgr2=0x7ff7f8067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.341+0000 7ff817e00640 1 --2- 172.21.15.6:0/3841882189 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff7f80652a0 0x7ff7f8067750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff808007fd0 tx=0x7ff808009040 comp rx=0 tx=0).stop 2024-08-17T02:26:38.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.341+0000 7ff817e00640 1 -- 172.21.15.6:0/3841882189 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff818152340 msgr2=0x7ff81813f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.341+0000 7ff817e00640 1 --2- 172.21.15.6:0/3841882189 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff818152340 0x7ff81813f610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff81806baf0 tx=0x7ff81000b040 comp rx=0 tx=0).stop 2024-08-17T02:26:38.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.341+0000 7ff817400640 1 -- 172.21.15.6:0/3841882189 reap_dead start 2024-08-17T02:26:38.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.341+0000 7ff817e00640 1 -- 172.21.15.6:0/3841882189 shutdown_connections 2024-08-17T02:26:38.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.341+0000 7ff817e00640 1 -- 172.21.15.6:0/3841882189 >> 172.21.15.6:0/3841882189 conn(0x7ff818066e60 msgr2=0x7ff81815aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.341+0000 7fd6d2e00640 1 -- 172.21.15.6:0/817563356 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd6ac0651a0 msgr2=0x7fd6ac067650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.341+0000 7fd6d2e00640 1 --2- 172.21.15.6:0/817563356 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd6ac0651a0 0x7fd6ac067650 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc160670 tx=0x7fd6c4009620 comp rx=0 tx=0).stop 2024-08-17T02:26:38.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.341+0000 7fd6d2e00640 1 -- 172.21.15.6:0/817563356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc15d2c0 msgr2=0x7fd6cc1543f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.341+0000 7fd6d2e00640 1 --2- 172.21.15.6:0/817563356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc15d2c0 0x7fd6cc1543f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000c490 tx=0x7fd6c0007ea0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.342+0000 7fd6d2400640 1 -- 172.21.15.6:0/817563356 reap_dead start 2024-08-17T02:26:38.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.342+0000 7ff817e00640 1 -- 172.21.15.6:0/3841882189 shutdown_connections 2024-08-17T02:26:38.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.342+0000 7fd6d2e00640 1 -- 172.21.15.6:0/817563356 shutdown_connections 2024-08-17T02:26:38.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.342+0000 7fd6d2e00640 1 -- 172.21.15.6:0/817563356 >> 172.21.15.6:0/817563356 conn(0x7fd6cc0684a0 msgr2=0x7fd6cc0cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.342+0000 7fd6d2e00640 1 -- 172.21.15.6:0/817563356 shutdown_connections 2024-08-17T02:26:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.342+0000 7ff817e00640 1 -- 172.21.15.6:0/3841882189 wait complete. 2024-08-17T02:26:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.342+0000 7fd6d2e00640 1 -- 172.21.15.6:0/817563356 wait complete. 2024-08-17T02:26:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.343+0000 7f1763e00640 1 -- 172.21.15.6:0/1637937308 <== osd.5 v2:172.21.15.136:6805/37290 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f174c002ca0 con 0x7f175006d4b0 2024-08-17T02:26:38.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.344+0000 7f1776200640 1 -- 172.21.15.6:0/1637937308 >> [v2:172.21.15.136:6805/37290,v1:172.21.15.136:6806/37290] conn(0x7f175006d4b0 msgr2=0x7f175006f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.344+0000 7f1776200640 1 --2- 172.21.15.6:0/1637937308 >> [v2:172.21.15.136:6805/37290,v1:172.21.15.136:6806/37290] conn(0x7f175006d4b0 0x7f175006f8c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.344+0000 7f7566200640 1 -- 172.21.15.6:0/2771683275 --> [v2:172.21.15.136:6816/37292,v1:172.21.15.136:6818/37292] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7538002ca0 con 0x7f753c06d3e0 2024-08-17T02:26:38.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.344+0000 7f1776200640 1 -- 172.21.15.6:0/1637937308 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f17500652a0 msgr2=0x7f1750067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.344+0000 7f1776200640 1 --2- 172.21.15.6:0/1637937308 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f17500652a0 0x7f1750067750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1764009a20 tx=0x7f1764006f30 comp rx=0 tx=0).stop 2024-08-17T02:26:38.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.344+0000 7f1776200640 1 -- 172.21.15.6:0/1637937308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1768033850 msgr2=0x7f17680f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.345+0000 7f7556a00640 1 -- 172.21.15.6:0/2771683275 <== osd.6 v2:172.21.15.136:6816/37292 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7538002ca0 con 0x7f753c06d3e0 2024-08-17T02:26:38.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.344+0000 7f1776200640 1 --2- 172.21.15.6:0/1637937308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1768033850 0x7f17680f59e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f175c00b4c0 tx=0x7f175c009060 comp rx=0 tx=0).stop 2024-08-17T02:26:38.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.344+0000 7f1775800640 1 -- 172.21.15.6:0/1637937308 reap_dead start 2024-08-17T02:26:38.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.344+0000 7f1776200640 1 -- 172.21.15.6:0/1637937308 shutdown_connections 2024-08-17T02:26:38.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.344+0000 7f1776200640 1 -- 172.21.15.6:0/1637937308 >> 172.21.15.6:0/1637937308 conn(0x7f1768054b90 msgr2=0x7f1768006e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.345+0000 7f7566200640 1 -- 172.21.15.6:0/2771683275 >> [v2:172.21.15.136:6816/37292,v1:172.21.15.136:6818/37292] conn(0x7f753c06d3e0 msgr2=0x7f753c06f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.345+0000 7f7566200640 1 --2- 172.21.15.6:0/2771683275 >> [v2:172.21.15.136:6816/37292,v1:172.21.15.136:6818/37292] conn(0x7f753c06d3e0 0x7f753c06f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.345+0000 7f7566200640 1 -- 172.21.15.6:0/2771683275 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f753c0651d0 msgr2=0x7f753c067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.345+0000 7f7566200640 1 --2- 172.21.15.6:0/2771683275 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f753c0651d0 0x7f753c067680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7558034000 tx=0x7f7558032000 comp rx=0 tx=0).stop 2024-08-17T02:26:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.345+0000 7f7566200640 1 -- 172.21.15.6:0/2771683275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75600ce140 msgr2=0x7f7560152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.345+0000 7f7566200640 1 --2- 172.21.15.6:0/2771683275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75600ce140 0x7f7560152cd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f755000cc40 tx=0x7f7550001a60 comp rx=0 tx=0).stop 2024-08-17T02:26:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.346+0000 7f755fe00640 1 -- 172.21.15.6:0/2771683275 reap_dead start 2024-08-17T02:26:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.346+0000 7f1776200640 1 -- 172.21.15.6:0/1637937308 shutdown_connections 2024-08-17T02:26:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.346+0000 7f7566200640 1 -- 172.21.15.6:0/2771683275 shutdown_connections 2024-08-17T02:26:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.346+0000 7f7566200640 1 -- 172.21.15.6:0/2771683275 >> 172.21.15.6:0/2771683275 conn(0x7f756006e590 msgr2=0x7f75600cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.346+0000 7f1776200640 1 -- 172.21.15.6:0/1637937308 wait complete. 2024-08-17T02:26:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.346+0000 7f7566200640 1 -- 172.21.15.6:0/2771683275 shutdown_connections 2024-08-17T02:26:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.346+0000 7f7566200640 1 -- 172.21.15.6:0/2771683275 wait complete. 2024-08-17T02:26:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.348+0000 7f2ff6e00640 1 -- 172.21.15.6:0/1062741701 --> [v2:172.21.15.136:6800/37291,v1:172.21.15.136:6801/37291] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2fc8002ca0 con 0x7f2fd006d3e0 2024-08-17T02:26:38.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.349+0000 7f2fe7400640 1 -- 172.21.15.6:0/1062741701 <== osd.4 v2:172.21.15.136:6800/37291 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2fc8002ca0 con 0x7f2fd006d3e0 2024-08-17T02:26:38.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.349+0000 7fee0e800640 1 -- 172.21.15.6:0/2972406520 --> [v2:172.21.15.136:6817/37309,v1:172.21.15.136:6819/37309] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fede0002ca0 con 0x7fede806d4b0 2024-08-17T02:26:38.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.349+0000 7f2ff6e00640 1 -- 172.21.15.6:0/1062741701 >> [v2:172.21.15.136:6800/37291,v1:172.21.15.136:6801/37291] conn(0x7f2fd006d3e0 msgr2=0x7f2fd006f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.350+0000 7f2ff6e00640 1 --2- 172.21.15.6:0/1062741701 >> [v2:172.21.15.136:6800/37291,v1:172.21.15.136:6801/37291] conn(0x7f2fd006d3e0 0x7f2fd006f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.350+0000 7f2ff6e00640 1 -- 172.21.15.6:0/1062741701 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2fd00651d0 msgr2=0x7f2fd0067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.350+0000 7f2ff6e00640 1 --2- 172.21.15.6:0/1062741701 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2fd00651d0 0x7f2fd0067680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc034000 tx=0x7f2fdc032000 comp rx=0 tx=0).stop 2024-08-17T02:26:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.350+0000 7f2ff6e00640 1 -- 172.21.15.6:0/1062741701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ff00aeda0 msgr2=0x7f2ff0156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.350+0000 7f2ff6e00640 1 --2- 172.21.15.6:0/1062741701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ff00aeda0 0x7f2ff0156c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000e900 tx=0x7f2fe00090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.350+0000 7fedfea00640 1 -- 172.21.15.6:0/2972406520 <== osd.7 v2:172.21.15.136:6817/37309 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fede0002ca0 con 0x7fede806d4b0 2024-08-17T02:26:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.350+0000 7f2ff4e00640 1 -- 172.21.15.6:0/1062741701 reap_dead start 2024-08-17T02:26:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.351+0000 7f2ff6e00640 1 -- 172.21.15.6:0/1062741701 shutdown_connections 2024-08-17T02:26:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.351+0000 7f2ff6e00640 1 -- 172.21.15.6:0/1062741701 >> 172.21.15.6:0/1062741701 conn(0x7f2ff0066e60 msgr2=0x7f2ff015bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.351+0000 7f2ff6e00640 1 -- 172.21.15.6:0/1062741701 shutdown_connections 2024-08-17T02:26:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.351+0000 7f2ff6e00640 1 -- 172.21.15.6:0/1062741701 wait complete. 2024-08-17T02:26:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.351+0000 7fee0e800640 1 -- 172.21.15.6:0/2972406520 >> [v2:172.21.15.136:6817/37309,v1:172.21.15.136:6819/37309] conn(0x7fede806d4b0 msgr2=0x7fede806f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.351+0000 7fee0e800640 1 --2- 172.21.15.6:0/2972406520 >> [v2:172.21.15.136:6817/37309,v1:172.21.15.136:6819/37309] conn(0x7fede806d4b0 0x7fede806f8c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.354+0000 7fee0e800640 1 -- 172.21.15.6:0/2972406520 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fede80652a0 msgr2=0x7fede8067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.354+0000 7fee0e800640 1 --2- 172.21.15.6:0/2972406520 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fede80652a0 0x7fede8067750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fee08069a20 tx=0x7fedf8008040 comp rx=0 tx=0).stop 2024-08-17T02:26:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.354+0000 7fee0e800640 1 -- 172.21.15.6:0/2972406520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee08067970 msgr2=0x7fee0815a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.379 INFO:teuthology.orchestra.run.smithi006.stdout:55834574852 2024-08-17T02:26:38.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:26:38.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.354+0000 7fee0e800640 1 --2- 172.21.15.6:0/2972406520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee08067970 0x7fee0815a990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fee0002ae10 tx=0x7fee00037000 comp rx=0 tx=0).stop 2024-08-17T02:26:38.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.355+0000 7fee07e00640 1 -- 172.21.15.6:0/2972406520 reap_dead start 2024-08-17T02:26:38.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.355+0000 7fee0e800640 1 -- 172.21.15.6:0/2972406520 shutdown_connections 2024-08-17T02:26:38.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.355+0000 7fee0e800640 1 -- 172.21.15.6:0/2972406520 >> 172.21.15.6:0/2972406520 conn(0x7fee08066e60 msgr2=0x7fee081518e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.355+0000 7fee0e800640 1 -- 172.21.15.6:0/2972406520 shutdown_connections 2024-08-17T02:26:38.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.355+0000 7fee0e800640 1 -- 172.21.15.6:0/2972406520 wait complete. 2024-08-17T02:26:38.381 INFO:teuthology.orchestra.run.smithi006.stdout:55834574852 2024-08-17T02:26:38.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:26:38.382 INFO:teuthology.orchestra.run.smithi006.stdout:55834574852 2024-08-17T02:26:38.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:26:38.383 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2024-08-17T02:26:38.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:26:38.384 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2024-08-17T02:26:38.384 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:26:38.385 INFO:teuthology.orchestra.run.smithi006.stdout:55834574852 2024-08-17T02:26:38.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:26:38.385 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2024-08-17T02:26:38.386 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:26:38.387 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2024-08-17T02:26:38.387 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:26:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.694+0000 7fa4e9a00640 1 Processor -- start 2024-08-17T02:26:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.694+0000 7f9935000640 1 Processor -- start 2024-08-17T02:26:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.694+0000 7fa4e9a00640 1 -- start start 2024-08-17T02:26:38.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.694+0000 7f9935000640 1 -- start start 2024-08-17T02:26:38.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.696+0000 7f9935000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9930154a80 0x7f99300abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.696+0000 7f9935000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9930159320 0x7f993006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.696+0000 7f9935000640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993006e140 con 0x7f993006dd10 2024-08-17T02:26:38.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.696+0000 7f9935000640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99300afb80 con 0x7f9930154a80 2024-08-17T02:26:38.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.696+0000 7f9935000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99300ac4f0 con 0x7f9930159320 2024-08-17T02:26:38.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.696+0000 7fa4e9a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e4158aa0 0x7fa4e406d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.697+0000 7fa4e9a00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa4e406dd10 0x7fa4e40a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.697+0000 7f638ae00640 1 Processor -- start 2024-08-17T02:26:38.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.697+0000 7f992de00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9930154a80 0x7f99300abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.697+0000 7f992d400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9930159320 0x7f993006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.697+0000 7f992de00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9930154a80 0x7f99300abef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56998/0 (socket says 172.21.15.6:56998) 2024-08-17T02:26:38.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.697+0000 7f992de00640 1 -- 172.21.15.6:0/3176477519 learned_addr learned my addr 172.21.15.6:0/3176477519 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.698+0000 7f638ae00640 1 -- start start 2024-08-17T02:26:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.698+0000 7fa4e2a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e4158aa0 0x7fa4e406d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.697+0000 7fa4e9a00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e415a4c0 con 0x7fa4e40a98f0 2024-08-17T02:26:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.698+0000 7fa4e9a00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e40ab480 con 0x7fa4e406dd10 2024-08-17T02:26:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.698+0000 7fa4e9a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e415ad60 con 0x7fa4e4158aa0 2024-08-17T02:26:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.698+0000 7fa4e2a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e4158aa0 0x7fa4e406d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49378/0 (socket says 172.21.15.6:49378) 2024-08-17T02:26:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.698+0000 7fa4e2a00640 1 -- 172.21.15.6:0/2846190649 learned_addr learned my addr 172.21.15.6:0/2846190649 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.698+0000 7fa4e2000640 1 --2- 172.21.15.6:0/2846190649 >> v2:172.21.15.6:3300/0 conn(0x7fa4e406dd10 0x7fa4e40a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.698+0000 7f992d400640 1 -- 172.21.15.6:0/3176477519 >> v2:172.21.15.6:3300/0 conn(0x7f9930154a80 msgr2=0x7f99300abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.698+0000 7f992d400640 1 --2- 172.21.15.6:0/3176477519 >> v2:172.21.15.6:3300/0 conn(0x7f9930154a80 0x7f99300abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.698+0000 7f992d400640 1 -- 172.21.15.6:0/3176477519 >> v1:172.21.15.6:6789/0 conn(0x7f993006dd10 legacy=0x7f9930154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.698+0000 7f992d400640 1 -- 172.21.15.6:0/3176477519 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99300ac7d0 con 0x7f9930159320 2024-08-17T02:26:38.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.699+0000 7fa4e2a00640 1 -- 172.21.15.6:0/2846190649 >> v2:172.21.15.6:3300/0 conn(0x7fa4e406dd10 msgr2=0x7fa4e40a93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.700+0000 7f638ae00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f638414fe00 0x7f63840cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.700+0000 7f638ae00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63840cca30 0x7f63840cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.700+0000 7f992d400640 1 --2- 172.21.15.6:0/3176477519 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9930159320 0x7f993006d7d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9928009bd0 tx=0x7f992802ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6da6d0b48f066a65 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.700+0000 7f638ae00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f63840d0150 0x7f638415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.700+0000 7f992ca00640 1 -- 172.21.15.6:0/3176477519 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992802f8f0 con 0x7f9930159320 2024-08-17T02:26:38.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.700+0000 7f638ae00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63840af8e0 con 0x7f63840cca30 2024-08-17T02:26:38.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.700+0000 7f638ae00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63840d05b0 con 0x7f63840d0150 2024-08-17T02:26:38.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.700+0000 7f638ae00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63840cdef0 con 0x7f638414fe00 2024-08-17T02:26:38.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.700+0000 7f637b400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63840cca30 0x7f63840cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.701+0000 7f637b400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63840cca30 0x7f63840cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57014/0 (socket says 172.21.15.6:57014) 2024-08-17T02:26:38.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.701+0000 7f637b400640 1 -- 172.21.15.6:0/4130343666 learned_addr learned my addr 172.21.15.6:0/4130343666 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.701+0000 7f6388e00640 1 --2- 172.21.15.6:0/4130343666 >> v2:172.21.15.136:3300/0 conn(0x7f63840d0150 0x7f638415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.701+0000 7f6383e00640 1 --2- 172.21.15.6:0/4130343666 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f638414fe00 0x7f63840cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.699+0000 7fa4e2a00640 1 --2- 172.21.15.6:0/2846190649 >> v2:172.21.15.6:3300/0 conn(0x7fa4e406dd10 0x7fa4e40a93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.699+0000 7fa4e2a00640 1 -- 172.21.15.6:0/2846190649 >> v1:172.21.15.6:6789/0 conn(0x7fa4e40a98f0 legacy=0x7fa4e415b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.699+0000 7fa4e2a00640 1 -- 172.21.15.6:0/2846190649 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e40a9d50 con 0x7fa4e4158aa0 2024-08-17T02:26:38.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.700+0000 7fa4e2000640 1 --2- 172.21.15.6:0/2846190649 >> v2:172.21.15.6:3300/0 conn(0x7fa4e406dd10 0x7fa4e40a93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:38.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.701+0000 7f992ca00640 1 -- 172.21.15.6:0/3176477519 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992802fa50 con 0x7f9930159320 2024-08-17T02:26:38.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.701+0000 7f5eb0e00640 1 Processor -- start 2024-08-17T02:26:38.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.701+0000 7f992ca00640 1 -- 172.21.15.6:0/3176477519 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992802fe30 con 0x7f9930159320 2024-08-17T02:26:38.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.701+0000 7fa4e2a00640 1 --2- 172.21.15.6:0/2846190649 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e4158aa0 0x7fa4e406d7d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009910 tx=0x7fa4d40091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7243e4ba45ad4add server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.701+0000 7f5eb0e00640 1 -- start start 2024-08-17T02:26:38.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.702+0000 7f637b400640 1 -- 172.21.15.6:0/4130343666 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f638414fe00 msgr2=0x7f63840cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.702+0000 7f637b400640 1 --2- 172.21.15.6:0/4130343666 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f638414fe00 0x7f63840cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.702+0000 7f637b400640 1 -- 172.21.15.6:0/4130343666 >> v2:172.21.15.136:3300/0 conn(0x7f63840d0150 msgr2=0x7f638415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.702+0000 7f637b400640 1 --2- 172.21.15.6:0/4130343666 >> v2:172.21.15.136:3300/0 conn(0x7f63840d0150 0x7f638415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.702+0000 7f637b400640 1 -- 172.21.15.6:0/4130343666 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63840ccf10 con 0x7f63840cca30 2024-08-17T02:26:38.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7fddd4200640 1 Processor -- start 2024-08-17T02:26:38.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.702+0000 7fa4e1600640 1 -- 172.21.15.6:0/2846190649 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d402ae60 con 0x7fa4e4158aa0 2024-08-17T02:26:38.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7fa4e1600640 1 -- 172.21.15.6:0/2846190649 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d4032440 con 0x7fa4e4158aa0 2024-08-17T02:26:38.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7f9935000640 1 -- 172.21.15.6:0/3176477519 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9930159320 msgr2=0x7f993006d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7f9935000640 1 --2- 172.21.15.6:0/3176477519 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9930159320 0x7f993006d7d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9928009bd0 tx=0x7f992802ed40 comp rx=0 tx=0).stop 2024-08-17T02:26:38.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7fa4e1600640 1 -- 172.21.15.6:0/2846190649 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40327e0 con 0x7fa4e4158aa0 2024-08-17T02:26:38.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7fddd4200640 1 -- start start 2024-08-17T02:26:38.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7f9935000640 1 -- 172.21.15.6:0/3176477519 shutdown_connections 2024-08-17T02:26:38.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7f9935000640 1 --2- 172.21.15.6:0/3176477519 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9930159320 0x7f993006d7d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7f9935000640 1 --2- 172.21.15.6:0/3176477519 >> v2:172.21.15.6:3300/0 conn(0x7f9930154a80 0x7f99300abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7f9935000640 1 -- 172.21.15.6:0/3176477519 >> 172.21.15.6:0/3176477519 conn(0x7f9930066e60 msgr2=0x7f9930067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7f9935000640 1 -- 172.21.15.6:0/3176477519 shutdown_connections 2024-08-17T02:26:38.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7f637b400640 1 --2- 172.21.15.6:0/4130343666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63840cca30 0x7f63840cfc10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f63840cd790 tx=0x7f636c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c700be82ea7723 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7fa4e9a00640 1 -- 172.21.15.6:0/2846190649 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e4158aa0 msgr2=0x7fa4e406d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7fa4e9a00640 1 --2- 172.21.15.6:0/2846190649 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e4158aa0 0x7fa4e406d7d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009910 tx=0x7fa4d40091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7f9935000640 1 -- 172.21.15.6:0/3176477519 wait complete. 2024-08-17T02:26:38.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.704+0000 7f6383400640 1 -- 172.21.15.6:0/4130343666 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c031400 con 0x7f63840cca30 2024-08-17T02:26:38.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.704+0000 7f6383400640 1 -- 172.21.15.6:0/4130343666 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636c02d050 con 0x7f63840cca30 2024-08-17T02:26:38.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.704+0000 7f6383400640 1 -- 172.21.15.6:0/4130343666 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c0317d0 con 0x7f63840cca30 2024-08-17T02:26:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.704+0000 7fa4e9a00640 1 -- 172.21.15.6:0/2846190649 shutdown_connections 2024-08-17T02:26:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.704+0000 7fa4e9a00640 1 --2- 172.21.15.6:0/2846190649 >> v2:172.21.15.6:3300/0 conn(0x7fa4e406dd10 0x7fa4e40a93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.704+0000 7fa4e9a00640 1 --2- 172.21.15.6:0/2846190649 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e4158aa0 0x7fa4e406d7d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.704+0000 7fa4e9a00640 1 -- 172.21.15.6:0/2846190649 >> 172.21.15.6:0/2846190649 conn(0x7fa4e4066e60 msgr2=0x7fa4e4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.705+0000 7fa4e9a00640 1 -- 172.21.15.6:0/2846190649 shutdown_connections 2024-08-17T02:26:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.705+0000 7fa4e9a00640 1 -- 172.21.15.6:0/2846190649 wait complete. 2024-08-17T02:26:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7f5eb0e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5ea40e22c0 0x7f5ea40e5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7f5eb0e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5ea4054340 0x7f5ea40e6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7f5eb0e00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea4058860 con 0x7f5ea40e1ef0 2024-08-17T02:26:38.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7f5eb0e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea4058cf0 con 0x7f5ea4054340 2024-08-17T02:26:38.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.703+0000 7f5eb0e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea4057c50 con 0x7f5ea40e22c0 2024-08-17T02:26:38.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.704+0000 7f5eab400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5ea40e1ef0 0x7f5ea4057420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38330/0 (socket says 172.21.15.6:38330) 2024-08-17T02:26:38.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.704+0000 7f5eab400640 1 -- 172.21.15.6:0/3725168217 learned_addr learned my addr 172.21.15.6:0/3725168217 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:38.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.704+0000 7f5eaaa00640 1 --2- 172.21.15.6:0/3725168217 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5ea40e22c0 0x7f5ea40e5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.705+0000 7f5eabe00640 1 --2- 172.21.15.6:0/3725168217 >> v2:172.21.15.136:3300/0 conn(0x7f5ea4054340 0x7f5ea40e6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.705+0000 7f5eaa000640 1 -- 172.21.15.6:0/3725168217 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556275761 0 0) 0x7f5ea4058860 con 0x7f5ea40e1ef0 2024-08-17T02:26:38.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.705+0000 7f5eaa000640 1 -- 172.21.15.6:0/3725168217 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e940034e0 con 0x7f5ea40e1ef0 2024-08-17T02:26:38.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.705+0000 7f5eaaa00640 1 -- 172.21.15.6:0/3725168217 >> v2:172.21.15.136:3300/0 conn(0x7f5ea4054340 msgr2=0x7f5ea40e6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.705+0000 7f5eaaa00640 1 --2- 172.21.15.6:0/3725168217 >> v2:172.21.15.136:3300/0 conn(0x7f5ea4054340 0x7f5ea40e6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.705+0000 7f5eaaa00640 1 -- 172.21.15.6:0/3725168217 >> v1:172.21.15.6:6789/0 conn(0x7f5ea40e1ef0 legacy=0x7f5ea4057420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.705+0000 7f5eaaa00640 1 -- 172.21.15.6:0/3725168217 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea4057f30 con 0x7f5ea40e22c0 2024-08-17T02:26:38.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.705+0000 7fddd4200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fddc4036c90 0x7fddc4037060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.705+0000 7fddd4200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddc4034ef0 0x7fddc40dd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.706+0000 7fddd4200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc40e1300 con 0x7fddc4035320 2024-08-17T02:26:38.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.706+0000 7fddd4200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc40e0500 con 0x7fddc4036c90 2024-08-17T02:26:38.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.706+0000 7fddd4200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40e06f0 con 0x7fddc4034ef0 2024-08-17T02:26:38.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.707+0000 7f638ae00640 1 -- 172.21.15.6:0/4130343666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63840cca30 msgr2=0x7f63840cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.706+0000 7f9935000640 1 Processor -- start 2024-08-17T02:26:38.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.706+0000 7f9935000640 1 -- start start 2024-08-17T02:26:38.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.706+0000 7fddd0e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddc4034ef0 0x7fddc40dd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.706+0000 7fddd1800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fddc4036c90 0x7fddc4037060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.707+0000 7f638ae00640 1 --2- 172.21.15.6:0/4130343666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63840cca30 0x7f63840cfc10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f63840cd790 tx=0x7f636c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.706+0000 7fddd0e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddc4034ef0 0x7fddc40dd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49404/0 (socket says 172.21.15.6:49404) 2024-08-17T02:26:38.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.706+0000 7fddd0e00640 1 -- 172.21.15.6:0/1374952100 learned_addr learned my addr 172.21.15.6:0/1374952100 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.707+0000 7fddd0e00640 1 -- 172.21.15.6:0/1374952100 >> v2:172.21.15.136:3300/0 conn(0x7fddc4036c90 msgr2=0x7fddc4037060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.707+0000 7fddd0e00640 1 --2- 172.21.15.6:0/1374952100 >> v2:172.21.15.136:3300/0 conn(0x7fddc4036c90 0x7fddc4037060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.707+0000 7fddd0e00640 1 -- 172.21.15.6:0/1374952100 >> v1:172.21.15.136:6789/0 conn(0x7fddc4035320 legacy=0x7fddc40e3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.707+0000 7fddd0e00640 1 -- 172.21.15.6:0/1374952100 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc40e09d0 con 0x7fddc4034ef0 2024-08-17T02:26:38.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.707+0000 7f2450400640 1 Processor -- start 2024-08-17T02:26:38.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.707+0000 7f2450400640 1 -- start start 2024-08-17T02:26:38.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7fa4e9a00640 1 Processor -- start 2024-08-17T02:26:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7f638ae00640 1 -- 172.21.15.6:0/4130343666 shutdown_connections 2024-08-17T02:26:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7f638ae00640 1 --2- 172.21.15.6:0/4130343666 >> v2:172.21.15.136:3300/0 conn(0x7f63840d0150 0x7f638415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7f638ae00640 1 --2- 172.21.15.6:0/4130343666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63840cca30 0x7f63840cfc10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7f638ae00640 1 --2- 172.21.15.6:0/4130343666 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f638414fe00 0x7f63840cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7f638ae00640 1 -- 172.21.15.6:0/4130343666 >> 172.21.15.6:0/4130343666 conn(0x7f6384068680 msgr2=0x7f6384068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7fa4e9a00640 1 -- start start 2024-08-17T02:26:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7f9935000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f993006dd10 0x7f9930147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7f9935000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9930154a80 0x7f99300cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7f9935000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9930159320 0x7f99300c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7f9935000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9930156a10 con 0x7f9930154a80 2024-08-17T02:26:38.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7f9935000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99300c9120 con 0x7f9930159320 2024-08-17T02:26:38.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7f9935000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99300c9400 con 0x7f993006dd10 2024-08-17T02:26:38.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7f5eaaa00640 1 --2- 172.21.15.6:0/3725168217 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5ea40e22c0 0x7f5ea40e5c20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009850 tx=0x7f5e980090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc161c962f081520 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7f1619000640 1 Processor -- start 2024-08-17T02:26:38.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7f638ae00640 1 -- 172.21.15.6:0/4130343666 shutdown_connections 2024-08-17T02:26:38.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7f992de00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f993006dd10 0x7f9930147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7fddd0e00640 1 --2- 172.21.15.6:0/1374952100 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddc4034ef0 0x7fddc40dd460 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009910 tx=0x7fddbc0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccce73ab58e194a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7f992de00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f993006dd10 0x7f9930147c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49406/0 (socket says 172.21.15.6:49406) 2024-08-17T02:26:38.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.709+0000 7f992de00640 1 -- 172.21.15.6:0/2505798793 learned_addr learned my addr 172.21.15.6:0/2505798793 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.709+0000 7f5eaa000640 1 -- 172.21.15.6:0/3725168217 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9802ad90 con 0x7f5ea40e22c0 2024-08-17T02:26:38.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.709+0000 7f5eaa000640 1 -- 172.21.15.6:0/3725168217 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e98032440 con 0x7f5ea40e22c0 2024-08-17T02:26:38.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.709+0000 7fddcbe00640 1 -- 172.21.15.6:0/1374952100 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc02adb0 con 0x7fddc4034ef0 2024-08-17T02:26:38.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.709+0000 7fddcbe00640 1 -- 172.21.15.6:0/1374952100 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc032440 con 0x7fddc4034ef0 2024-08-17T02:26:38.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.709+0000 7fddcbe00640 1 -- 172.21.15.6:0/1374952100 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc02adb0 con 0x7fddc4034ef0 2024-08-17T02:26:38.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.709+0000 7f992e800640 1 --2- 172.21.15.6:0/2505798793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9930159320 0x7f99300c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.709+0000 7f992d400640 1 --2- 172.21.15.6:0/2505798793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9930154a80 0x7f99300cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7f992d400640 1 -- 172.21.15.6:0/2505798793 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f993006dd10 msgr2=0x7f9930147c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.709+0000 7f2450400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2448158a20 0x7f24480a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.709+0000 7f2450400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24480ae860 0x7f244806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7f2450400640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24480aed90 con 0x7f2448158df0 2024-08-17T02:26:38.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7f2450400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24480af070 con 0x7f2448158a20 2024-08-17T02:26:38.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7f2450400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24480af350 con 0x7f24480ae860 2024-08-17T02:26:38.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7f5eb0e00640 1 -- 172.21.15.6:0/3725168217 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5ea40e22c0 msgr2=0x7f5ea40e5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7f5eb0e00640 1 --2- 172.21.15.6:0/3725168217 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5ea40e22c0 0x7f5ea40e5c20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009850 tx=0x7f5e980090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7fa4e9a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e406dd10 0x7fa4e40cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7fa4e9a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4e40a98f0 0x7fa4e4168cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7fa4e9a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4e4158aa0 0x7fa4e415d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7f992d400640 1 --2- 172.21.15.6:0/2505798793 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f993006dd10 0x7f9930147c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7fddd4200640 1 -- 172.21.15.6:0/1374952100 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddc4034ef0 msgr2=0x7fddc40dd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7fddd4200640 1 --2- 172.21.15.6:0/1374952100 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddc4034ef0 0x7fddc40dd460 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009910 tx=0x7fddbc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7f992d400640 1 -- 172.21.15.6:0/2505798793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9930159320 msgr2=0x7f99300c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7f992d400640 1 --2- 172.21.15.6:0/2505798793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9930159320 0x7f99300c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7f992d400640 1 -- 172.21.15.6:0/2505798793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9928009790 con 0x7f9930154a80 2024-08-17T02:26:38.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.709+0000 7f638ae00640 1 -- 172.21.15.6:0/4130343666 wait complete. 2024-08-17T02:26:38.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f638ae00640 1 Processor -- start 2024-08-17T02:26:38.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f5eb0e00640 1 -- 172.21.15.6:0/3725168217 shutdown_connections 2024-08-17T02:26:38.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f5eb0e00640 1 --2- 172.21.15.6:0/3725168217 >> v2:172.21.15.136:3300/0 conn(0x7f5ea4054340 0x7f5ea40e6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f5eb0e00640 1 --2- 172.21.15.6:0/3725168217 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5ea40e22c0 0x7f5ea40e5c20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f5eb0e00640 1 -- 172.21.15.6:0/3725168217 >> 172.21.15.6:0/3725168217 conn(0x7f5ea4055a10 msgr2=0x7f5ea4055e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7f244da00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2448158a20 0x7f24480a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f244e400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2448158df0 0x7f244815c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38342/0 (socket says 172.21.15.6:38342) 2024-08-17T02:26:38.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f244e400640 1 -- 172.21.15.6:0/2302869504 learned_addr learned my addr 172.21.15.6:0/2302869504 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:38.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f244d000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24480ae860 0x7f244806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.708+0000 7f1619000640 1 -- start start 2024-08-17T02:26:38.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7f1619000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f160c0d86d0 0x7f160c005e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f1619000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f160c04f1d0 0x7f160c0de700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f1619000640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160c053840 con 0x7f160c04fda0 2024-08-17T02:26:38.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f1619000640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160c0df740 con 0x7f160c0d86d0 2024-08-17T02:26:38.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f1619000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160c0dec40 con 0x7f160c04f1d0 2024-08-17T02:26:38.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f1612a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f160c04f1d0 0x7f160c0de700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f1612a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f160c04f1d0 0x7f160c0de700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:44116/0 (socket says 172.21.15.6:44116) 2024-08-17T02:26:38.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f1612a00640 1 -- 172.21.15.6:0/3929252780 learned_addr learned my addr 172.21.15.6:0/3929252780 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f638ae00640 1 -- start start 2024-08-17T02:26:38.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7fa4e2a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e406dd10 0x7fa4e40cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7fa4e3400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4e4158aa0 0x7fa4e415d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7fa4e3400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4e4158aa0 0x7fa4e415d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:44100/0 (socket says 172.21.15.6:44100) 2024-08-17T02:26:38.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7fa4e3400640 1 -- 172.21.15.6:0/593673089 learned_addr learned my addr 172.21.15.6:0/593673089 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.710+0000 7fa4e9a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e40ac230 con 0x7fa4e40a98f0 2024-08-17T02:26:38.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7fa4e9a00640 1 -- 172.21.15.6:0/593673089 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e40ab660 con 0x7fa4e4158aa0 2024-08-17T02:26:38.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7fa4e9a00640 1 -- 172.21.15.6:0/593673089 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e40ab900 con 0x7fa4e406dd10 2024-08-17T02:26:38.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f992d400640 1 --2- 172.21.15.6:0/2505798793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9930154a80 0x7f99300cb550 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9928036000 tx=0x7f992803a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7fddd4200640 1 -- 172.21.15.6:0/1374952100 shutdown_connections 2024-08-17T02:26:38.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7fddd4200640 1 --2- 172.21.15.6:0/1374952100 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddc4034ef0 0x7fddc40dd460 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7fddd4200640 1 --2- 172.21.15.6:0/1374952100 >> v2:172.21.15.136:3300/0 conn(0x7fddc4036c90 0x7fddc4037060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7fddd4200640 1 -- 172.21.15.6:0/1374952100 >> 172.21.15.6:0/1374952100 conn(0x7fddc4054b90 msgr2=0x7fddc4054f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f1612a00640 1 -- 172.21.15.6:0/3929252780 >> v2:172.21.15.6:3300/0 conn(0x7f160c0d86d0 msgr2=0x7f160c005e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f1612a00640 1 --2- 172.21.15.6:0/3929252780 >> v2:172.21.15.6:3300/0 conn(0x7f160c0d86d0 0x7f160c005e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7f1612a00640 1 -- 172.21.15.6:0/3929252780 >> v1:172.21.15.6:6789/0 conn(0x7f160c04fda0 legacy=0x7f160c0501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.712+0000 7f1612a00640 1 -- 172.21.15.6:0/3929252780 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c053380 con 0x7f160c04f1d0 2024-08-17T02:26:38.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.712+0000 7f244d000640 1 -- 172.21.15.6:0/2302869504 >> v2:172.21.15.136:3300/0 conn(0x7f2448158a20 msgr2=0x7f24480a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.712+0000 7f244d000640 1 --2- 172.21.15.6:0/2302869504 >> v2:172.21.15.136:3300/0 conn(0x7f2448158a20 0x7f24480a89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.712+0000 7fa4e3400640 1 -- 172.21.15.6:0/593673089 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e406dd10 msgr2=0x7fa4e40cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.712+0000 7fa4e3400640 1 --2- 172.21.15.6:0/593673089 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e406dd10 0x7fa4e40cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.712+0000 7f244d000640 1 -- 172.21.15.6:0/2302869504 >> v1:172.21.15.6:6789/0 conn(0x7f2448158df0 legacy=0x7f244815c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.712+0000 7fa4e3400640 1 -- 172.21.15.6:0/593673089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4e40a98f0 msgr2=0x7fa4e4168cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.712+0000 7fddd4200640 1 -- 172.21.15.6:0/1374952100 shutdown_connections 2024-08-17T02:26:38.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.712+0000 7fa4e2a00640 1 --2- 172.21.15.6:0/593673089 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e406dd10 0x7fa4e40cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:38.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.712+0000 7fddd4200640 1 -- 172.21.15.6:0/1374952100 wait complete. 2024-08-17T02:26:38.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.711+0000 7fa4e2000640 1 --2- 172.21.15.6:0/593673089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4e40a98f0 0x7fa4e4168cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.712+0000 7f9126c00640 1 Processor -- start 2024-08-17T02:26:38.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7f638ae00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63840cca30 0x7f638414cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.712+0000 7fa4e3400640 1 --2- 172.21.15.6:0/593673089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4e40a98f0 0x7fa4e4168cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7fa4e3400640 1 -- 172.21.15.6:0/593673089 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d0009390 con 0x7fa4e4158aa0 2024-08-17T02:26:38.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7fa4e2000640 1 --2- 172.21.15.6:0/593673089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4e40a98f0 0x7fa4e4168cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:38.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7fa4e3400640 1 --2- 172.21.15.6:0/593673089 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4e4158aa0 0x7fa4e415d260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00c860 tx=0x7fa4dc001690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.712+0000 7f9925600640 1 -- 172.21.15.6:0/2505798793 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9928045070 con 0x7f9930154a80 2024-08-17T02:26:38.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7f9925600640 1 -- 172.21.15.6:0/2505798793 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9928014130 con 0x7f9930154a80 2024-08-17T02:26:38.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7f9925600640 1 -- 172.21.15.6:0/2505798793 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9928014550 con 0x7f9930154a80 2024-08-17T02:26:38.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.712+0000 7f244d000640 1 -- 172.21.15.6:0/2302869504 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24480af630 con 0x7f24480ae860 2024-08-17T02:26:38.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7f244da00640 1 --2- 172.21.15.6:0/2302869504 >> v2:172.21.15.136:3300/0 conn(0x7f2448158a20 0x7f24480a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:38.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7f9935000640 1 -- 172.21.15.6:0/2505798793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99300c96e0 con 0x7f9930154a80 2024-08-17T02:26:38.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7f9935000640 1 -- 172.21.15.6:0/2505798793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99300cba90 con 0x7f9930154a80 2024-08-17T02:26:38.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7f638ae00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63840d0150 0x7f638414ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7f638ae00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f638414fe00 0x7f6384144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7f638ae00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63840c89d0 con 0x7f63840cca30 2024-08-17T02:26:38.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7f638ae00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638414d720 con 0x7f638414fe00 2024-08-17T02:26:38.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7f638ae00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638414f340 con 0x7f63840d0150 2024-08-17T02:26:38.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7fa4da000640 1 -- 172.21.15.6:0/593673089 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc00ce50 con 0x7fa4e4158aa0 2024-08-17T02:26:38.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.714+0000 7fa4da000640 1 -- 172.21.15.6:0/593673089 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc00a850 con 0x7fa4e4158aa0 2024-08-17T02:26:38.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.714+0000 7fa4da000640 1 -- 172.21.15.6:0/593673089 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc00ac10 con 0x7fa4e4158aa0 2024-08-17T02:26:38.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7f9126c00640 1 -- start start 2024-08-17T02:26:38.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7f5eb0e00640 1 -- 172.21.15.6:0/3725168217 shutdown_connections 2024-08-17T02:26:38.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.713+0000 7f5eb0e00640 1 -- 172.21.15.6:0/3725168217 wait complete. 2024-08-17T02:26:38.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.714+0000 7f6383e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63840cca30 0x7f638414cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.714+0000 7f6388e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f638414fe00 0x7f6384144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.714+0000 7f6383e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63840cca30 0x7f638414cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57048/0 (socket says 172.21.15.6:57048) 2024-08-17T02:26:38.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.714+0000 7f1612a00640 1 --2- 172.21.15.6:0/3929252780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f160c04f1d0 0x7f160c0de700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f160c03ab90 tx=0x7f160400abf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1779c5031903d599 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.714+0000 7f6383e00640 1 -- 172.21.15.6:0/2651943559 learned_addr learned my addr 172.21.15.6:0/2651943559 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.714+0000 7f637b400640 1 --2- 172.21.15.6:0/2651943559 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63840d0150 0x7f638414ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.714+0000 7fa4e9a00640 1 -- 172.21.15.6:0/593673089 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d4009450 con 0x7fa4e4158aa0 2024-08-17T02:26:38.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.714+0000 7fa4e9a00640 1 -- 172.21.15.6:0/593673089 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e40abec0 con 0x7fa4e4158aa0 2024-08-17T02:26:38.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.715+0000 7f244d000640 1 --2- 172.21.15.6:0/2302869504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24480ae860 0x7f244806d7d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2440009e60 tx=0x7f2440009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15350650c38f9dd2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.715+0000 7f1612000640 1 -- 172.21.15.6:0/3929252780 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160402bd70 con 0x7f160c04f1d0 2024-08-17T02:26:38.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.715+0000 7f1612000640 1 -- 172.21.15.6:0/3929252780 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16040089e0 con 0x7f160c04f1d0 2024-08-17T02:26:38.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.715+0000 7f1612000640 1 -- 172.21.15.6:0/3929252780 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1604008dc0 con 0x7f160c04f1d0 2024-08-17T02:26:38.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.715+0000 7f6383e00640 1 -- 172.21.15.6:0/2651943559 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63840d0150 msgr2=0x7f638414ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.715+0000 7fa4e9a00640 1 -- 172.21.15.6:0/593673089 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e40ac3a0 con 0x7fa4e4158aa0 2024-08-17T02:26:38.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.715+0000 7f2447e00640 1 -- 172.21.15.6:0/2302869504 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440007550 con 0x7f24480ae860 2024-08-17T02:26:38.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.715+0000 7f2447e00640 1 -- 172.21.15.6:0/2302869504 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244002d050 con 0x7f24480ae860 2024-08-17T02:26:38.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.716+0000 7f2447e00640 1 -- 172.21.15.6:0/2302869504 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440007920 con 0x7f24480ae860 2024-08-17T02:26:38.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.716+0000 7f2450400640 1 -- 172.21.15.6:0/2302869504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24480ae860 msgr2=0x7f244806d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.715+0000 7f9935000640 1 -- 172.21.15.6:0/2505798793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9930063fb0 con 0x7f9930154a80 2024-08-17T02:26:38.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.715+0000 7f5eb0e00640 1 Processor -- start 2024-08-17T02:26:38.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.716+0000 7f2450400640 1 --2- 172.21.15.6:0/2302869504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24480ae860 0x7f244806d7d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2440009e60 tx=0x7f2440009780 comp rx=0 tx=0).stop 2024-08-17T02:26:38.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.716+0000 7f1619000640 1 -- 172.21.15.6:0/3929252780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f160c04f1d0 msgr2=0x7f160c0de700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.716+0000 7f1619000640 1 --2- 172.21.15.6:0/3929252780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f160c04f1d0 0x7f160c0de700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f160c03ab90 tx=0x7f160400abf0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.715+0000 7f6383e00640 1 --2- 172.21.15.6:0/2651943559 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63840d0150 0x7f638414ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.715+0000 7f6383e00640 1 -- 172.21.15.6:0/2651943559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f638414fe00 msgr2=0x7f6384144a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.715+0000 7f6383e00640 1 --2- 172.21.15.6:0/2651943559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f638414fe00 0x7f6384144a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.715+0000 7f6383e00640 1 -- 172.21.15.6:0/2651943559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c009450 con 0x7f63840cca30 2024-08-17T02:26:38.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.716+0000 7f6383e00640 1 --2- 172.21.15.6:0/2651943559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63840cca30 0x7f638414cdf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6374009f20 tx=0x7f637400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.716+0000 7f637be00640 1 -- 172.21.15.6:0/2651943559 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637400cdb0 con 0x7f63840cca30 2024-08-17T02:26:38.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.716+0000 7f637be00640 1 -- 172.21.15.6:0/2651943559 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637400f040 con 0x7f63840cca30 2024-08-17T02:26:38.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.716+0000 7f637be00640 1 -- 172.21.15.6:0/2651943559 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63740146b0 con 0x7f63840cca30 2024-08-17T02:26:38.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.716+0000 7f638ae00640 1 -- 172.21.15.6:0/2651943559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63840c9200 con 0x7f63840cca30 2024-08-17T02:26:38.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.716+0000 7f638ae00640 1 -- 172.21.15.6:0/2651943559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63840c8e90 con 0x7f63840cca30 2024-08-17T02:26:38.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.714+0000 7fddd4200640 1 Processor -- start 2024-08-17T02:26:38.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.714+0000 7fddd4200640 1 -- start start 2024-08-17T02:26:38.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.716+0000 7fddd4200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddc4034ef0 0x7fddc40d5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.716+0000 7fddd4200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddc4035320 0x7fddc40e9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.716+0000 7fddd4200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddc4036c90 0x7fddc40d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.717+0000 7fddd4200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40d1870 con 0x7fddc4036c90 2024-08-17T02:26:38.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.717+0000 7fddd4200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40df200 con 0x7fddc4035320 2024-08-17T02:26:38.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.717+0000 7fddd4200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40df4b0 con 0x7fddc4034ef0 2024-08-17T02:26:38.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.717+0000 7fddd0e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddc4035320 0x7fddc40e9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.717+0000 7fddd1800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddc4034ef0 0x7fddc40d5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.717+0000 7fddd2200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddc4036c90 0x7fddc40d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.718+0000 7f5eb0e00640 1 -- start start 2024-08-17T02:26:38.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.717+0000 7f2450400640 1 -- 172.21.15.6:0/2302869504 shutdown_connections 2024-08-17T02:26:38.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.717+0000 7fddd2200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddc4036c90 0x7fddc40d0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57062/0 (socket says 172.21.15.6:57062) 2024-08-17T02:26:38.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.717+0000 7fddd2200640 1 -- 172.21.15.6:0/2553696748 learned_addr learned my addr 172.21.15.6:0/2553696748 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.717+0000 7fddd1800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddc4034ef0 0x7fddc40d5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49440/0 (socket says 172.21.15.6:49440) 2024-08-17T02:26:38.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.717+0000 7f2450400640 1 --2- 172.21.15.6:0/2302869504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24480ae860 0x7f244806d7d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.717+0000 7f2450400640 1 --2- 172.21.15.6:0/2302869504 >> v2:172.21.15.136:3300/0 conn(0x7f2448158a20 0x7f24480a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.717+0000 7f2450400640 1 -- 172.21.15.6:0/2302869504 >> 172.21.15.6:0/2302869504 conn(0x7f2448066e60 msgr2=0x7f2448067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.718+0000 7f2450400640 1 -- 172.21.15.6:0/2302869504 shutdown_connections 2024-08-17T02:26:38.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.718+0000 7f2450400640 1 -- 172.21.15.6:0/2302869504 wait complete. 2024-08-17T02:26:38.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.718+0000 7f638ae00640 1 -- 172.21.15.6:0/2651943559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f635c005210 con 0x7f63840cca30 2024-08-17T02:26:38.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.718+0000 7fa4da000640 1 -- 172.21.15.6:0/593673089 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa4dc012630 con 0x7fa4e4158aa0 2024-08-17T02:26:38.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.718+0000 7f1619000640 1 -- 172.21.15.6:0/3929252780 shutdown_connections 2024-08-17T02:26:38.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.718+0000 7f1619000640 1 --2- 172.21.15.6:0/3929252780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f160c04f1d0 0x7f160c0de700 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.719+0000 7f1619000640 1 --2- 172.21.15.6:0/3929252780 >> v2:172.21.15.6:3300/0 conn(0x7f160c0d86d0 0x7f160c005e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.719+0000 7f1619000640 1 -- 172.21.15.6:0/3929252780 >> 172.21.15.6:0/3929252780 conn(0x7f160c051600 msgr2=0x7f160c051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.718+0000 7fddd2200640 1 -- 172.21.15.6:0/2553696748 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddc4034ef0 msgr2=0x7fddc40d5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.718+0000 7fddd2200640 1 --2- 172.21.15.6:0/2553696748 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddc4034ef0 0x7fddc40d5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.718+0000 7fddd2200640 1 -- 172.21.15.6:0/2553696748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddc4035320 msgr2=0x7fddc40e9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.718+0000 7fddd2200640 1 --2- 172.21.15.6:0/2553696748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddc4035320 0x7fddc40e9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.718+0000 7fddd2200640 1 -- 172.21.15.6:0/2553696748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc009450 con 0x7fddc4036c90 2024-08-17T02:26:38.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.718+0000 7f9925600640 1 -- 172.21.15.6:0/2505798793 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9928010740 con 0x7f9930154a80 2024-08-17T02:26:38.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.719+0000 7f1619000640 1 -- 172.21.15.6:0/3929252780 shutdown_connections 2024-08-17T02:26:38.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.719+0000 7f1619000640 1 -- 172.21.15.6:0/3929252780 wait complete. 2024-08-17T02:26:38.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.719+0000 7fddd2200640 1 --2- 172.21.15.6:0/2553696748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddc4036c90 0x7fddc40d0a60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fddc000c4e0 tx=0x7fddc0007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.719+0000 7f5eb0e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ea4054340 0x7f5ea40c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.719+0000 7f5eb0e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea40e1ef0 0x7f5ea400a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.719+0000 7f5eb0e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5ea40e22c0 0x7f5ea403df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.719+0000 7f5eaaa00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea40e1ef0 0x7f5ea400a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.719+0000 7f5eb0e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea40521f0 con 0x7f5ea4054340 2024-08-17T02:26:38.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f5eabe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5ea40e22c0 0x7f5ea403df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f5eabe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5ea40e22c0 0x7f5ea403df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49454/0 (socket says 172.21.15.6:49454) 2024-08-17T02:26:38.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f5eabe00640 1 -- 172.21.15.6:0/2847073290 learned_addr learned my addr 172.21.15.6:0/2847073290 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.719+0000 7f5eb0e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea4050280 con 0x7f5ea40e1ef0 2024-08-17T02:26:38.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f5eb0e00640 1 -- 172.21.15.6:0/2847073290 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea4051950 con 0x7f5ea40e22c0 2024-08-17T02:26:38.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f5eab400640 1 --2- 172.21.15.6:0/2847073290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ea4054340 0x7f5ea40c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7fa4da000640 1 --2- 172.21.15.6:0/593673089 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa4c40652a0 0x7fa4c4067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f5eabe00640 1 -- 172.21.15.6:0/2847073290 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea40e1ef0 msgr2=0x7f5ea400a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f5eabe00640 1 --2- 172.21.15.6:0/2847073290 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea40e1ef0 0x7f5ea400a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f9126c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f91180e1d60 0x7f91180e2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f9126c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9118054080 0x7f91180544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f9126c00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f911800fbb0 0x7f9118010030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7fa4da000640 1 -- 172.21.15.6:0/593673089 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4dc082610 con 0x7fa4e4158aa0 2024-08-17T02:26:38.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f9925600640 1 --2- 172.21.15.6:0/2505798793 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f99100651d0 0x7f9910067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f9126c00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9118010570 con 0x7f911800fbb0 2024-08-17T02:26:38.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f9126c00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9118058590 con 0x7f91180e1d60 2024-08-17T02:26:38.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f9126c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9118057980 con 0x7f9118054080 2024-08-17T02:26:38.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.721+0000 7f9925600640 1 -- 172.21.15.6:0/2505798793 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f99280a3ad0 con 0x7f9930154a80 2024-08-17T02:26:38.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f5eabe00640 1 -- 172.21.15.6:0/2847073290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ea4054340 msgr2=0x7f5ea40c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f5eabe00640 1 --2- 172.21.15.6:0/2847073290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ea4054340 0x7f5ea40c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.721+0000 7f5eabe00640 1 -- 172.21.15.6:0/2847073290 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e98009390 con 0x7f5ea40e22c0 2024-08-17T02:26:38.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.721+0000 7f9124e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9118054080 0x7f91180544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f2450400640 1 Processor -- start 2024-08-17T02:26:38.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.720+0000 7f2450400640 1 -- start start 2024-08-17T02:26:38.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.721+0000 7f9124e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9118054080 0x7f91180544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49458/0 (socket says 172.21.15.6:49458) 2024-08-17T02:26:38.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.721+0000 7f9124e00640 1 -- 172.21.15.6:0/655516551 learned_addr learned my addr 172.21.15.6:0/655516551 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.721+0000 7f9126200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f911800fbb0 0x7f9118010030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.721+0000 7f5eab400640 1 --2- 172.21.15.6:0/2847073290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ea4054340 0x7f5ea40c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:38.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.721+0000 7f5eabe00640 1 --2- 172.21.15.6:0/2847073290 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5ea40e22c0 0x7f5ea403df60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0659e0 tx=0x7f5eac088040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.721+0000 7f9125800640 1 --2- 172.21.15.6:0/655516551 >> v2:172.21.15.136:3300/0 conn(0x7f91180e1d60 0x7f91180e2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.721+0000 7f992de00640 1 --2- 172.21.15.6:0/2505798793 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f99100651d0 0x7f9910067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.722+0000 7f9126200640 1 -- 172.21.15.6:0/655516551 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9118054080 msgr2=0x7f91180544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.722+0000 7f5e9ea00640 1 -- 172.21.15.6:0/2847073290 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac0706c0 con 0x7f5ea40e22c0 2024-08-17T02:26:38.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.721+0000 7f1619000640 1 Processor -- start 2024-08-17T02:26:38.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.721+0000 7f1619000640 1 -- start start 2024-08-17T02:26:38.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.722+0000 7f5e9ea00640 1 -- 172.21.15.6:0/2847073290 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac070820 con 0x7f5ea40e22c0 2024-08-17T02:26:38.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.722+0000 7f5eb0e00640 1 -- 172.21.15.6:0/2847073290 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea4051c30 con 0x7f5ea40e22c0 2024-08-17T02:26:38.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.722+0000 7f5e9ea00640 1 -- 172.21.15.6:0/2847073290 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac08e400 con 0x7f5ea40e22c0 2024-08-17T02:26:38.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.722+0000 7f9126200640 1 --2- 172.21.15.6:0/655516551 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9118054080 0x7f91180544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.722+0000 7f9126200640 1 -- 172.21.15.6:0/655516551 >> v2:172.21.15.136:3300/0 conn(0x7f91180e1d60 msgr2=0x7f91180e2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.722+0000 7f5eb0e00640 1 -- 172.21.15.6:0/2847073290 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea40515e0 con 0x7f5ea40e22c0 2024-08-17T02:26:38.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.722+0000 7f9126200640 1 --2- 172.21.15.6:0/655516551 >> v2:172.21.15.136:3300/0 conn(0x7f91180e1d60 0x7f91180e2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.722+0000 7f9126200640 1 -- 172.21.15.6:0/655516551 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9118057c60 con 0x7f911800fbb0 2024-08-17T02:26:38.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.722+0000 7f9125800640 1 --2- 172.21.15.6:0/655516551 >> v2:172.21.15.136:3300/0 conn(0x7f91180e1d60 0x7f91180e2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:38.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.721+0000 7fa4e2a00640 1 --2- 172.21.15.6:0/593673089 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa4c40652a0 0x7fa4c4067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.722+0000 7f2450400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24480ae860 0x7f2448157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.722+0000 7f2450400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2448158a20 0x7f24480acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.722+0000 7f2450400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2448158df0 0x7f24480ad320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.722+0000 7f2450400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2448148b90 con 0x7f2448158a20 2024-08-17T02:26:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.722+0000 7f2450400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2448146e60 con 0x7f24480ae860 2024-08-17T02:26:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.722+0000 7f2450400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24481470b0 con 0x7f2448158df0 2024-08-17T02:26:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.723+0000 7f244da00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24480ae860 0x7f2448157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.723+0000 7f244da00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24480ae860 0x7f2448157260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:44156/0 (socket says 172.21.15.6:44156) 2024-08-17T02:26:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.723+0000 7f244da00640 1 -- 172.21.15.6:0/496880079 learned_addr learned my addr 172.21.15.6:0/496880079 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.723+0000 7f244d000640 1 --2- 172.21.15.6:0/496880079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2448158a20 0x7f24480acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.723+0000 7f244da00640 1 -- 172.21.15.6:0/496880079 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2448158df0 msgr2=0x7f24480ad320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.723+0000 7f244da00640 1 --2- 172.21.15.6:0/496880079 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2448158df0 0x7f24480ad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.723+0000 7fa4e2a00640 1 --2- 172.21.15.6:0/593673089 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa4c40652a0 0x7fa4c4067750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4034000 tx=0x7fa4d4032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.723+0000 7f992de00640 1 --2- 172.21.15.6:0/2505798793 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f99100651d0 0x7f9910067680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9920006a70 tx=0x7f9920008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.723+0000 7f244da00640 1 -- 172.21.15.6:0/496880079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2448158a20 msgr2=0x7f24480acde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.723+0000 7f244da00640 1 --2- 172.21.15.6:0/496880079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2448158a20 0x7f24480acde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.723+0000 7f244da00640 1 -- 172.21.15.6:0/496880079 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c009390 con 0x7f24480ae860 2024-08-17T02:26:38.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.723+0000 7f244d000640 1 --2- 172.21.15.6:0/496880079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2448158a20 0x7f24480acde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:38.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.724+0000 7f244da00640 1 --2- 172.21.15.6:0/496880079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24480ae860 0x7f2448157260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f243c00ec80 tx=0x7f243c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.724+0000 7f9126200640 1 --2- 172.21.15.6:0/655516551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f911800fbb0 0x7f9118010030 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9118011a60 tx=0x7f91140090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c611465c1b7c9f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.724+0000 7f1619000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f160c04f1d0 0x7f160c0d5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.724+0000 7f1619000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160c04fda0 0x7f160c036ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.724+0000 7f1619000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f160c0d86d0 0x7f160c035de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.724+0000 7f9925600640 1 -- 172.21.15.6:0/2505798793 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9928071c30 con 0x7f9930154a80 2024-08-17T02:26:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.724+0000 7f5e9ea00640 1 -- 172.21.15.6:0/2847073290 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5eac0973b0 con 0x7f5ea40e22c0 2024-08-17T02:26:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.725+0000 7fddc8c00640 1 -- 172.21.15.6:0/2553696748 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0012630 con 0x7fddc4036c90 2024-08-17T02:26:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.724+0000 7f1619000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c038990 con 0x7f160c04fda0 2024-08-17T02:26:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.724+0000 7f1619000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c03a310 con 0x7f160c04f1d0 2024-08-17T02:26:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.724+0000 7f1619000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c03a5f0 con 0x7f160c0d86d0 2024-08-17T02:26:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.725+0000 7f1613400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f160c04f1d0 0x7f160c0d5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.725+0000 7f2444c00640 1 -- 172.21.15.6:0/496880079 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c00eec0 con 0x7f24480ae860 2024-08-17T02:26:38.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.725+0000 7fddd4200640 1 -- 172.21.15.6:0/2553696748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc40df7f0 con 0x7fddc4036c90 2024-08-17T02:26:38.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.725+0000 7fddd4200640 1 -- 172.21.15.6:0/2553696748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc40d5b70 con 0x7fddc4036c90 2024-08-17T02:26:38.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.725+0000 7fddc8c00640 1 -- 172.21.15.6:0/2553696748 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc0012790 con 0x7fddc4036c90 2024-08-17T02:26:38.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.725+0000 7fddc8c00640 1 -- 172.21.15.6:0/2553696748 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0012630 con 0x7fddc4036c90 2024-08-17T02:26:38.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.725+0000 7f1613400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f160c04f1d0 0x7f160c0d5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:44170/0 (socket says 172.21.15.6:44170) 2024-08-17T02:26:38.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.725+0000 7f1613400640 1 -- 172.21.15.6:0/1510061871 learned_addr learned my addr 172.21.15.6:0/1510061871 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.725+0000 7fa4da000640 1 -- 172.21.15.6:0/593673089 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa4dc0506b0 con 0x7fa4e4158aa0 2024-08-17T02:26:38.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.725+0000 7f2444c00640 1 -- 172.21.15.6:0/496880079 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c00cbc0 con 0x7f24480ae860 2024-08-17T02:26:38.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.725+0000 7f2444c00640 1 -- 172.21.15.6:0/496880079 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c013470 con 0x7f24480ae860 2024-08-17T02:26:38.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.725+0000 7f1613e00640 1 --2- 172.21.15.6:0/1510061871 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f160c0d86d0 0x7f160c035de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.725+0000 7f1612a00640 1 --2- 172.21.15.6:0/1510061871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160c04fda0 0x7f160c036ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.726+0000 7f1612a00640 1 -- 172.21.15.6:0/1510061871 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f160c0d86d0 msgr2=0x7f160c035de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.726+0000 7f1612a00640 1 --2- 172.21.15.6:0/1510061871 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f160c0d86d0 0x7f160c035de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.726+0000 7f1612a00640 1 -- 172.21.15.6:0/1510061871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f160c04f1d0 msgr2=0x7f160c0d5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.726+0000 7f1612a00640 1 --2- 172.21.15.6:0/1510061871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f160c04f1d0 0x7f160c0d5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.726+0000 7f1612a00640 1 -- 172.21.15.6:0/1510061871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1604007040 con 0x7f160c04fda0 2024-08-17T02:26:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.726+0000 7fddd4200640 1 -- 172.21.15.6:0/2553696748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda8005210 con 0x7fddc4036c90 2024-08-17T02:26:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.726+0000 7f5e9ea00640 1 --2- 172.21.15.6:0/2847073290 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5e8c0652a0 0x7f5e8c067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.726+0000 7f5e9ea00640 1 -- 172.21.15.6:0/2847073290 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5eac0f8960 con 0x7f5ea40e22c0 2024-08-17T02:26:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.726+0000 7f5eab400640 1 --2- 172.21.15.6:0/2847073290 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5e8c0652a0 0x7f5e8c067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.727+0000 7f5eb0e00640 1 -- 172.21.15.6:0/2847073290 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea4050050 con 0x7f5ea40e22c0 2024-08-17T02:26:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.727+0000 7f5eab400640 1 --2- 172.21.15.6:0/2847073290 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5e8c0652a0 0x7f5e8c067750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0005840 tx=0x7f5ea0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.726+0000 7f911fe00640 1 -- 172.21.15.6:0/655516551 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911402ad00 con 0x7f911800fbb0 2024-08-17T02:26:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.727+0000 7f911fe00640 1 -- 172.21.15.6:0/655516551 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911402ae60 con 0x7f911800fbb0 2024-08-17T02:26:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.727+0000 7f911fe00640 1 -- 172.21.15.6:0/655516551 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9114032670 con 0x7f911800fbb0 2024-08-17T02:26:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.728+0000 7f9126c00640 1 -- 172.21.15.6:0/655516551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f911800fbb0 msgr2=0x7f9118010030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.728+0000 7f9126c00640 1 --2- 172.21.15.6:0/655516551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f911800fbb0 0x7f9118010030 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9118011a60 tx=0x7f91140090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.727+0000 7f1612a00640 1 --2- 172.21.15.6:0/1510061871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160c04fda0 0x7f160c036ea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1604031000 tx=0x7f1604035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.726+0000 7f2450400640 1 -- 172.21.15.6:0/496880079 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2440009a20 con 0x7f24480ae860 2024-08-17T02:26:38.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.726+0000 7f2450400640 1 -- 172.21.15.6:0/496880079 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2448147670 con 0x7f24480ae860 2024-08-17T02:26:38.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.728+0000 7f637be00640 1 -- 172.21.15.6:0/2651943559 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6374014a20 con 0x7f63840cca30 2024-08-17T02:26:38.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.730+0000 7f2450400640 1 -- 172.21.15.6:0/496880079 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2424005210 con 0x7f24480ae860 2024-08-17T02:26:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.730+0000 7f637be00640 1 --2- 172.21.15.6:0/2651943559 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6360065220 0x7f63600676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.730+0000 7f637be00640 1 -- 172.21.15.6:0/2651943559 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6374083510 con 0x7f63840cca30 2024-08-17T02:26:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.730+0000 7f9126c00640 1 -- 172.21.15.6:0/655516551 shutdown_connections 2024-08-17T02:26:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.730+0000 7f9126c00640 1 --2- 172.21.15.6:0/655516551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f911800fbb0 0x7f9118010030 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.730+0000 7f9126c00640 1 --2- 172.21.15.6:0/655516551 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9118054080 0x7f91180544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.730+0000 7f9126c00640 1 --2- 172.21.15.6:0/655516551 >> v2:172.21.15.136:3300/0 conn(0x7f91180e1d60 0x7f91180e2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.730+0000 7f9126c00640 1 -- 172.21.15.6:0/655516551 >> 172.21.15.6:0/655516551 conn(0x7f9118059a20 msgr2=0x7f9118006ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.731+0000 7f9126c00640 1 -- 172.21.15.6:0/655516551 shutdown_connections 2024-08-17T02:26:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.731+0000 7f637b400640 1 --2- 172.21.15.6:0/2651943559 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6360065220 0x7f63600676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.731+0000 7f9126c00640 1 -- 172.21.15.6:0/655516551 wait complete. 2024-08-17T02:26:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.731+0000 7f637b400640 1 --2- 172.21.15.6:0/2651943559 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6360065220 0x7f63600676d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f636c034000 tx=0x7f636c035000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.732+0000 7f2444c00640 1 -- 172.21.15.6:0/496880079 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f243c0137e0 con 0x7f24480ae860 2024-08-17T02:26:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.733+0000 7f9126c00640 1 Processor -- start 2024-08-17T02:26:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.733+0000 7f637be00640 1 -- 172.21.15.6:0/2651943559 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f63740516e0 con 0x7f63840cca30 2024-08-17T02:26:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.733+0000 7f5e9ea00640 1 -- 172.21.15.6:0/2847073290 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5ea4050050 con 0x7f5ea40e22c0 2024-08-17T02:26:38.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.733+0000 7f9126c00640 1 -- start start 2024-08-17T02:26:38.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.733+0000 7f1602a00640 1 -- 172.21.15.6:0/1510061871 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160400a4f0 con 0x7f160c04fda0 2024-08-17T02:26:38.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.733+0000 7f1602a00640 1 -- 172.21.15.6:0/1510061871 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160400a670 con 0x7f160c04fda0 2024-08-17T02:26:38.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.734+0000 7f1602a00640 1 -- 172.21.15.6:0/1510061871 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1604008040 con 0x7f160c04fda0 2024-08-17T02:26:38.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.735+0000 7f2444c00640 1 --2- 172.21.15.6:0/496880079 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f24280652a0 0x7f2428067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.735+0000 7f9126c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f911800fbb0 0x7f91180d6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.735+0000 7f9126c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9118054080 0x7f91180d8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.735+0000 7f2444c00640 1 -- 172.21.15.6:0/496880079 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f243c082840 con 0x7f24480ae860 2024-08-17T02:26:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.735+0000 7f1619000640 1 -- 172.21.15.6:0/1510061871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160c038620 con 0x7f160c04fda0 2024-08-17T02:26:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.735+0000 7f1619000640 1 -- 172.21.15.6:0/1510061871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160c0382e0 con 0x7f160c04fda0 2024-08-17T02:26:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.735+0000 7f9126c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91180e1d60 0x7f9118050070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.735+0000 7f9126c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91180daa50 con 0x7f91180e1d60 2024-08-17T02:26:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.735+0000 7f9126c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91180d7320 con 0x7f9118054080 2024-08-17T02:26:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.735+0000 7f9126c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91180f7740 con 0x7f911800fbb0 2024-08-17T02:26:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.736+0000 7f244d000640 1 --2- 172.21.15.6:0/496880079 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f24280652a0 0x7f2428067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.736+0000 7fddc8c00640 1 -- 172.21.15.6:0/2553696748 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fddc0012900 con 0x7fddc4036c90 2024-08-17T02:26:38.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.736+0000 7f9125800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f911800fbb0 0x7f91180d6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.736+0000 7f9124e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9118054080 0x7f91180d8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.737+0000 7f9125800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f911800fbb0 0x7f91180d6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49482/0 (socket says 172.21.15.6:49482) 2024-08-17T02:26:38.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.737+0000 7f9125800640 1 -- 172.21.15.6:0/2553143312 learned_addr learned my addr 172.21.15.6:0/2553143312 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:38.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.737+0000 7f9126200640 1 --2- 172.21.15.6:0/2553143312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91180e1d60 0x7f9118050070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.737+0000 7f244d000640 1 --2- 172.21.15.6:0/496880079 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f24280652a0 0x7f2428067750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2440034000 tx=0x7f2440037000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.737+0000 7f9126200640 1 -- 172.21.15.6:0/2553143312 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f911800fbb0 msgr2=0x7f91180d6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.738+0000 7fddc8c00640 1 --2- 172.21.15.6:0/2553696748 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fddb0065210 0x7fddb00676c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.737+0000 7f9126200640 1 --2- 172.21.15.6:0/2553143312 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f911800fbb0 0x7f91180d6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.737+0000 7f9126200640 1 -- 172.21.15.6:0/2553143312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9118054080 msgr2=0x7f91180d8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.737+0000 7f9126200640 1 --2- 172.21.15.6:0/2553143312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9118054080 0x7f91180d8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.737+0000 7f9126200640 1 -- 172.21.15.6:0/2553143312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9114009390 con 0x7f91180e1d60 2024-08-17T02:26:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.738+0000 7f9126200640 1 --2- 172.21.15.6:0/2553143312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91180e1d60 0x7f9118050070 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9114031000 tx=0x7f9114032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.738+0000 7f9125800640 1 --2- 172.21.15.6:0/2553143312 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f911800fbb0 0x7f91180d6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.738+0000 7f2444c00640 1 -- 172.21.15.6:0/496880079 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f243c0508e0 con 0x7f24480ae860 2024-08-17T02:26:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.738+0000 7fddc8c00640 1 -- 172.21.15.6:0/2553696748 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fddc00822d0 con 0x7fddc4036c90 2024-08-17T02:26:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.739+0000 7fddd1800640 1 --2- 172.21.15.6:0/2553696748 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fddb0065210 0x7fddb00676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.739+0000 7f1619000640 1 -- 172.21.15.6:0/1510061871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160c038b00 con 0x7f160c04fda0 2024-08-17T02:26:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.739+0000 7fddd1800640 1 --2- 172.21.15.6:0/2553696748 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fddb0065210 0x7fddb00676c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fddcc02ae30 tx=0x7fddcc06d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.742+0000 7fddc8c00640 1 -- 172.21.15.6:0/2553696748 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fddc0050440 con 0x7fddc4036c90 2024-08-17T02:26:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.742+0000 7f911cc00640 1 -- 172.21.15.6:0/2553143312 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9114032e00 con 0x7f91180e1d60 2024-08-17T02:26:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.742+0000 7f911cc00640 1 -- 172.21.15.6:0/2553143312 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114031a60 con 0x7f91180e1d60 2024-08-17T02:26:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.742+0000 7f911cc00640 1 -- 172.21.15.6:0/2553143312 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9114031de0 con 0x7f91180e1d60 2024-08-17T02:26:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.743+0000 7f9126c00640 1 -- 172.21.15.6:0/2553143312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91180d7570 con 0x7f91180e1d60 2024-08-17T02:26:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.743+0000 7f9126c00640 1 -- 172.21.15.6:0/2553143312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91180d7b30 con 0x7f91180e1d60 2024-08-17T02:26:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.744+0000 7f1602a00640 1 -- 172.21.15.6:0/1510061871 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1604008470 con 0x7f160c04fda0 2024-08-17T02:26:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.747+0000 7f1602a00640 1 --2- 172.21.15.6:0/1510061871 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f15f8065250 0x7f15f8067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.747+0000 7f1602a00640 1 -- 172.21.15.6:0/1510061871 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f16040a39e0 con 0x7f160c04fda0 2024-08-17T02:26:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.747+0000 7f9126c00640 1 -- 172.21.15.6:0/2553143312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91180d7d20 con 0x7f91180e1d60 2024-08-17T02:26:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.749+0000 7f1602a00640 1 -- 172.21.15.6:0/1510061871 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1604071c00 con 0x7f160c04fda0 2024-08-17T02:26:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.749+0000 7f1613400640 1 --2- 172.21.15.6:0/1510061871 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f15f8065250 0x7f15f8067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.751+0000 7f1613400640 1 --2- 172.21.15.6:0/1510061871 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f15f8065250 0x7f15f8067700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f160800fdc0 tx=0x7f1608011040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.754+0000 7f911cc00640 1 -- 172.21.15.6:0/2553143312 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9114043030 con 0x7f91180e1d60 2024-08-17T02:26:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.757+0000 7f911cc00640 1 --2- 172.21.15.6:0/2553143312 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91000652a0 0x7f9100067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.757+0000 7f911cc00640 1 -- 172.21.15.6:0/2553143312 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9114041070 con 0x7f91180e1d60 2024-08-17T02:26:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.757+0000 7f911cc00640 1 -- 172.21.15.6:0/2553143312 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f91140a3160 con 0x7f91180e1d60 2024-08-17T02:26:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.762+0000 7f9125800640 1 --2- 172.21.15.6:0/2553143312 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91000652a0 0x7f9100067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:38.762+0000 7f9125800640 1 --2- 172.21.15.6:0/2553143312 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91000652a0 0x7f9100067750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9120066b80 tx=0x7f9120088040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.146+0000 7fa4e9a00640 1 -- 172.21.15.6:0/593673089 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa4e4063fb0 con 0x7fa4e4158aa0 2024-08-17T02:26:39.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.147+0000 7fa4da000640 1 -- 172.21.15.6:0/593673089 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4dc053cd0 con 0x7fa4e4158aa0 2024-08-17T02:26:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:55834574851 2024-08-17T02:26:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.148+0000 7f9935000640 1 -- 172.21.15.6:0/2505798793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f993006e930 con 0x7f9930154a80 2024-08-17T02:26:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.148+0000 7f9925600640 1 -- 172.21.15.6:0/2505798793 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f992803c020 con 0x7f9930154a80 2024-08-17T02:26:39.151 INFO:teuthology.orchestra.run.smithi006.stdout:55834574851 2024-08-17T02:26:39.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.151+0000 7fa4e9a00640 1 -- 172.21.15.6:0/593673089 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa4c40652a0 msgr2=0x7fa4c4067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.151+0000 7fa4e9a00640 1 --2- 172.21.15.6:0/593673089 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa4c40652a0 0x7fa4c4067750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4034000 tx=0x7fa4d4032000 comp rx=0 tx=0).stop 2024-08-17T02:26:39.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.151+0000 7fa4e9a00640 1 -- 172.21.15.6:0/593673089 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4e4158aa0 msgr2=0x7fa4e415d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.151+0000 7fa4e9a00640 1 --2- 172.21.15.6:0/593673089 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4e4158aa0 0x7fa4e415d260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00c860 tx=0x7fa4dc001690 comp rx=0 tx=0).stop 2024-08-17T02:26:39.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.152+0000 7fa4e9a00640 1 -- 172.21.15.6:0/593673089 shutdown_connections 2024-08-17T02:26:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.152+0000 7fa4e9a00640 1 --2- 172.21.15.6:0/593673089 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa4c40652a0 0x7fa4c4067750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.152+0000 7fa4e9a00640 1 --2- 172.21.15.6:0/593673089 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4e4158aa0 0x7fa4e415d260 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.152+0000 7fa4e9a00640 1 --2- 172.21.15.6:0/593673089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4e40a98f0 0x7fa4e4168cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.152+0000 7fa4e9a00640 1 --2- 172.21.15.6:0/593673089 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e406dd10 0x7fa4e40cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.152+0000 7fa4e9a00640 1 -- 172.21.15.6:0/593673089 >> 172.21.15.6:0/593673089 conn(0x7fa4e4066e60 msgr2=0x7fa4e40a8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.152+0000 7fa4e9a00640 1 -- 172.21.15.6:0/593673089 shutdown_connections 2024-08-17T02:26:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.152+0000 7f9935000640 1 -- 172.21.15.6:0/2505798793 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f99100651d0 msgr2=0x7f9910067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.152+0000 7f9935000640 1 --2- 172.21.15.6:0/2505798793 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f99100651d0 0x7f9910067680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9920006a70 tx=0x7f9920008040 comp rx=0 tx=0).stop 2024-08-17T02:26:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.152+0000 7f9935000640 1 -- 172.21.15.6:0/2505798793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9930154a80 msgr2=0x7f99300cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.152+0000 7f9935000640 1 --2- 172.21.15.6:0/2505798793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9930154a80 0x7f99300cb550 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9928036000 tx=0x7f992803a000 comp rx=0 tx=0).stop 2024-08-17T02:26:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.152+0000 7fa4e9a00640 1 -- 172.21.15.6:0/593673089 wait complete. 2024-08-17T02:26:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.153+0000 7f9935000640 1 -- 172.21.15.6:0/2505798793 shutdown_connections 2024-08-17T02:26:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.153+0000 7f9935000640 1 --2- 172.21.15.6:0/2505798793 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f99100651d0 0x7f9910067680 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.153+0000 7f9935000640 1 --2- 172.21.15.6:0/2505798793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9930159320 0x7f99300c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.153+0000 7f9935000640 1 --2- 172.21.15.6:0/2505798793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9930154a80 0x7f99300cb550 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.153+0000 7f9935000640 1 --2- 172.21.15.6:0/2505798793 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f993006dd10 0x7f9930147c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.153+0000 7f9935000640 1 -- 172.21.15.6:0/2505798793 >> 172.21.15.6:0/2505798793 conn(0x7f9930066e60 msgr2=0x7f9930067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.153+0000 7f9935000640 1 -- 172.21.15.6:0/2505798793 shutdown_connections 2024-08-17T02:26:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.153+0000 7f9935000640 1 -- 172.21.15.6:0/2505798793 wait complete. 2024-08-17T02:26:39.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.159+0000 7f5eb0e00640 1 -- 172.21.15.6:0/2847073290 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5ea4050050 con 0x7f5ea40e22c0 2024-08-17T02:26:39.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.163+0000 7f5e9ea00640 1 -- 172.21.15.6:0/2847073290 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ea4050050 con 0x7f5ea40e22c0 2024-08-17T02:26:39.164 INFO:teuthology.orchestra.run.smithi006.stdout:55834574852 2024-08-17T02:26:39.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.167+0000 7fddd4200640 1 -- 172.21.15.6:0/2553696748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fdda8005790 con 0x7fddc4036c90 2024-08-17T02:26:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.167+0000 7f5eb0e00640 1 -- 172.21.15.6:0/2847073290 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5e8c0652a0 msgr2=0x7f5e8c067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.168+0000 7f5eb0e00640 1 --2- 172.21.15.6:0/2847073290 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5e8c0652a0 0x7f5e8c067750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0005840 tx=0x7f5ea0009040 comp rx=0 tx=0).stop 2024-08-17T02:26:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.168+0000 7f5eb0e00640 1 -- 172.21.15.6:0/2847073290 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5ea40e22c0 msgr2=0x7f5ea403df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.168+0000 7f5eb0e00640 1 --2- 172.21.15.6:0/2847073290 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5ea40e22c0 0x7f5ea403df60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0659e0 tx=0x7f5eac088040 comp rx=0 tx=0).stop 2024-08-17T02:26:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.168+0000 7f5eb0e00640 1 -- 172.21.15.6:0/2847073290 shutdown_connections 2024-08-17T02:26:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.168+0000 7f5eb0e00640 1 --2- 172.21.15.6:0/2847073290 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5e8c0652a0 0x7f5e8c067750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.168+0000 7f5eb0e00640 1 --2- 172.21.15.6:0/2847073290 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5ea40e22c0 0x7f5ea403df60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.168+0000 7f5eb0e00640 1 --2- 172.21.15.6:0/2847073290 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ea40e1ef0 0x7f5ea400a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.168+0000 7f5eb0e00640 1 --2- 172.21.15.6:0/2847073290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ea4054340 0x7f5ea40c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.168+0000 7f5eb0e00640 1 -- 172.21.15.6:0/2847073290 >> 172.21.15.6:0/2847073290 conn(0x7f5ea4055a10 msgr2=0x7f5ea404f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.168+0000 7f5eb0e00640 1 -- 172.21.15.6:0/2847073290 shutdown_connections 2024-08-17T02:26:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.168+0000 7f2450400640 1 -- 172.21.15.6:0/496880079 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f24240054c0 con 0x7f24480ae860 2024-08-17T02:26:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.168+0000 7f5eb0e00640 1 -- 172.21.15.6:0/2847073290 wait complete. 2024-08-17T02:26:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.170+0000 7f1619000640 1 -- 172.21.15.6:0/1510061871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f160c005250 con 0x7f160c04fda0 2024-08-17T02:26:39.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.170+0000 7f2444c00640 1 -- 172.21.15.6:0/496880079 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f243c021020 con 0x7f24480ae860 2024-08-17T02:26:39.174 INFO:teuthology.orchestra.run.smithi006.stdout:55834574851 2024-08-17T02:26:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.171+0000 7f638ae00640 1 -- 172.21.15.6:0/2651943559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f635c005790 con 0x7f63840cca30 2024-08-17T02:26:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.172+0000 7f637be00640 1 -- 172.21.15.6:0/2651943559 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6374054d00 con 0x7f63840cca30 2024-08-17T02:26:39.175 INFO:teuthology.orchestra.run.smithi006.stdout:55834574852 2024-08-17T02:26:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.170+0000 7fddc8c00640 1 -- 172.21.15.6:0/2553696748 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fddc0053a60 con 0x7fddc4036c90 2024-08-17T02:26:39.175 INFO:teuthology.orchestra.run.smithi006.stdout:55834574852 2024-08-17T02:26:39.176 INFO:teuthology.orchestra.run.smithi006.stdout:55834574852 2024-08-17T02:26:39.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.171+0000 7f1602a00640 1 -- 172.21.15.6:0/1510061871 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1604075220 con 0x7f160c04fda0 2024-08-17T02:26:39.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.174+0000 7fddd4200640 1 -- 172.21.15.6:0/2553696748 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fddb0065210 msgr2=0x7fddb00676c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.174+0000 7fddd4200640 1 --2- 172.21.15.6:0/2553696748 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fddb0065210 0x7fddb00676c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fddcc02ae30 tx=0x7fddcc06d040 comp rx=0 tx=0).stop 2024-08-17T02:26:39.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.174+0000 7fddd4200640 1 -- 172.21.15.6:0/2553696748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddc4036c90 msgr2=0x7fddc40d0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.174+0000 7fddd4200640 1 --2- 172.21.15.6:0/2553696748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddc4036c90 0x7fddc40d0a60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fddc000c4e0 tx=0x7fddc0007e60 comp rx=0 tx=0).stop 2024-08-17T02:26:39.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.174+0000 7f1619000640 1 -- 172.21.15.6:0/1510061871 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f15f8065250 msgr2=0x7f15f8067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.174+0000 7f1619000640 1 --2- 172.21.15.6:0/1510061871 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f15f8065250 0x7f15f8067700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f160800fdc0 tx=0x7f1608011040 comp rx=0 tx=0).stop 2024-08-17T02:26:39.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.174+0000 7f1619000640 1 -- 172.21.15.6:0/1510061871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160c04fda0 msgr2=0x7f160c036ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.174+0000 7f1619000640 1 --2- 172.21.15.6:0/1510061871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160c04fda0 0x7f160c036ea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1604031000 tx=0x7f1604035000 comp rx=0 tx=0).stop 2024-08-17T02:26:39.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f2450400640 1 -- 172.21.15.6:0/496880079 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f24280652a0 msgr2=0x7f2428067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f2450400640 1 --2- 172.21.15.6:0/496880079 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f24280652a0 0x7f2428067750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2440034000 tx=0x7f2440037000 comp rx=0 tx=0).stop 2024-08-17T02:26:39.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7fddd4200640 1 -- 172.21.15.6:0/2553696748 shutdown_connections 2024-08-17T02:26:39.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7fddd4200640 1 --2- 172.21.15.6:0/2553696748 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fddb0065210 0x7fddb00676c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7fddd4200640 1 --2- 172.21.15.6:0/2553696748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddc4036c90 0x7fddc40d0a60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7fddd4200640 1 --2- 172.21.15.6:0/2553696748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddc4035320 0x7fddc40e9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7fddd4200640 1 --2- 172.21.15.6:0/2553696748 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddc4034ef0 0x7fddc40d5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7fddd4200640 1 -- 172.21.15.6:0/2553696748 >> 172.21.15.6:0/2553696748 conn(0x7fddc4054b90 msgr2=0x7fddc4005db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f2450400640 1 -- 172.21.15.6:0/496880079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24480ae860 msgr2=0x7f2448157260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f2450400640 1 --2- 172.21.15.6:0/496880079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24480ae860 0x7f2448157260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f243c00ec80 tx=0x7f243c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f2450400640 1 -- 172.21.15.6:0/496880079 shutdown_connections 2024-08-17T02:26:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f2450400640 1 --2- 172.21.15.6:0/496880079 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f24280652a0 0x7f2428067750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f2450400640 1 --2- 172.21.15.6:0/496880079 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2448158df0 0x7f24480ad320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f2450400640 1 --2- 172.21.15.6:0/496880079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2448158a20 0x7f24480acde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f2450400640 1 --2- 172.21.15.6:0/496880079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24480ae860 0x7f2448157260 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f2450400640 1 -- 172.21.15.6:0/496880079 >> 172.21.15.6:0/496880079 conn(0x7f2448066e60 msgr2=0x7f244806a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f2450400640 1 -- 172.21.15.6:0/496880079 shutdown_connections 2024-08-17T02:26:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7fddd4200640 1 -- 172.21.15.6:0/2553696748 shutdown_connections 2024-08-17T02:26:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f2450400640 1 -- 172.21.15.6:0/496880079 wait complete. 2024-08-17T02:26:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f1619000640 1 -- 172.21.15.6:0/1510061871 shutdown_connections 2024-08-17T02:26:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f1619000640 1 --2- 172.21.15.6:0/1510061871 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f15f8065250 0x7f15f8067700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f1619000640 1 --2- 172.21.15.6:0/1510061871 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f160c0d86d0 0x7f160c035de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7fddd4200640 1 -- 172.21.15.6:0/2553696748 wait complete. 2024-08-17T02:26:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f1619000640 1 --2- 172.21.15.6:0/1510061871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160c04fda0 0x7f160c036ea0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f1619000640 1 --2- 172.21.15.6:0/1510061871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f160c04f1d0 0x7f160c0d5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.175+0000 7f1619000640 1 -- 172.21.15.6:0/1510061871 >> 172.21.15.6:0/1510061871 conn(0x7f160c051600 msgr2=0x7f160c005ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.176+0000 7f638ae00640 1 -- 172.21.15.6:0/2651943559 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6360065220 msgr2=0x7f63600676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.176+0000 7f638ae00640 1 --2- 172.21.15.6:0/2651943559 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6360065220 0x7f63600676d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f636c034000 tx=0x7f636c035000 comp rx=0 tx=0).stop 2024-08-17T02:26:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.176+0000 7f638ae00640 1 -- 172.21.15.6:0/2651943559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63840cca30 msgr2=0x7f638414cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.176+0000 7f638ae00640 1 --2- 172.21.15.6:0/2651943559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63840cca30 0x7f638414cdf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6374009f20 tx=0x7f637400b040 comp rx=0 tx=0).stop 2024-08-17T02:26:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.176+0000 7f638ae00640 1 -- 172.21.15.6:0/2651943559 shutdown_connections 2024-08-17T02:26:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.176+0000 7f638ae00640 1 --2- 172.21.15.6:0/2651943559 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6360065220 0x7f63600676d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.176+0000 7f638ae00640 1 --2- 172.21.15.6:0/2651943559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f638414fe00 0x7f6384144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.176+0000 7f638ae00640 1 --2- 172.21.15.6:0/2651943559 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63840d0150 0x7f638414ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.176+0000 7f638ae00640 1 --2- 172.21.15.6:0/2651943559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63840cca30 0x7f638414cdf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.176+0000 7f638ae00640 1 -- 172.21.15.6:0/2651943559 >> 172.21.15.6:0/2651943559 conn(0x7f6384068680 msgr2=0x7f63840afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.176+0000 7f1619000640 1 -- 172.21.15.6:0/1510061871 shutdown_connections 2024-08-17T02:26:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.176+0000 7f1619000640 1 -- 172.21.15.6:0/1510061871 wait complete. 2024-08-17T02:26:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.176+0000 7f638ae00640 1 -- 172.21.15.6:0/2651943559 shutdown_connections 2024-08-17T02:26:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.176+0000 7f638ae00640 1 -- 172.21.15.6:0/2651943559 wait complete. 2024-08-17T02:26:39.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.3 2024-08-17T02:26:39.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2024-08-17T02:26:39.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.185+0000 7f9126c00640 1 -- 172.21.15.6:0/2553143312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f91180063f0 con 0x7f91180e1d60 2024-08-17T02:26:39.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.185+0000 7f911cc00640 1 -- 172.21.15.6:0/2553143312 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9114037090 con 0x7f91180e1d60 2024-08-17T02:26:39.186 INFO:teuthology.orchestra.run.smithi006.stdout:55834574851 2024-08-17T02:26:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.189+0000 7f9126c00640 1 -- 172.21.15.6:0/2553143312 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91000652a0 msgr2=0x7f9100067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.189+0000 7f9126c00640 1 --2- 172.21.15.6:0/2553143312 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91000652a0 0x7f9100067750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9120066b80 tx=0x7f9120088040 comp rx=0 tx=0).stop 2024-08-17T02:26:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.189+0000 7f9126c00640 1 -- 172.21.15.6:0/2553143312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91180e1d60 msgr2=0x7f9118050070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.189+0000 7f9126c00640 1 --2- 172.21.15.6:0/2553143312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91180e1d60 0x7f9118050070 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9114031000 tx=0x7f9114032000 comp rx=0 tx=0).stop 2024-08-17T02:26:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.190+0000 7f9126c00640 1 -- 172.21.15.6:0/2553143312 shutdown_connections 2024-08-17T02:26:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.190+0000 7f9126c00640 1 --2- 172.21.15.6:0/2553143312 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91000652a0 0x7f9100067750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.190+0000 7f9126c00640 1 --2- 172.21.15.6:0/2553143312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91180e1d60 0x7f9118050070 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.190+0000 7f9126c00640 1 --2- 172.21.15.6:0/2553143312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9118054080 0x7f91180d8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.190+0000 7f9126c00640 1 --2- 172.21.15.6:0/2553143312 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f911800fbb0 0x7f91180d6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.190+0000 7f9126c00640 1 -- 172.21.15.6:0/2553143312 >> 172.21.15.6:0/2553143312 conn(0x7f9118059a20 msgr2=0x7f91180e3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.190+0000 7f9126c00640 1 -- 172.21.15.6:0/2553143312 shutdown_connections 2024-08-17T02:26:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:39.190+0000 7f9126c00640 1 -- 172.21.15.6:0/2553143312 wait complete. 2024-08-17T02:26:39.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-08-17T02:26:39.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-08-17T02:26:39.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2024-08-17T02:26:39.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-08-17T02:26:39.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2024-08-17T02:26:39.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2024-08-17T02:26:40.185 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:26:40.186 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:26:40.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:26:40.202 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:26:40.206 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:26:40.209 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:26:40.211 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:26:40.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:26:40.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.431+0000 7fa06be00640 1 Processor -- start 2024-08-17T02:26:40.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.432+0000 7fa06be00640 1 -- start start 2024-08-17T02:26:40.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.434+0000 7fa06be00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa064154a60 0x7fa06406d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.434+0000 7fa06be00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa064154e30 0x7fa06406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.435+0000 7fa069400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa064154a60 0x7fa06406d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.435+0000 7fa069400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa064154a60 0x7fa06406d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49486/0 (socket says 172.21.15.6:49486) 2024-08-17T02:26:40.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.435+0000 7fa069400640 1 -- 172.21.15.6:0/586646841 learned_addr learned my addr 172.21.15.6:0/586646841 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:40.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.436+0000 7fa06be00640 1 --2- 172.21.15.6:0/586646841 >> v2:172.21.15.136:3300/0 conn(0x7fa0640abe60 0x7fa0640ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.436+0000 7fa06be00640 1 -- 172.21.15.6:0/586646841 --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa064069580 con 0x7fa064154e30 2024-08-17T02:26:40.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.436+0000 7fa06be00640 1 -- 172.21.15.6:0/586646841 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa064069860 con 0x7fa0640abe60 2024-08-17T02:26:40.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.436+0000 7fa069e00640 1 --2- 172.21.15.6:0/586646841 >> v2:172.21.15.136:3300/0 conn(0x7fa0640abe60 0x7fa0640ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.437+0000 7fa06be00640 1 -- 172.21.15.6:0/586646841 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa064069b40 con 0x7fa064154a60 2024-08-17T02:26:40.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.437+0000 7fa068a00640 1 --2- 172.21.15.6:0/586646841 >> v2:172.21.15.6:3300/0 conn(0x7fa064154e30 0x7fa06406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.438+0000 7fa069400640 1 -- 172.21.15.6:0/586646841 >> v2:172.21.15.136:3300/0 conn(0x7fa0640abe60 msgr2=0x7fa0640ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.438+0000 7fa069400640 1 --2- 172.21.15.6:0/586646841 >> v2:172.21.15.136:3300/0 conn(0x7fa0640abe60 0x7fa0640ac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.438+0000 7fa069400640 1 -- 172.21.15.6:0/586646841 >> v2:172.21.15.6:3300/0 conn(0x7fa064154e30 msgr2=0x7fa06406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.438+0000 7fa069400640 1 --2- 172.21.15.6:0/586646841 >> v2:172.21.15.6:3300/0 conn(0x7fa064154e30 0x7fa06406db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.438+0000 7fa069400640 1 -- 172.21.15.6:0/586646841 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa064069e20 con 0x7fa064154a60 2024-08-17T02:26:40.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.438+0000 7fa068a00640 1 --2- 172.21.15.6:0/586646841 >> v2:172.21.15.6:3300/0 conn(0x7fa064154e30 0x7fa06406db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:40.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.439+0000 7fa069e00640 1 --2- 172.21.15.6:0/586646841 >> v2:172.21.15.136:3300/0 conn(0x7fa0640abe60 0x7fa0640ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:40.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.441+0000 7fa069400640 1 --2- 172.21.15.6:0/586646841 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa064154a60 0x7fa06406d5e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa0640c8200 tx=0x7fa05000abf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe3e6fd0f1481c57 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.441+0000 7fe413c00640 1 Processor -- start 2024-08-17T02:26:40.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.441+0000 7fa063e00640 1 -- 172.21.15.6:0/586646841 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05002bdd0 con 0x7fa064154a60 2024-08-17T02:26:40.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.441+0000 7fa063e00640 1 -- 172.21.15.6:0/586646841 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0500089e0 con 0x7fa064154a60 2024-08-17T02:26:40.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.441+0000 7fa063e00640 1 -- 172.21.15.6:0/586646841 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050008dc0 con 0x7fa064154a60 2024-08-17T02:26:40.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.442+0000 7fa06be00640 1 -- 172.21.15.6:0/586646841 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa064154a60 msgr2=0x7fa06406d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.442+0000 7fa06be00640 1 --2- 172.21.15.6:0/586646841 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa064154a60 0x7fa06406d5e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa0640c8200 tx=0x7fa05000abf0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.441+0000 7fe413c00640 1 -- start start 2024-08-17T02:26:40.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.443+0000 7fa06be00640 1 -- 172.21.15.6:0/586646841 shutdown_connections 2024-08-17T02:26:40.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.443+0000 7fa06be00640 1 --2- 172.21.15.6:0/586646841 >> v2:172.21.15.136:3300/0 conn(0x7fa0640abe60 0x7fa0640ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.443+0000 7fa06be00640 1 --2- 172.21.15.6:0/586646841 >> v2:172.21.15.6:3300/0 conn(0x7fa064154e30 0x7fa06406db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.443+0000 7fa06be00640 1 --2- 172.21.15.6:0/586646841 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa064154a60 0x7fa06406d5e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.443+0000 7fa06be00640 1 -- 172.21.15.6:0/586646841 >> 172.21.15.6:0/586646841 conn(0x7fa0640c8260 msgr2=0x7fa0640c8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.444+0000 7fa06be00640 1 -- 172.21.15.6:0/586646841 shutdown_connections 2024-08-17T02:26:40.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.444+0000 7fe413c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe404052110 0x7fe404005e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.444+0000 7fe413c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4040de700 0x7fe40404fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.444+0000 7fa06be00640 1 -- 172.21.15.6:0/586646841 wait complete. 2024-08-17T02:26:40.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.444+0000 7fe411200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe404052110 0x7fe404005e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.444+0000 7fe40be00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fe40404f1d0 0x7fe4040d8530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:56612/0 (socket says 172.21.15.6:56612) 2024-08-17T02:26:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.444+0000 7fe411200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe404052110 0x7fe404005e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:44206/0 (socket says 172.21.15.6:44206) 2024-08-17T02:26:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.445+0000 7fe411200640 1 -- 172.21.15.6:0/1878435269 learned_addr learned my addr 172.21.15.6:0/1878435269 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.445+0000 7fe413c00640 1 -- 172.21.15.6:0/1878435269 --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4040d8c40 con 0x7fe40404f1d0 2024-08-17T02:26:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.445+0000 7fe413c00640 1 -- 172.21.15.6:0/1878435269 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4040df740 con 0x7fe404052110 2024-08-17T02:26:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.445+0000 7fe413c00640 1 -- 172.21.15.6:0/1878435269 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe404053380 con 0x7fe4040de700 2024-08-17T02:26:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.445+0000 7fe411c00640 1 --2- 172.21.15.6:0/1878435269 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4040de700 0x7fe40404fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.445+0000 7fe411200640 1 -- 172.21.15.6:0/1878435269 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4040de700 msgr2=0x7fe40404fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.445+0000 7fe411200640 1 --2- 172.21.15.6:0/1878435269 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4040de700 0x7fe40404fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.445+0000 7fe411200640 1 -- 172.21.15.6:0/1878435269 >> v1:172.21.15.136:6789/0 conn(0x7fe40404f1d0 legacy=0x7fe4040d8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.446+0000 7fe411200640 1 -- 172.21.15.6:0/1878435269 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4040deea0 con 0x7fe404052110 2024-08-17T02:26:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.446+0000 7fa06be00640 1 Processor -- start 2024-08-17T02:26:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.447+0000 7fa06be00640 1 -- start start 2024-08-17T02:26:40.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.447+0000 7fe411200640 1 --2- 172.21.15.6:0/1878435269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe404052110 0x7fe404005e70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe40c065320 tx=0x7fe40c064990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e00a8a3e27cfb6c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.447+0000 7fe40b400640 1 -- 172.21.15.6:0/1878435269 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0a1e70 con 0x7fe404052110 2024-08-17T02:26:40.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.447+0000 7fe40b400640 1 -- 172.21.15.6:0/1878435269 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c0a93f0 con 0x7fe404052110 2024-08-17T02:26:40.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.447+0000 7fe40b400640 1 -- 172.21.15.6:0/1878435269 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0a9830 con 0x7fe404052110 2024-08-17T02:26:40.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.449+0000 7fe413c00640 1 -- 172.21.15.6:0/1878435269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe404052110 msgr2=0x7fe404005e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.449+0000 7fe413c00640 1 --2- 172.21.15.6:0/1878435269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe404052110 0x7fe404005e70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe40c065320 tx=0x7fe40c064990 comp rx=0 tx=0).stop 2024-08-17T02:26:40.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.449+0000 7fa06be00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa0640abe60 0x7fa064153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.449+0000 7fa06be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa064154a60 0x7fa0640ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.449+0000 7fa06be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa064154e30 0x7fa064148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.449+0000 7fe413c00640 1 -- 172.21.15.6:0/1878435269 shutdown_connections 2024-08-17T02:26:40.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.449+0000 7fe413c00640 1 --2- 172.21.15.6:0/1878435269 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4040de700 0x7fe40404fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.449+0000 7fe413c00640 1 --2- 172.21.15.6:0/1878435269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe404052110 0x7fe404005e70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.449+0000 7fe413c00640 1 -- 172.21.15.6:0/1878435269 >> 172.21.15.6:0/1878435269 conn(0x7fe404051600 msgr2=0x7fe404051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.450+0000 7fe413c00640 1 -- 172.21.15.6:0/1878435269 shutdown_connections 2024-08-17T02:26:40.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.450+0000 7fa069e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa064154e30 0x7fa064148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.450+0000 7fa069e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa064154e30 0x7fa064148210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57122/0 (socket says 172.21.15.6:57122) 2024-08-17T02:26:40.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.450+0000 7fa069e00640 1 -- 172.21.15.6:0/2756035106 learned_addr learned my addr 172.21.15.6:0/2756035106 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:40.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.450+0000 7fa068a00640 1 --2- 172.21.15.6:0/2756035106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa064154a60 0x7fa0640ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.450+0000 7fa069400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa0640abe60 0x7fa064153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.451+0000 7fa06be00640 1 -- 172.21.15.6:0/2756035106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640afae0 con 0x7fa064154e30 2024-08-17T02:26:40.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.451+0000 7fa06be00640 1 -- 172.21.15.6:0/2756035106 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640aef80 con 0x7fa064154a60 2024-08-17T02:26:40.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.451+0000 7fa06be00640 1 -- 172.21.15.6:0/2756035106 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640af260 con 0x7fa0640abe60 2024-08-17T02:26:40.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.450+0000 7fe413c00640 1 -- 172.21.15.6:0/1878435269 wait complete. 2024-08-17T02:26:40.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.452+0000 7fe413c00640 1 Processor -- start 2024-08-17T02:26:40.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.452+0000 7fa069e00640 1 -- 172.21.15.6:0/2756035106 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa0640abe60 msgr2=0x7fa064153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.452+0000 7fa069e00640 1 --2- 172.21.15.6:0/2756035106 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa0640abe60 0x7fa064153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.452+0000 7fa069e00640 1 -- 172.21.15.6:0/2756035106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa064154a60 msgr2=0x7fa0640ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.452+0000 7fa069e00640 1 --2- 172.21.15.6:0/2756035106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa064154a60 0x7fa0640ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.452+0000 7fa069e00640 1 -- 172.21.15.6:0/2756035106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c009a20 con 0x7fa064154e30 2024-08-17T02:26:40.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.453+0000 7fe413c00640 1 -- start start 2024-08-17T02:26:40.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.453+0000 7fa069400640 1 --2- 172.21.15.6:0/2756035106 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa0640abe60 0x7fa064153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:40.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.453+0000 7fa068a00640 1 --2- 172.21.15.6:0/2756035106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa064154a60 0x7fa0640ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:40.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.454+0000 7fa069e00640 1 --2- 172.21.15.6:0/2756035106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa064154e30 0x7fa064148210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009fc0 tx=0x7fa05c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.455+0000 7fa060c00640 1 -- 172.21.15.6:0/2756035106 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00ce70 con 0x7fa064154e30 2024-08-17T02:26:40.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.455+0000 7fe413c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe40404f1d0 0x7fe40404af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.455+0000 7fa060c00640 1 -- 172.21.15.6:0/2756035106 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c00f040 con 0x7fa064154e30 2024-08-17T02:26:40.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.455+0000 7fe413c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe404052110 0x7fe404039690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.455+0000 7fa06be00640 1 -- 172.21.15.6:0/2756035106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa050007040 con 0x7fa064154e30 2024-08-17T02:26:40.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.455+0000 7fa06be00640 1 -- 172.21.15.6:0/2756035106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0640afd30 con 0x7fa064154e30 2024-08-17T02:26:40.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.456+0000 7fa060c00640 1 -- 172.21.15.6:0/2756035106 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c0146d0 con 0x7fa064154e30 2024-08-17T02:26:40.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.455+0000 7fe411200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe40404f1d0 0x7fe40404af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.455+0000 7fe411200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe40404f1d0 0x7fe40404af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:44220/0 (socket says 172.21.15.6:44220) 2024-08-17T02:26:40.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.455+0000 7fe411200640 1 -- 172.21.15.6:0/2837210475 learned_addr learned my addr 172.21.15.6:0/2837210475 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:40.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.456+0000 7fe40be00640 1 --2- 172.21.15.6:0/2837210475 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe404052110 0x7fe404039690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.456+0000 7fe413c00640 1 --2- 172.21.15.6:0/2837210475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4040de700 0x7fe404039bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.457+0000 7fe413c00640 1 -- 172.21.15.6:0/2837210475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe404035c30 con 0x7fe4040de700 2024-08-17T02:26:40.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.457+0000 7fe411c00640 1 --2- 172.21.15.6:0/2837210475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4040de700 0x7fe404039bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.457+0000 7fe413c00640 1 -- 172.21.15.6:0/2837210475 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe404034d40 con 0x7fe40404f1d0 2024-08-17T02:26:40.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.457+0000 7fe413c00640 1 -- 172.21.15.6:0/2837210475 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe404035020 con 0x7fe404052110 2024-08-17T02:26:40.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.459+0000 7fe411200640 1 -- 172.21.15.6:0/2837210475 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe404052110 msgr2=0x7fe404039690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.459+0000 7fe411200640 1 --2- 172.21.15.6:0/2837210475 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe404052110 0x7fe404039690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.459+0000 7fe411200640 1 -- 172.21.15.6:0/2837210475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4040de700 msgr2=0x7fe404039bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.459+0000 7fa060c00640 1 -- 172.21.15.6:0/2756035106 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa05c003020 con 0x7fa064154e30 2024-08-17T02:26:40.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.459+0000 7fe411200640 1 --2- 172.21.15.6:0/2837210475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4040de700 0x7fe404039bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.459+0000 7fe411200640 1 -- 172.21.15.6:0/2837210475 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c04c200 con 0x7fe40404f1d0 2024-08-17T02:26:40.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.459+0000 7fe411c00640 1 --2- 172.21.15.6:0/2837210475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4040de700 0x7fe404039bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:40.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.460+0000 7fa06be00640 1 -- 172.21.15.6:0/2756035106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa040005210 con 0x7fa064154e30 2024-08-17T02:26:40.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.461+0000 7fa060c00640 1 --2- 172.21.15.6:0/2756035106 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa044065200 0x7fa0440676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.461+0000 7fa060c00640 1 -- 172.21.15.6:0/2756035106 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa05c082fa0 con 0x7fa064154e30 2024-08-17T02:26:40.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.462+0000 7fa069400640 1 --2- 172.21.15.6:0/2756035106 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa044065200 0x7fa0440676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.462+0000 7fe411200640 1 --2- 172.21.15.6:0/2837210475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe40404f1d0 0x7fe40404af60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe40c04c780 tx=0x7fe40c0ab000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.463+0000 7fa069400640 1 --2- 172.21.15.6:0/2756035106 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa044065200 0x7fa0440676b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa050034000 tx=0x7fa050035000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.463+0000 7fe3ffe00640 1 -- 172.21.15.6:0/2837210475 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0b8070 con 0x7fe40404f1d0 2024-08-17T02:26:40.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.463+0000 7fe413c00640 1 -- 172.21.15.6:0/2837210475 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe404035300 con 0x7fe40404f1d0 2024-08-17T02:26:40.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.464+0000 7fe413c00640 1 -- 172.21.15.6:0/2837210475 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4040358c0 con 0x7fe40404f1d0 2024-08-17T02:26:40.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.464+0000 7fe3ffe00640 1 -- 172.21.15.6:0/2837210475 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c0a8d80 con 0x7fe40404f1d0 2024-08-17T02:26:40.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.464+0000 7fe3ffe00640 1 -- 172.21.15.6:0/2837210475 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0b8070 con 0x7fe40404f1d0 2024-08-17T02:26:40.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.467+0000 7fe3ffe00640 1 -- 172.21.15.6:0/2837210475 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe40c0b4610 con 0x7fe40404f1d0 2024-08-17T02:26:40.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.468+0000 7fe3fd600640 1 -- 172.21.15.6:0/2837210475 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e0005210 con 0x7fe40404f1d0 2024-08-17T02:26:40.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.470+0000 7fa060c00640 1 -- 172.21.15.6:0/2756035106 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa05c050fc0 con 0x7fa064154e30 2024-08-17T02:26:40.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.469+0000 7fe3ffe00640 1 --2- 172.21.15.6:0/2837210475 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe3ec065230 0x7fe3ec0676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.470+0000 7fe3ffe00640 1 -- 172.21.15.6:0/2837210475 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe40c119ca0 con 0x7fe40404f1d0 2024-08-17T02:26:40.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.470+0000 7fe40be00640 1 --2- 172.21.15.6:0/2837210475 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe3ec065230 0x7fe3ec0676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.471+0000 7fe40be00640 1 --2- 172.21.15.6:0/2837210475 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe3ec065230 0x7fe3ec0676e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe40403a930 tx=0x7fe400006f50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.475+0000 7fe3ffe00640 1 -- 172.21.15.6:0/2837210475 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe40c0e7cc0 con 0x7fe40404f1d0 2024-08-17T02:26:40.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.513+0000 7f91cee00640 1 Processor -- start 2024-08-17T02:26:40.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.513+0000 7f91cee00640 1 -- start start 2024-08-17T02:26:40.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.516+0000 7f91cee00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91c0051da0 0x7f91c0052170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.516+0000 7f91cee00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f91c0035960 0x7f91c0035db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.516+0000 7f91cee00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c00363e0 con 0x7f91c00dfb30 2024-08-17T02:26:40.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.516+0000 7f91cee00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c0054b10 con 0x7f91c0035960 2024-08-17T02:26:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.517+0000 7f91cee00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c0054df0 con 0x7f91c0051da0 2024-08-17T02:26:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.517+0000 7f91ce400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f91c00dfb30 0x7f91c00dffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:56628/0 (socket says 172.21.15.6:56628) 2024-08-17T02:26:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.517+0000 7f91ce400640 1 -- 172.21.15.6:0/1090705174 learned_addr learned my addr 172.21.15.6:0/1090705174 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.517+0000 7f91cd000640 1 --2- 172.21.15.6:0/1090705174 >> v2:172.21.15.136:3300/0 conn(0x7f91c0035960 0x7f91c0035db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.515+0000 7f3341a00640 1 Processor -- start 2024-08-17T02:26:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.515+0000 7f3341a00640 1 -- start start 2024-08-17T02:26:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.518+0000 7f91c7e00640 1 -- 172.21.15.6:0/1090705174 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835763086 0 0) 0x7f91c00363e0 con 0x7f91c00dfb30 2024-08-17T02:26:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.518+0000 7f91c7e00640 1 -- 172.21.15.6:0/1090705174 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91b00034e0 con 0x7f91c00dfb30 2024-08-17T02:26:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.518+0000 7f3341a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333c15d2d0 0x7f333c0acad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.518+0000 7f3341a00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333c0cb3c0 con 0x7f333c068680 2024-08-17T02:26:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.518+0000 7f3341a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333c0691a0 con 0x7f333c0cac80 2024-08-17T02:26:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.518+0000 7f3341a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0870e0 con 0x7f333c15d2d0 2024-08-17T02:26:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.518+0000 7f91cd000640 1 -- 172.21.15.6:0/1090705174 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91c0051da0 msgr2=0x7f91c0052170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:26:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.518+0000 7f91cd000640 1 --2- 172.21.15.6:0/1090705174 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91c0051da0 0x7f91c0052170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.518+0000 7f91c7e00640 1 -- 172.21.15.6:0/1090705174 <== mon.1 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 523764713 0 0) 0x7f91b00034e0 con 0x7f91c00dfb30 2024-08-17T02:26:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.518+0000 7f333aa00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333c15d2d0 0x7f333c0acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.518+0000 7f333aa00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333c15d2d0 0x7f333c0acad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49526/0 (socket says 172.21.15.6:49526) 2024-08-17T02:26:40.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.518+0000 7f333aa00640 1 -- 172.21.15.6:0/2397259190 learned_addr learned my addr 172.21.15.6:0/2397259190 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:40.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.518+0000 7f91cd000640 1 -- 172.21.15.6:0/1090705174 >> v1:172.21.15.136:6789/0 conn(0x7f91c00dfb30 legacy=0x7f91c00dffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.519+0000 7f91cd000640 1 -- 172.21.15.6:0/1090705174 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c00550d0 con 0x7f91c0035960 2024-08-17T02:26:40.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.519+0000 7f333aa00640 1 -- 172.21.15.6:0/2397259190 >> v1:172.21.15.136:6789/0 conn(0x7f333c0cac80 legacy=0x7f333c067f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.519+0000 7f333aa00640 1 -- 172.21.15.6:0/2397259190 >> v1:172.21.15.6:6789/0 conn(0x7f333c068680 legacy=0x7f333c0cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.519+0000 7f333aa00640 1 -- 172.21.15.6:0/2397259190 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c0cb120 con 0x7f333c15d2d0 2024-08-17T02:26:40.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.521+0000 7f333aa00640 1 --2- 172.21.15.6:0/2397259190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333c15d2d0 0x7f333c0acad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f33240098c0 tx=0x7f33240091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3defbffa968bb263 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.521+0000 7f1000600640 1 Processor -- start 2024-08-17T02:26:40.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.521+0000 7f3339600640 1 -- 172.21.15.6:0/2397259190 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332402ad20 con 0x7f333c15d2d0 2024-08-17T02:26:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.521+0000 7f91cd000640 1 --2- 172.21.15.6:0/1090705174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91c0035960 0x7f91c0035db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009850 tx=0x7f91b40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=180701000789a44c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.521+0000 7f3339600640 1 -- 172.21.15.6:0/2397259190 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332402ae80 con 0x7f333c15d2d0 2024-08-17T02:26:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.521+0000 7f3339600640 1 -- 172.21.15.6:0/2397259190 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324032670 con 0x7f333c15d2d0 2024-08-17T02:26:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.521+0000 7f1000600640 1 -- start start 2024-08-17T02:26:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.522+0000 7f91c7e00640 1 -- 172.21.15.6:0/1090705174 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c804c200 con 0x7f91c0035960 2024-08-17T02:26:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.522+0000 7f116f200640 1 Processor -- start 2024-08-17T02:26:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.522+0000 7f91c7e00640 1 -- 172.21.15.6:0/1090705174 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b402a8a0 con 0x7f91c0035960 2024-08-17T02:26:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.522+0000 7f3341a00640 1 -- 172.21.15.6:0/2397259190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333c15d2d0 msgr2=0x7f333c0acad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.522+0000 7f3341a00640 1 --2- 172.21.15.6:0/2397259190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333c15d2d0 0x7f333c0acad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f33240098c0 tx=0x7f33240091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.522+0000 7f91c7e00640 1 -- 172.21.15.6:0/1090705174 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b402ac80 con 0x7f91c0035960 2024-08-17T02:26:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.523+0000 7f91cee00640 1 -- 172.21.15.6:0/1090705174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91c0035960 msgr2=0x7f91c0035db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.523+0000 7f91cee00640 1 --2- 172.21.15.6:0/1090705174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91c0035960 0x7f91c0035db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009850 tx=0x7f91b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.523+0000 7f1000600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ff80cb0d0 0x7f0ff8158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.523+0000 7f1000600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0ff80cda30 0x7f0ff80cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.523+0000 7f1000600640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff80af9a0 con 0x7f0ff81589e0 2024-08-17T02:26:40.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.523+0000 7f1000600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80af810 con 0x7f0ff80cb0d0 2024-08-17T02:26:40.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.523+0000 7f1000600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80ce740 con 0x7f0ff80cda30 2024-08-17T02:26:40.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.523+0000 7f3341a00640 1 -- 172.21.15.6:0/2397259190 shutdown_connections 2024-08-17T02:26:40.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.523+0000 7f3341a00640 1 --2- 172.21.15.6:0/2397259190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333c15d2d0 0x7f333c0acad0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.523+0000 7f3341a00640 1 -- 172.21.15.6:0/2397259190 >> 172.21.15.6:0/2397259190 conn(0x7f333c0ce590 msgr2=0x7f333c0ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.523+0000 7f3341a00640 1 -- 172.21.15.6:0/2397259190 shutdown_connections 2024-08-17T02:26:40.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.524+0000 7f91cee00640 1 -- 172.21.15.6:0/1090705174 shutdown_connections 2024-08-17T02:26:40.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.524+0000 7f91cee00640 1 --2- 172.21.15.6:0/1090705174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91c0035960 0x7f91c0035db0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.523+0000 7f3341a00640 1 -- 172.21.15.6:0/2397259190 wait complete. 2024-08-17T02:26:40.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.524+0000 7f91cee00640 1 --2- 172.21.15.6:0/1090705174 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91c0051da0 0x7f91c0052170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.524+0000 7f91cee00640 1 -- 172.21.15.6:0/1090705174 >> 172.21.15.6:0/1090705174 conn(0x7f91c000a800 msgr2=0x7f91c0056da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.524+0000 7f91cee00640 1 -- 172.21.15.6:0/1090705174 shutdown_connections 2024-08-17T02:26:40.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.524+0000 7f91cee00640 1 -- 172.21.15.6:0/1090705174 wait complete. 2024-08-17T02:26:40.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.524+0000 7f0ffdc00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0ff81589e0 0x7f0ff80ca9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38382/0 (socket says 172.21.15.6:38382) 2024-08-17T02:26:40.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.524+0000 7f0ffdc00640 1 -- 172.21.15.6:0/2879126242 learned_addr learned my addr 172.21.15.6:0/2879126242 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:40.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.525+0000 7f0ffe600640 1 --2- 172.21.15.6:0/2879126242 >> v2:172.21.15.136:3300/0 conn(0x7f0ff80cda30 0x7f0ff80cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.522+0000 7f116f200640 1 -- start start 2024-08-17T02:26:40.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.524+0000 7f116f200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1170158a00 0x7f1170158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.524+0000 7f116f200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700cb190 0x7f11700cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.524+0000 7f116f200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f117006e590 0x7f117006e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.524+0000 7f116f200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117006ef10 con 0x7f1170158a00 2024-08-17T02:26:40.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.524+0000 7f116f200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11700cbc50 con 0x7f117006e590 2024-08-17T02:26:40.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.525+0000 7f116f200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11700cbf30 con 0x7f11700cb190 2024-08-17T02:26:40.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.525+0000 7fcc91600640 1 Processor -- start 2024-08-17T02:26:40.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.525+0000 7f0ffd200640 1 --2- 172.21.15.6:0/2879126242 >> v2:172.21.15.6:3300/0 conn(0x7f0ff80cb0d0 0x7f0ff8158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.526+0000 7f3341a00640 1 Processor -- start 2024-08-17T02:26:40.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.527+0000 7f3341a00640 1 -- start start 2024-08-17T02:26:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.525+0000 7fcc91600640 1 -- start start 2024-08-17T02:26:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.526+0000 7f0ff7e00640 1 -- 172.21.15.6:0/2879126242 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651980526 0 0) 0x7f0ff80af9a0 con 0x7f0ff81589e0 2024-08-17T02:26:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.525+0000 7f116e800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f117006e590 0x7f117006e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.525+0000 7f116de00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1170158a00 0x7f1170158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.525+0000 7f116e800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f117006e590 0x7f117006e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:44230/0 (socket says 172.21.15.6:44230) 2024-08-17T02:26:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.525+0000 7f116e800640 1 -- 172.21.15.6:0/653393584 learned_addr learned my addr 172.21.15.6:0/653393584 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.525+0000 7f1165400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700cb190 0x7f11700cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.526+0000 7f1165400640 1 -- 172.21.15.6:0/653393584 >> v2:172.21.15.136:3300/0 conn(0x7f117006e590 msgr2=0x7f117006e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.526+0000 7f1165400640 1 --2- 172.21.15.6:0/653393584 >> v2:172.21.15.136:3300/0 conn(0x7f117006e590 0x7f117006e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.526+0000 7f1165400640 1 -- 172.21.15.6:0/653393584 >> v2:172.21.15.6:3300/0 conn(0x7f1170158a00 msgr2=0x7f1170158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.526+0000 7f1165400640 1 --2- 172.21.15.6:0/653393584 >> v2:172.21.15.6:3300/0 conn(0x7f1170158a00 0x7f1170158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.526+0000 7f1165400640 1 -- 172.21.15.6:0/653393584 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700cc210 con 0x7f11700cb190 2024-08-17T02:26:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.526+0000 7f0ffd200640 1 -- 172.21.15.6:0/2879126242 >> v2:172.21.15.136:3300/0 conn(0x7f0ff80cda30 msgr2=0x7f0ff80cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.526+0000 7f0ffd200640 1 --2- 172.21.15.6:0/2879126242 >> v2:172.21.15.136:3300/0 conn(0x7f0ff80cda30 0x7f0ff80cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.526+0000 7f0ffd200640 1 -- 172.21.15.6:0/2879126242 >> v1:172.21.15.6:6789/0 conn(0x7f0ff81589e0 legacy=0x7f0ff80ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.526+0000 7f0ffd200640 1 -- 172.21.15.6:0/2879126242 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80cea00 con 0x7f0ff80cb0d0 2024-08-17T02:26:40.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.528+0000 7f91cee00640 1 Processor -- start 2024-08-17T02:26:40.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.528+0000 7ff9cfc00640 1 Processor -- start 2024-08-17T02:26:40.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.528+0000 7f91cee00640 1 -- start start 2024-08-17T02:26:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.528+0000 7f0ffd200640 1 --2- 172.21.15.6:0/2879126242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff80cb0d0 0x7f0ff8158db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ff80cbe00 tx=0x7f0fec0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ae3202d3f35a4d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.528+0000 7ff9cfc00640 1 -- start start 2024-08-17T02:26:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.528+0000 7fcc91600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc8c15d070 0x7fcc8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.528+0000 7fcc91600640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8c069220 con 0x7fcc8c0ac460 2024-08-17T02:26:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.528+0000 7fcc91600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8c0694c0 con 0x7fcc8c0ab6a0 2024-08-17T02:26:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.528+0000 7fcc91600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c069760 con 0x7fcc8c15d070 2024-08-17T02:26:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.528+0000 7f0ff7e00640 1 -- 172.21.15.6:0/2879126242 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec02add0 con 0x7f0ff80cb0d0 2024-08-17T02:26:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7f0ff7e00640 1 -- 172.21.15.6:0/2879126242 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec032440 con 0x7f0ff80cb0d0 2024-08-17T02:26:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7f0ff7e00640 1 -- 172.21.15.6:0/2879126242 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec02add0 con 0x7f0ff80cb0d0 2024-08-17T02:26:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7f3341a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333c068680 0x7f333c15b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.528+0000 7f1165400640 1 --2- 172.21.15.6:0/653393584 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700cb190 0x7f11700cb5c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f11700d0bd0 tx=0x7f11580119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e12dd150095e2a3d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7f3341a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f333c0cac80 0x7f333c0ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7f3341a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f333c15d2d0 0x7f333c0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7fcc8be00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc8c15d070 0x7fcc8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7fcc8be00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc8c15d070 0x7fcc8c068930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49542/0 (socket says 172.21.15.6:49542) 2024-08-17T02:26:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7fcc8be00640 1 -- 172.21.15.6:0/1370023748 learned_addr learned my addr 172.21.15.6:0/1370023748 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7fcc90c00640 1 --1- 172.21.15.6:0/1370023748 >> v1:172.21.15.6:6789/0 conn(0x7fcc8c0ac460 0x7fcc8c0ae9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38396/0 (socket says 172.21.15.6:38396) 2024-08-17T02:26:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7f116d400640 1 -- 172.21.15.6:0/653393584 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580112e0 con 0x7f11700cb190 2024-08-17T02:26:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7fcc8be00640 1 -- 172.21.15.6:0/1370023748 >> v1:172.21.15.136:6789/0 conn(0x7fcc8c0ab6a0 legacy=0x7fcc8c0abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7fcc8be00640 1 -- 172.21.15.6:0/1370023748 >> v1:172.21.15.6:6789/0 conn(0x7fcc8c0ac460 legacy=0x7fcc8c0ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7f333aa00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333c068680 0x7f333c15b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7f333aa00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333c068680 0x7f333c15b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49554/0 (socket says 172.21.15.6:49554) 2024-08-17T02:26:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7f3341a00640 1 -- 172.21.15.6:0/618182851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0ae650 con 0x7f333c0cac80 2024-08-17T02:26:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7f333aa00640 1 -- 172.21.15.6:0/618182851 learned_addr learned my addr 172.21.15.6:0/618182851 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7f3341a00640 1 -- 172.21.15.6:0/618182851 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c15bb90 con 0x7f333c15d2d0 2024-08-17T02:26:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7f3341a00640 1 -- 172.21.15.6:0/618182851 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0ada40 con 0x7f333c068680 2024-08-17T02:26:40.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7f116d400640 1 -- 172.21.15.6:0/653393584 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1158011440 con 0x7f11700cb190 2024-08-17T02:26:40.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.529+0000 7f116d400640 1 -- 172.21.15.6:0/653393584 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115800f850 con 0x7f11700cb190 2024-08-17T02:26:40.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.530+0000 7f1000600640 1 -- 172.21.15.6:0/2879126242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff80cb0d0 msgr2=0x7f0ff8158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.530+0000 7f1000600640 1 --2- 172.21.15.6:0/2879126242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff80cb0d0 0x7f0ff8158db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ff80cbe00 tx=0x7f0fec0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.530+0000 7f333b400640 1 --2- 172.21.15.6:0/618182851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f333c15d2d0 0x7f333c0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.530+0000 7f333b400640 1 -- 172.21.15.6:0/618182851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333c068680 msgr2=0x7f333c15b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.530+0000 7ff9cfc00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff9c814fe00 0x7ff9c80cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.530+0000 7ff9cfc00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9c80cca30 0x7ff9c80cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.530+0000 7ff9cfc00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c80cdef0 con 0x7ff9c80d0150 2024-08-17T02:26:40.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.530+0000 7f333b400640 1 --2- 172.21.15.6:0/618182851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333c068680 0x7f333c15b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.530+0000 7f333b400640 1 -- 172.21.15.6:0/618182851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f333c0cac80 msgr2=0x7f333c0ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.530+0000 7ff9cfc00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c80d05f0 con 0x7ff9c814fe00 2024-08-17T02:26:40.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.530+0000 7ff9cfc00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80af8e0 con 0x7ff9c80cca30 2024-08-17T02:26:40.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.530+0000 7f91cee00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91c0035960 0x7f91c0038c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.531+0000 7f91cee00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91c0051da0 0x7f91c00dea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.530+0000 7fcc8be00640 1 -- 172.21.15.6:0/1370023748 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c0ae4b0 con 0x7fcc8c15d070 2024-08-17T02:26:40.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.530+0000 7f333a000640 1 --2- 172.21.15.6:0/618182851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f333c0cac80 0x7f333c0ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.531+0000 7f333b400640 1 --2- 172.21.15.6:0/618182851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f333c0cac80 0x7f333c0ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.531+0000 7f333b400640 1 -- 172.21.15.6:0/618182851 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3324009450 con 0x7f333c15d2d0 2024-08-17T02:26:40.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.531+0000 7f91cee00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91c00dfb30 0x7f91c0036d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.531+0000 7ff9cdc00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff9c80d0150 0x7ff9c815cac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38402/0 (socket says 172.21.15.6:38402) 2024-08-17T02:26:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.531+0000 7ff9cdc00640 1 -- 172.21.15.6:0/1144525677 learned_addr learned my addr 172.21.15.6:0/1144525677 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.531+0000 7f333a000640 1 --2- 172.21.15.6:0/618182851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f333c0cac80 0x7f333c0ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.531+0000 7f116f200640 1 -- 172.21.15.6:0/653393584 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700cb190 msgr2=0x7f11700cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f1000600640 1 -- 172.21.15.6:0/2879126242 shutdown_connections 2024-08-17T02:26:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f333b400640 1 --2- 172.21.15.6:0/618182851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f333c15d2d0 0x7f333c0b2360 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f333400c790 tx=0x7f3334001560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.531+0000 7f91cda00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91c0035960 0x7f91c0038c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f1000600640 1 --2- 172.21.15.6:0/2879126242 >> v2:172.21.15.136:3300/0 conn(0x7f0ff80cda30 0x7f0ff80cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f91ce400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91c00dfb30 0x7f91c0036d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f1000600640 1 --2- 172.21.15.6:0/2879126242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff80cb0d0 0x7f0ff8158db0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f1000600640 1 -- 172.21.15.6:0/2879126242 >> 172.21.15.6:0/2879126242 conn(0x7f0ff806e590 msgr2=0x7f0ff806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7ff9c7e00640 1 --2- 172.21.15.6:0/1144525677 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9c80cca30 0x7ff9c80cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.531+0000 7fcc8be00640 1 --2- 172.21.15.6:0/1370023748 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc8c15d070 0x7fcc8c068930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009940 tx=0x7fcc780091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cfb0b973781facd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f91ce400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91c00dfb30 0x7f91c0036d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:44252/0 (socket says 172.21.15.6:44252) 2024-08-17T02:26:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.531+0000 7f116f200640 1 --2- 172.21.15.6:0/653393584 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700cb190 0x7f11700cb5c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f11700d0bd0 tx=0x7f11580119b0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f91ce400640 1 -- 172.21.15.6:0/1378755742 learned_addr learned my addr 172.21.15.6:0/1378755742 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f3332000640 1 -- 172.21.15.6:0/618182851 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400a640 con 0x7f333c15d2d0 2024-08-17T02:26:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7ff9cd200640 1 --2- 172.21.15.6:0/1144525677 >> v2:172.21.15.6:3300/0 conn(0x7ff9c814fe00 0x7ff9c80cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7fcc8aa00640 1 -- 172.21.15.6:0/1370023748 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7802ae40 con 0x7fcc8c15d070 2024-08-17T02:26:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7fcc8aa00640 1 -- 172.21.15.6:0/1370023748 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc78032440 con 0x7fcc8c15d070 2024-08-17T02:26:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7fcc8aa00640 1 -- 172.21.15.6:0/1370023748 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78032820 con 0x7fcc8c15d070 2024-08-17T02:26:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f3332000640 1 -- 172.21.15.6:0/618182851 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333400a7c0 con 0x7f333c15d2d0 2024-08-17T02:26:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f3332000640 1 -- 172.21.15.6:0/618182851 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400ab80 con 0x7f333c15d2d0 2024-08-17T02:26:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f116f200640 1 -- 172.21.15.6:0/653393584 shutdown_connections 2024-08-17T02:26:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f116f200640 1 --2- 172.21.15.6:0/653393584 >> v2:172.21.15.136:3300/0 conn(0x7f117006e590 0x7f117006e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f116f200640 1 --2- 172.21.15.6:0/653393584 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700cb190 0x7f11700cb5c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f116f200640 1 --2- 172.21.15.6:0/653393584 >> v2:172.21.15.6:3300/0 conn(0x7f1170158a00 0x7f1170158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f116f200640 1 -- 172.21.15.6:0/653393584 >> 172.21.15.6:0/653393584 conn(0x7f11700cfb80 msgr2=0x7f11700cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f1000600640 1 -- 172.21.15.6:0/2879126242 shutdown_connections 2024-08-17T02:26:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f1000600640 1 -- 172.21.15.6:0/2879126242 wait complete. 2024-08-17T02:26:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f91cee00640 1 -- 172.21.15.6:0/1378755742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00391c0 con 0x7f91c0051da0 2024-08-17T02:26:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f91cee00640 1 -- 172.21.15.6:0/1378755742 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c004de50 con 0x7f91c00dfb30 2024-08-17T02:26:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f91cee00640 1 -- 172.21.15.6:0/1378755742 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c003b930 con 0x7f91c0035960 2024-08-17T02:26:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f91cd000640 1 --2- 172.21.15.6:0/1378755742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91c0051da0 0x7f91c00dea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f3341a00640 1 -- 172.21.15.6:0/618182851 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333c0add20 con 0x7f333c15d2d0 2024-08-17T02:26:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7f3341a00640 1 -- 172.21.15.6:0/618182851 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333c0ae2e0 con 0x7f333c15d2d0 2024-08-17T02:26:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.533+0000 7f91cda00640 1 -- 172.21.15.6:0/1378755742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91c00dfb30 msgr2=0x7f91c0036d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.533+0000 7f91cda00640 1 --2- 172.21.15.6:0/1378755742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91c00dfb30 0x7f91c0036d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.533+0000 7f91cda00640 1 -- 172.21.15.6:0/1378755742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91c0051da0 msgr2=0x7f91c00dea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.533+0000 7f91cda00640 1 --2- 172.21.15.6:0/1378755742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91c0051da0 0x7f91c00dea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.533+0000 7f91cda00640 1 -- 172.21.15.6:0/1378755742 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b4009390 con 0x7f91c0035960 2024-08-17T02:26:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.533+0000 7fcc91600640 1 -- 172.21.15.6:0/1370023748 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc8c15d070 msgr2=0x7fcc8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.533+0000 7fcc91600640 1 --2- 172.21.15.6:0/1370023748 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc8c15d070 0x7fcc8c068930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009940 tx=0x7fcc780091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7ff9c7e00640 1 -- 172.21.15.6:0/1144525677 >> v2:172.21.15.6:3300/0 conn(0x7ff9c814fe00 msgr2=0x7ff9c80cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7ff9c7e00640 1 --2- 172.21.15.6:0/1144525677 >> v2:172.21.15.6:3300/0 conn(0x7ff9c814fe00 0x7ff9c80cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7ff9c7e00640 1 -- 172.21.15.6:0/1144525677 >> v1:172.21.15.6:6789/0 conn(0x7ff9c80d0150 legacy=0x7ff9c815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.532+0000 7ff9c7e00640 1 -- 172.21.15.6:0/1144525677 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c80ccf10 con 0x7ff9c80cca30 2024-08-17T02:26:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.533+0000 7f91cda00640 1 --2- 172.21.15.6:0/1378755742 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91c0035960 0x7f91c0038c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009fd0 tx=0x7f91bc009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.533+0000 7f91ce400640 1 --2- 172.21.15.6:0/1378755742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91c00dfb30 0x7f91c0036d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.534+0000 7fcc91600640 1 -- 172.21.15.6:0/1370023748 shutdown_connections 2024-08-17T02:26:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.534+0000 7fcc91600640 1 --2- 172.21.15.6:0/1370023748 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc8c15d070 0x7fcc8c068930 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.534+0000 7fcc91600640 1 -- 172.21.15.6:0/1370023748 >> 172.21.15.6:0/1370023748 conn(0x7fcc8c0ce470 msgr2=0x7fcc8c095c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.534+0000 7ff9c7e00640 1 --2- 172.21.15.6:0/1144525677 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9c80cca30 0x7ff9c80cfc10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009850 tx=0x7ff9b80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c6413bc8b08e16a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.534+0000 7f116f200640 1 -- 172.21.15.6:0/653393584 shutdown_connections 2024-08-17T02:26:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.534+0000 7f116f200640 1 -- 172.21.15.6:0/653393584 wait complete. 2024-08-17T02:26:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.534+0000 7f91c4c00640 1 -- 172.21.15.6:0/1378755742 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc00f510 con 0x7f91c0035960 2024-08-17T02:26:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.534+0000 7ff9c7400640 1 -- 172.21.15.6:0/1144525677 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b802ad40 con 0x7ff9c80cca30 2024-08-17T02:26:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.534+0000 7ff9c7400640 1 -- 172.21.15.6:0/1144525677 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b8032440 con 0x7ff9c80cca30 2024-08-17T02:26:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.534+0000 7ff9c7400640 1 -- 172.21.15.6:0/1144525677 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b802aea0 con 0x7ff9c80cca30 2024-08-17T02:26:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.534+0000 7f91c4c00640 1 -- 172.21.15.6:0/1378755742 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc00f690 con 0x7f91c0035960 2024-08-17T02:26:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.534+0000 7f91cee00640 1 -- 172.21.15.6:0/1378755742 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c003bc10 con 0x7f91c0035960 2024-08-17T02:26:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.535+0000 7f91cee00640 1 -- 172.21.15.6:0/1378755742 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c003c1d0 con 0x7f91c0035960 2024-08-17T02:26:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.535+0000 7f91c4c00640 1 -- 172.21.15.6:0/1378755742 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc00fa50 con 0x7f91c0035960 2024-08-17T02:26:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.535+0000 7fcc91600640 1 -- 172.21.15.6:0/1370023748 shutdown_connections 2024-08-17T02:26:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.535+0000 7fcc91600640 1 -- 172.21.15.6:0/1370023748 wait complete. 2024-08-17T02:26:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.535+0000 7f1000600640 1 Processor -- start 2024-08-17T02:26:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.535+0000 7f1000600640 1 -- start start 2024-08-17T02:26:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.536+0000 7f3341a00640 1 -- 172.21.15.6:0/618182851 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333c12ad20 con 0x7f333c15d2d0 2024-08-17T02:26:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.537+0000 7ff9cfc00640 1 -- 172.21.15.6:0/1144525677 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9c80cca30 msgr2=0x7ff9c80cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.537+0000 7ff9cfc00640 1 --2- 172.21.15.6:0/1144525677 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9c80cca30 0x7ff9c80cfc10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009850 tx=0x7ff9b80090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.537+0000 7f116f200640 1 Processor -- start 2024-08-17T02:26:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.537+0000 7f3332000640 1 -- 172.21.15.6:0/618182851 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3334003030 con 0x7f333c15d2d0 2024-08-17T02:26:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.537+0000 7ff9cfc00640 1 -- 172.21.15.6:0/1144525677 shutdown_connections 2024-08-17T02:26:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.537+0000 7ff9cfc00640 1 --2- 172.21.15.6:0/1144525677 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9c80cca30 0x7ff9c80cfc10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.537+0000 7ff9cfc00640 1 --2- 172.21.15.6:0/1144525677 >> v2:172.21.15.6:3300/0 conn(0x7ff9c814fe00 0x7ff9c80cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.537+0000 7ff9cfc00640 1 -- 172.21.15.6:0/1144525677 >> 172.21.15.6:0/1144525677 conn(0x7ff9c8068680 msgr2=0x7ff9c8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.537+0000 7f116f200640 1 -- start start 2024-08-17T02:26:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.537+0000 7f1000600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ff80cb0d0 0x7f0ff8159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.537+0000 7ff9cfc00640 1 -- 172.21.15.6:0/1144525677 shutdown_connections 2024-08-17T02:26:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.538+0000 7fcc91600640 1 Processor -- start 2024-08-17T02:26:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.537+0000 7ff9cfc00640 1 -- 172.21.15.6:0/1144525677 wait complete. 2024-08-17T02:26:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.537+0000 7f1000600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff80cda30 0x7f0ff8171150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.538+0000 7f0ffdc00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ff80cb0d0 0x7f0ff8159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.538+0000 7f0ffdc00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ff80cb0d0 0x7f0ff8159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49592/0 (socket says 172.21.15.6:49592) 2024-08-17T02:26:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.538+0000 7f3332000640 1 --2- 172.21.15.6:0/618182851 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f33180652a0 0x7f3318067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.538+0000 7f1000600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ff81589e0 0x7f0ff8171690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.538+0000 7f1000600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80b4620 con 0x7f0ff80cda30 2024-08-17T02:26:40.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.538+0000 7f1000600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80b4900 con 0x7f0ff81589e0 2024-08-17T02:26:40.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.538+0000 7f1000600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80b4be0 con 0x7f0ff80cb0d0 2024-08-17T02:26:40.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.538+0000 7f0ffe600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ff81589e0 0x7f0ff8171690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f0ffe600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ff81589e0 0x7f0ff8171690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:44266/0 (socket says 172.21.15.6:44266) 2024-08-17T02:26:40.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f0ffe600640 1 -- 172.21.15.6:0/366214657 learned_addr learned my addr 172.21.15.6:0/366214657 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:40.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f116f200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f117006e590 0x7f1170159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f116f200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700cb190 0x7f117014dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f116f200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1170158a00 0x7f117014e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f116f200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117015abe0 con 0x7f1170158a00 2024-08-17T02:26:40.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f116f200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117014efa0 con 0x7f117006e590 2024-08-17T02:26:40.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f116f200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117014e9e0 con 0x7f11700cb190 2024-08-17T02:26:40.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.538+0000 7f3332000640 1 -- 172.21.15.6:0/618182851 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3334082320 con 0x7f333c15d2d0 2024-08-17T02:26:40.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f333aa00640 1 --2- 172.21.15.6:0/618182851 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f33180652a0 0x7f3318067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7ff9cfc00640 1 Processor -- start 2024-08-17T02:26:40.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f0ffe600640 1 -- 172.21.15.6:0/366214657 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ff80cb0d0 msgr2=0x7f0ff8159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f116de00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f117006e590 0x7f1170159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f116de00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f117006e590 0x7f1170159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:44274/0 (socket says 172.21.15.6:44274) 2024-08-17T02:26:40.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f1165400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700cb190 0x7f117014dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f1165400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700cb190 0x7f117014dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49606/0 (socket says 172.21.15.6:49606) 2024-08-17T02:26:40.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7ff9cfc00640 1 -- start start 2024-08-17T02:26:40.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.540+0000 7f1165400640 1 -- 172.21.15.6:0/3871660025 learned_addr learned my addr 172.21.15.6:0/3871660025 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:40.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f0ffe600640 1 --2- 172.21.15.6:0/366214657 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ff80cb0d0 0x7f0ff8159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f0ffe600640 1 -- 172.21.15.6:0/366214657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff80cda30 msgr2=0x7f0ff8171150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f0ffe600640 1 --2- 172.21.15.6:0/366214657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff80cda30 0x7f0ff8171150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.539+0000 7f0ffe600640 1 -- 172.21.15.6:0/366214657 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec009390 con 0x7f0ff81589e0 2024-08-17T02:26:40.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.540+0000 7f333aa00640 1 --2- 172.21.15.6:0/618182851 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f33180652a0 0x7f3318067750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3324003080 tx=0x7f3324032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.540+0000 7f0ffe600640 1 --2- 172.21.15.6:0/366214657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ff81589e0 0x7f0ff8171690 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800ea50 tx=0x7f0fe80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.540+0000 7f116e800640 1 --2- 172.21.15.6:0/3871660025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1170158a00 0x7f117014e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.536+0000 7f91cee00640 1 -- 172.21.15.6:0/1378755742 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c00056a0 con 0x7f91c0035960 2024-08-17T02:26:40.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.541+0000 7f91c4c00640 1 -- 172.21.15.6:0/1378755742 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f91bc01a400 con 0x7f91c0035960 2024-08-17T02:26:40.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.540+0000 7f1165400640 1 -- 172.21.15.6:0/3871660025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f117006e590 msgr2=0x7f1170159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.540+0000 7f1165400640 1 --2- 172.21.15.6:0/3871660025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f117006e590 0x7f1170159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.540+0000 7f1165400640 1 -- 172.21.15.6:0/3871660025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1170158a00 msgr2=0x7f117014e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.540+0000 7f1165400640 1 --2- 172.21.15.6:0/3871660025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1170158a00 0x7f117014e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.540+0000 7f1165400640 1 -- 172.21.15.6:0/3871660025 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1158011c30 con 0x7f11700cb190 2024-08-17T02:26:40.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.541+0000 7ff9cfc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9c80cca30 0x7ff9c80c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.541+0000 7f1165400640 1 --2- 172.21.15.6:0/3871660025 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700cb190 0x7f117014dd50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1158011c00 tx=0x7f115803f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.541+0000 7ff9cfc00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9c80d0150 0x7ff9c80c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.541+0000 7ff9cfc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9c814fe00 0x7ff9c80c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.541+0000 7ff9cfc00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80c7650 con 0x7ff9c814fe00 2024-08-17T02:26:40.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.541+0000 7ff9cfc00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80c7420 con 0x7ff9c80cca30 2024-08-17T02:26:40.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.541+0000 7f91c4c00640 1 --2- 172.21.15.6:0/1378755742 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91a80652a0 0x7f91a8067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.541+0000 7ff9cfc00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80b4550 con 0x7ff9c80d0150 2024-08-17T02:26:40.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.541+0000 7ff9cd200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9c80cca30 0x7ff9c80c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.541+0000 7ff9cd200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9c80cca30 0x7ff9c80c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:44278/0 (socket says 172.21.15.6:44278) 2024-08-17T02:26:40.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.541+0000 7ff9cd200640 1 -- 172.21.15.6:0/2902536795 learned_addr learned my addr 172.21.15.6:0/2902536795 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:40.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.541+0000 7fcc91600640 1 -- start start 2024-08-17T02:26:40.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.542+0000 7f91c4c00640 1 -- 172.21.15.6:0/1378755742 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91bc081d90 con 0x7f91c0035960 2024-08-17T02:26:40.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.542+0000 7ff9c7e00640 1 --2- 172.21.15.6:0/2902536795 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9c80d0150 0x7ff9c80c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.542+0000 7ff9cd200640 1 -- 172.21.15.6:0/2902536795 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9c80d0150 msgr2=0x7ff9c80c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.542+0000 7ff9cd200640 1 --2- 172.21.15.6:0/2902536795 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9c80d0150 0x7ff9c80c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.542+0000 7ff9cd200640 1 -- 172.21.15.6:0/2902536795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9c814fe00 msgr2=0x7ff9c80c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.542+0000 7ff9cd200640 1 --2- 172.21.15.6:0/2902536795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9c814fe00 0x7ff9c80c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.542+0000 7ff9cd200640 1 -- 172.21.15.6:0/2902536795 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b8009390 con 0x7ff9c80cca30 2024-08-17T02:26:40.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.542+0000 7ff9c7e00640 1 --2- 172.21.15.6:0/2902536795 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9c80d0150 0x7ff9c80c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:40.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.542+0000 7fcc91600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc8c0ab6a0 0x7fcc8c15f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7ff9cd200640 1 --2- 172.21.15.6:0/2902536795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9c80cca30 0x7ff9c80c6ee0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000b7e0 tx=0x7ff9c000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7f0ff4c00640 1 -- 172.21.15.6:0/366214657 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe800c940 con 0x7f0ff81589e0 2024-08-17T02:26:40.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7f91cd000640 1 --2- 172.21.15.6:0/1378755742 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91a80652a0 0x7f91a8067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7f3332000640 1 -- 172.21.15.6:0/618182851 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f333c12ad20 con 0x7f333c15d2d0 2024-08-17T02:26:40.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7fcc91600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc8c0ac460 0x7fcc8c160500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7fcc91600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc8c15d070 0x7fcc8c16d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7fcc91600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c160a40 con 0x7fcc8c0ac460 2024-08-17T02:26:40.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7fcc91600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c15f700 con 0x7fcc8c15d070 2024-08-17T02:26:40.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7fcc91600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c15dd90 con 0x7fcc8c0ab6a0 2024-08-17T02:26:40.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7f1000600640 1 -- 172.21.15.6:0/366214657 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff80b4ec0 con 0x7f0ff81589e0 2024-08-17T02:26:40.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7f1000600640 1 -- 172.21.15.6:0/366214657 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff81597c0 con 0x7f0ff81589e0 2024-08-17T02:26:40.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7f0ff4c00640 1 -- 172.21.15.6:0/366214657 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe800caa0 con 0x7f0ff81589e0 2024-08-17T02:26:40.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7f0ff4c00640 1 -- 172.21.15.6:0/366214657 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe800c940 con 0x7f0ff81589e0 2024-08-17T02:26:40.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7ff9bfe00640 1 -- 172.21.15.6:0/2902536795 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0019070 con 0x7ff9c80cca30 2024-08-17T02:26:40.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7ff9bfe00640 1 -- 172.21.15.6:0/2902536795 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c0016630 con 0x7ff9c80cca30 2024-08-17T02:26:40.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7ff9bfe00640 1 -- 172.21.15.6:0/2902536795 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c00169d0 con 0x7ff9c80cca30 2024-08-17T02:26:40.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7ff9cfc00640 1 -- 172.21.15.6:0/2902536795 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c80c9f40 con 0x7ff9c80cca30 2024-08-17T02:26:40.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7ff9cfc00640 1 -- 172.21.15.6:0/2902536795 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c80b3f00 con 0x7ff9c80cca30 2024-08-17T02:26:40.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7fcc8be00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc8c0ab6a0 0x7fcc8c15f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7fcc8be00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc8c0ab6a0 0x7fcc8c15f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49622/0 (socket says 172.21.15.6:49622) 2024-08-17T02:26:40.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.543+0000 7fcc8be00640 1 -- 172.21.15.6:0/2551870239 learned_addr learned my addr 172.21.15.6:0/2551870239 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:40.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.544+0000 7fcc8be00640 1 -- 172.21.15.6:0/2551870239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc8c15d070 msgr2=0x7fcc8c16d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.544+0000 7fcc90c00640 1 --2- 172.21.15.6:0/2551870239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc8c15d070 0x7fcc8c16d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.544+0000 7fcc8be00640 1 --2- 172.21.15.6:0/2551870239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc8c15d070 0x7fcc8c16d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.544+0000 7fcc8be00640 1 -- 172.21.15.6:0/2551870239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc8c0ac460 msgr2=0x7fcc8c160500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.544+0000 7fcc8b400640 1 --2- 172.21.15.6:0/2551870239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc8c0ac460 0x7fcc8c160500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.544+0000 7fcc8be00640 1 --2- 172.21.15.6:0/2551870239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc8c0ac460 0x7fcc8c160500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.544+0000 7fcc8be00640 1 -- 172.21.15.6:0/2551870239 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc78009450 con 0x7fcc8c0ab6a0 2024-08-17T02:26:40.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.545+0000 7fcc8b400640 1 --2- 172.21.15.6:0/2551870239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc8c0ac460 0x7fcc8c160500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:40.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.545+0000 7fcc8be00640 1 --2- 172.21.15.6:0/2551870239 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc8c0ab6a0 0x7fcc8c15f030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009210 tx=0x7fcc78032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.546+0000 7f91cd000640 1 --2- 172.21.15.6:0/1378755742 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91a80652a0 0x7f91a8067750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f91b4034000 tx=0x7f91b4032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.545+0000 7f1166000640 1 -- 172.21.15.6:0/3871660025 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580115b0 con 0x7f11700cb190 2024-08-17T02:26:40.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.546+0000 7f0ff4c00640 1 -- 172.21.15.6:0/366214657 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0fe8013470 con 0x7f0ff81589e0 2024-08-17T02:26:40.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.546+0000 7f1166000640 1 -- 172.21.15.6:0/3871660025 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115804d460 con 0x7f11700cb190 2024-08-17T02:26:40.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.546+0000 7f1166000640 1 -- 172.21.15.6:0/3871660025 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115804d820 con 0x7f11700cb190 2024-08-17T02:26:40.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.547+0000 7f0ff4c00640 1 --2- 172.21.15.6:0/366214657 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0fdc0651b0 0x7f0fdc067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.546+0000 7ff9cfc00640 1 -- 172.21.15.6:0/2902536795 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a0005210 con 0x7ff9c80cca30 2024-08-17T02:26:40.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.547+0000 7f116f200640 1 -- 172.21.15.6:0/3871660025 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117014ecc0 con 0x7f11700cb190 2024-08-17T02:26:40.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.546+0000 7fcc83400640 1 -- 172.21.15.6:0/2551870239 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78031a60 con 0x7fcc8c0ab6a0 2024-08-17T02:26:40.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.546+0000 7fcc83400640 1 -- 172.21.15.6:0/2551870239 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc78031be0 con 0x7fcc8c0ab6a0 2024-08-17T02:26:40.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.546+0000 7fcc83400640 1 -- 172.21.15.6:0/2551870239 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78046430 con 0x7fcc8c0ab6a0 2024-08-17T02:26:40.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.548+0000 7fcc91600640 1 -- 172.21.15.6:0/2551870239 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8c15e070 con 0x7fcc8c0ab6a0 2024-08-17T02:26:40.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.548+0000 7fcc91600640 1 -- 172.21.15.6:0/2551870239 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8c0b18f0 con 0x7fcc8c0ab6a0 2024-08-17T02:26:40.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.547+0000 7f0ff4c00640 1 -- 172.21.15.6:0/366214657 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0fe8082730 con 0x7f0ff81589e0 2024-08-17T02:26:40.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.548+0000 7f0ffdc00640 1 --2- 172.21.15.6:0/366214657 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0fdc0651b0 0x7f0fdc067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.548+0000 7f1000600640 1 -- 172.21.15.6:0/366214657 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd4005210 con 0x7f0ff81589e0 2024-08-17T02:26:40.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.547+0000 7f116f200640 1 -- 172.21.15.6:0/3871660025 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11700c6b90 con 0x7f11700cb190 2024-08-17T02:26:40.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.547+0000 7ff9bfe00640 1 -- 172.21.15.6:0/2902536795 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff9c0016d80 con 0x7ff9c80cca30 2024-08-17T02:26:40.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.548+0000 7f0ffdc00640 1 --2- 172.21.15.6:0/366214657 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0fdc0651b0 0x7f0fdc067660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0006fd0 tx=0x7f0ff0001970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.548+0000 7ff9bfe00640 1 --2- 172.21.15.6:0/2902536795 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff9a80651d0 0x7ff9a8067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.549+0000 7ff9bfe00640 1 -- 172.21.15.6:0/2902536795 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9c008b410 con 0x7ff9c80cca30 2024-08-17T02:26:40.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.549+0000 7ff9c7e00640 1 --2- 172.21.15.6:0/2902536795 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff9a80651d0 0x7ff9a8067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.549+0000 7fcc91600640 1 -- 172.21.15.6:0/2551870239 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8c0b1b10 con 0x7fcc8c0ab6a0 2024-08-17T02:26:40.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.550+0000 7ff9c7e00640 1 --2- 172.21.15.6:0/2902536795 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff9a80651d0 0x7ff9a8067680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8034000 tx=0x7ff9b8032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.550+0000 7f91c4c00640 1 -- 172.21.15.6:0/1378755742 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f91bc04feb0 con 0x7f91c0035960 2024-08-17T02:26:40.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.551+0000 7fcc83400640 1 -- 172.21.15.6:0/2551870239 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcc78039040 con 0x7fcc8c0ab6a0 2024-08-17T02:26:40.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.553+0000 7fcc83400640 1 --2- 172.21.15.6:0/2551870239 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fcc6c0652a0 0x7fcc6c067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.553+0000 7fcc83400640 1 -- 172.21.15.6:0/2551870239 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc78041030 con 0x7fcc8c0ab6a0 2024-08-17T02:26:40.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.551+0000 7f116f200640 1 -- 172.21.15.6:0/3871660025 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1170070700 con 0x7f11700cb190 2024-08-17T02:26:40.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.553+0000 7fcc8b400640 1 --2- 172.21.15.6:0/2551870239 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fcc6c0652a0 0x7fcc6c067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.553+0000 7f1166000640 1 -- 172.21.15.6:0/3871660025 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1158044420 con 0x7f11700cb190 2024-08-17T02:26:40.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.554+0000 7ff9bfe00640 1 -- 172.21.15.6:0/2902536795 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff9c0059430 con 0x7ff9c80cca30 2024-08-17T02:26:40.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.555+0000 7fcc8b400640 1 --2- 172.21.15.6:0/2551870239 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fcc6c0652a0 0x7fcc6c067750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c0b35a0 tx=0x7fcc7c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.555+0000 7f1166000640 1 --2- 172.21.15.6:0/3871660025 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f114c065150 0x7f114c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.555+0000 7f1166000640 1 -- 172.21.15.6:0/3871660025 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f11580ac2a0 con 0x7f11700cb190 2024-08-17T02:26:40.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.555+0000 7f116de00640 1 --2- 172.21.15.6:0/3871660025 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f114c065150 0x7f114c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.556+0000 7f116de00640 1 --2- 172.21.15.6:0/3871660025 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f114c065150 0x7f114c067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f11600075a0 tx=0x7f11600097e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.556+0000 7fcc83400640 1 -- 172.21.15.6:0/2551870239 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcc78071330 con 0x7fcc8c0ab6a0 2024-08-17T02:26:40.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.557+0000 7f0ff4c00640 1 -- 172.21.15.6:0/366214657 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0fe8054290 con 0x7f0ff81589e0 2024-08-17T02:26:40.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.560+0000 7f1166000640 1 -- 172.21.15.6:0/3871660025 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f115807a340 con 0x7f11700cb190 2024-08-17T02:26:40.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.883+0000 7fe3fd600640 1 -- 172.21.15.6:0/2837210475 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe3e00054c0 con 0x7fe40404f1d0 2024-08-17T02:26:40.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.884+0000 7fe3ffe00640 1 -- 172.21.15.6:0/2837210475 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe40c0eb2e0 con 0x7fe40404f1d0 2024-08-17T02:26:40.888 INFO:teuthology.orchestra.run.smithi006.stdout:55834574852 2024-08-17T02:26:40.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.887+0000 7fe3fd600640 1 -- 172.21.15.6:0/2837210475 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe3ec065230 msgr2=0x7fe3ec0676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.887+0000 7fe3fd600640 1 --2- 172.21.15.6:0/2837210475 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe3ec065230 0x7fe3ec0676e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe40403a930 tx=0x7fe400006f50 comp rx=0 tx=0).stop 2024-08-17T02:26:40.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.887+0000 7fe3fd600640 1 -- 172.21.15.6:0/2837210475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe40404f1d0 msgr2=0x7fe40404af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.887+0000 7fe3fd600640 1 --2- 172.21.15.6:0/2837210475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe40404f1d0 0x7fe40404af60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe40c04c780 tx=0x7fe40c0ab000 comp rx=0 tx=0).stop 2024-08-17T02:26:40.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.888+0000 7fe3fd600640 1 -- 172.21.15.6:0/2837210475 shutdown_connections 2024-08-17T02:26:40.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.888+0000 7fe3fd600640 1 --2- 172.21.15.6:0/2837210475 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe3ec065230 0x7fe3ec0676e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.888+0000 7fe3fd600640 1 --2- 172.21.15.6:0/2837210475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4040de700 0x7fe404039bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.888+0000 7fe3fd600640 1 --2- 172.21.15.6:0/2837210475 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe404052110 0x7fe404039690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.888+0000 7fe3fd600640 1 --2- 172.21.15.6:0/2837210475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe40404f1d0 0x7fe40404af60 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe40c04c780 tx=0x7fe40c0ab000 comp rx=0 tx=0).stop 2024-08-17T02:26:40.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.888+0000 7fe3fd600640 1 -- 172.21.15.6:0/2837210475 >> 172.21.15.6:0/2837210475 conn(0x7fe404051600 msgr2=0x7fe4040e4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.888+0000 7fe3fd600640 1 -- 172.21.15.6:0/2837210475 shutdown_connections 2024-08-17T02:26:40.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.888+0000 7fe3fd600640 1 -- 172.21.15.6:0/2837210475 wait complete. 2024-08-17T02:26:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.893+0000 7fa06be00640 1 -- 172.21.15.6:0/2756035106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa0400054c0 con 0x7fa064154e30 2024-08-17T02:26:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.893+0000 7fa060c00640 1 -- 172.21.15.6:0/2756035106 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa05c0545e0 con 0x7fa064154e30 2024-08-17T02:26:40.897 INFO:teuthology.orchestra.run.smithi006.stdout:55834574852 2024-08-17T02:26:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.898+0000 7fa06be00640 1 -- 172.21.15.6:0/2756035106 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa044065200 msgr2=0x7fa0440676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.898+0000 7fa06be00640 1 --2- 172.21.15.6:0/2756035106 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa044065200 0x7fa0440676b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa050034000 tx=0x7fa050035000 comp rx=0 tx=0).stop 2024-08-17T02:26:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.898+0000 7fa06be00640 1 -- 172.21.15.6:0/2756035106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa064154e30 msgr2=0x7fa064148210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.898+0000 7fa06be00640 1 --2- 172.21.15.6:0/2756035106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa064154e30 0x7fa064148210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009fc0 tx=0x7fa05c00b040 comp rx=0 tx=0).stop 2024-08-17T02:26:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.898+0000 7fa06be00640 1 -- 172.21.15.6:0/2756035106 shutdown_connections 2024-08-17T02:26:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.898+0000 7fa06be00640 1 --2- 172.21.15.6:0/2756035106 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa044065200 0x7fa0440676b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.898+0000 7fa06be00640 1 --2- 172.21.15.6:0/2756035106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa064154e30 0x7fa064148210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.898+0000 7fa06be00640 1 --2- 172.21.15.6:0/2756035106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa064154a60 0x7fa0640ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.898+0000 7fa06be00640 1 --2- 172.21.15.6:0/2756035106 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa0640abe60 0x7fa064153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.898+0000 7fa06be00640 1 -- 172.21.15.6:0/2756035106 >> 172.21.15.6:0/2756035106 conn(0x7fa0640c8260 msgr2=0x7fa0640aa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.899+0000 7fa06be00640 1 -- 172.21.15.6:0/2756035106 shutdown_connections 2024-08-17T02:26:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.899+0000 7fa06be00640 1 -- 172.21.15.6:0/2756035106 wait complete. 2024-08-17T02:26:40.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2024-08-17T02:26:40.917 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:40.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.3 2024-08-17T02:26:40.926 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:40.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.941+0000 7f91cee00640 1 -- 172.21.15.6:0/1378755742 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f91c00522a0 con 0x7f91c0035960 2024-08-17T02:26:40.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.942+0000 7f91c4c00640 1 -- 172.21.15.6:0/1378755742 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91bc0534d0 con 0x7f91c0035960 2024-08-17T02:26:40.943 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2024-08-17T02:26:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.944+0000 7f91cee00640 1 -- 172.21.15.6:0/1378755742 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91a80652a0 msgr2=0x7f91a8067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.944+0000 7f91cee00640 1 --2- 172.21.15.6:0/1378755742 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91a80652a0 0x7f91a8067750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f91b4034000 tx=0x7f91b4032000 comp rx=0 tx=0).stop 2024-08-17T02:26:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.944+0000 7f91cee00640 1 -- 172.21.15.6:0/1378755742 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91c0035960 msgr2=0x7f91c0038c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.944+0000 7f91cee00640 1 --2- 172.21.15.6:0/1378755742 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91c0035960 0x7f91c0038c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009fd0 tx=0x7f91bc009060 comp rx=0 tx=0).stop 2024-08-17T02:26:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.945+0000 7f91cee00640 1 -- 172.21.15.6:0/1378755742 shutdown_connections 2024-08-17T02:26:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.945+0000 7f91cee00640 1 --2- 172.21.15.6:0/1378755742 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f91a80652a0 0x7f91a8067750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.945+0000 7f91cee00640 1 --2- 172.21.15.6:0/1378755742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91c00dfb30 0x7f91c0036d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.945+0000 7f91cee00640 1 --2- 172.21.15.6:0/1378755742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91c0051da0 0x7f91c00dea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.945+0000 7f91cee00640 1 --2- 172.21.15.6:0/1378755742 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91c0035960 0x7f91c0038c80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.945+0000 7f91cee00640 1 -- 172.21.15.6:0/1378755742 >> 172.21.15.6:0/1378755742 conn(0x7f91c000a800 msgr2=0x7f91c00dff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.945+0000 7f91cee00640 1 -- 172.21.15.6:0/1378755742 shutdown_connections 2024-08-17T02:26:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.945+0000 7f91cee00640 1 -- 172.21.15.6:0/1378755742 wait complete. 2024-08-17T02:26:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.947+0000 7fcc91600640 1 -- 172.21.15.6:0/2551870239 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcc8c070720 con 0x7fcc8c0ab6a0 2024-08-17T02:26:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.948+0000 7fcc83400640 1 -- 172.21.15.6:0/2551870239 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcc78074950 con 0x7fcc8c0ab6a0 2024-08-17T02:26:40.948 INFO:teuthology.orchestra.run.smithi006.stdout:55834574852 2024-08-17T02:26:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.950+0000 7fcc91600640 1 -- 172.21.15.6:0/2551870239 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fcc6c0652a0 msgr2=0x7fcc6c067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.950+0000 7fcc91600640 1 --2- 172.21.15.6:0/2551870239 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fcc6c0652a0 0x7fcc6c067750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c0b35a0 tx=0x7fcc7c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.950+0000 7fcc91600640 1 -- 172.21.15.6:0/2551870239 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc8c0ab6a0 msgr2=0x7fcc8c15f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.950+0000 7fcc91600640 1 --2- 172.21.15.6:0/2551870239 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc8c0ab6a0 0x7fcc8c15f030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009210 tx=0x7fcc78032000 comp rx=0 tx=0).stop 2024-08-17T02:26:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.950+0000 7fcc91600640 1 -- 172.21.15.6:0/2551870239 shutdown_connections 2024-08-17T02:26:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.950+0000 7fcc91600640 1 --2- 172.21.15.6:0/2551870239 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fcc6c0652a0 0x7fcc6c067750 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.950+0000 7fcc91600640 1 --2- 172.21.15.6:0/2551870239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc8c15d070 0x7fcc8c16d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.950+0000 7fcc91600640 1 --2- 172.21.15.6:0/2551870239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc8c0ac460 0x7fcc8c160500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.950+0000 7fcc91600640 1 --2- 172.21.15.6:0/2551870239 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc8c0ab6a0 0x7fcc8c15f030 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.950+0000 7fcc91600640 1 -- 172.21.15.6:0/2551870239 >> 172.21.15.6:0/2551870239 conn(0x7fcc8c0ce470 msgr2=0x7fcc8c06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.951+0000 7fcc91600640 1 -- 172.21.15.6:0/2551870239 shutdown_connections 2024-08-17T02:26:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.951+0000 7fcc91600640 1 -- 172.21.15.6:0/2551870239 wait complete. 2024-08-17T02:26:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.954+0000 7f3341a00640 1 -- 172.21.15.6:0/618182851 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f333c0ae800 con 0x7f333c15d2d0 2024-08-17T02:26:40.955 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2024-08-17T02:26:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.955+0000 7f3332000640 1 -- 172.21.15.6:0/618182851 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f333c0ae800 con 0x7f333c15d2d0 2024-08-17T02:26:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.958+0000 7f3341a00640 1 -- 172.21.15.6:0/618182851 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f33180652a0 msgr2=0x7f3318067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.958+0000 7f3341a00640 1 --2- 172.21.15.6:0/618182851 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f33180652a0 0x7f3318067750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3324003080 tx=0x7f3324032000 comp rx=0 tx=0).stop 2024-08-17T02:26:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.958+0000 7f3341a00640 1 -- 172.21.15.6:0/618182851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f333c15d2d0 msgr2=0x7f333c0b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.958+0000 7f3341a00640 1 --2- 172.21.15.6:0/618182851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f333c15d2d0 0x7f333c0b2360 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f333400c790 tx=0x7f3334001560 comp rx=0 tx=0).stop 2024-08-17T02:26:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.958+0000 7f3341a00640 1 -- 172.21.15.6:0/618182851 shutdown_connections 2024-08-17T02:26:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.958+0000 7f3341a00640 1 --2- 172.21.15.6:0/618182851 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f33180652a0 0x7f3318067750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.958+0000 7f3341a00640 1 --2- 172.21.15.6:0/618182851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f333c15d2d0 0x7f333c0b2360 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.958+0000 7f3341a00640 1 --2- 172.21.15.6:0/618182851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f333c0cac80 0x7f333c0ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.958+0000 7f3341a00640 1 --2- 172.21.15.6:0/618182851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333c068680 0x7f333c15b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.958+0000 7f3341a00640 1 -- 172.21.15.6:0/618182851 >> 172.21.15.6:0/618182851 conn(0x7f333c0ce590 msgr2=0x7f333c0ac660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.958+0000 7f3341a00640 1 -- 172.21.15.6:0/618182851 shutdown_connections 2024-08-17T02:26:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.958+0000 7f3341a00640 1 -- 172.21.15.6:0/618182851 wait complete. 2024-08-17T02:26:40.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-08-17T02:26:40.967 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:40.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2024-08-17T02:26:40.973 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:40.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.976+0000 7f1000600640 1 -- 172.21.15.6:0/366214657 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0fd40054c0 con 0x7f0ff81589e0 2024-08-17T02:26:40.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.977+0000 7f0ff4c00640 1 -- 172.21.15.6:0/366214657 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0fe8021030 con 0x7f0ff81589e0 2024-08-17T02:26:40.979 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2024-08-17T02:26:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.979+0000 7f116f200640 1 -- 172.21.15.6:0/3871660025 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f117015ad90 con 0x7f11700cb190 2024-08-17T02:26:40.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-08-17T02:26:40.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.980+0000 7f1166000640 1 -- 172.21.15.6:0/3871660025 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f115807d960 con 0x7f11700cb190 2024-08-17T02:26:40.981 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2024-08-17T02:26:40.981 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.981+0000 7f1000600640 1 -- 172.21.15.6:0/366214657 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0fdc0651b0 msgr2=0x7f0fdc067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.981+0000 7f1000600640 1 --2- 172.21.15.6:0/366214657 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0fdc0651b0 0x7f0fdc067660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0006fd0 tx=0x7f0ff0001970 comp rx=0 tx=0).stop 2024-08-17T02:26:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.981+0000 7f1000600640 1 -- 172.21.15.6:0/366214657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ff81589e0 msgr2=0x7f0ff8171690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.981+0000 7f1000600640 1 --2- 172.21.15.6:0/366214657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ff81589e0 0x7f0ff8171690 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800ea50 tx=0x7f0fe80090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.981+0000 7f1000600640 1 -- 172.21.15.6:0/366214657 shutdown_connections 2024-08-17T02:26:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.981+0000 7f1000600640 1 --2- 172.21.15.6:0/366214657 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0fdc0651b0 0x7f0fdc067660 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.981+0000 7f1000600640 1 --2- 172.21.15.6:0/366214657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ff81589e0 0x7f0ff8171690 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.981+0000 7f1000600640 1 --2- 172.21.15.6:0/366214657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff80cda30 0x7f0ff8171150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.981+0000 7f1000600640 1 --2- 172.21.15.6:0/366214657 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ff80cb0d0 0x7f0ff8159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.981+0000 7f1000600640 1 -- 172.21.15.6:0/366214657 >> 172.21.15.6:0/366214657 conn(0x7f0ff806e590 msgr2=0x7f0ff80b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.981+0000 7f1000600640 1 -- 172.21.15.6:0/366214657 shutdown_connections 2024-08-17T02:26:40.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.981+0000 7f1000600640 1 -- 172.21.15.6:0/366214657 wait complete. 2024-08-17T02:26:40.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.982+0000 7ff9cfc00640 1 -- 172.21.15.6:0/2902536795 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff9a00054c0 con 0x7ff9c80cca30 2024-08-17T02:26:40.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.982+0000 7ff9bfe00640 1 -- 172.21.15.6:0/2902536795 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9c005ca50 con 0x7ff9c80cca30 2024-08-17T02:26:40.984 INFO:teuthology.orchestra.run.smithi006.stdout:55834574852 2024-08-17T02:26:40.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.982+0000 7f116f200640 1 -- 172.21.15.6:0/3871660025 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f114c065150 msgr2=0x7f114c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.982+0000 7f116f200640 1 --2- 172.21.15.6:0/3871660025 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f114c065150 0x7f114c067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f11600075a0 tx=0x7f11600097e0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.982+0000 7f116f200640 1 -- 172.21.15.6:0/3871660025 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700cb190 msgr2=0x7f117014dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.982+0000 7f116f200640 1 --2- 172.21.15.6:0/3871660025 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700cb190 0x7f117014dd50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1158011c00 tx=0x7f115803f000 comp rx=0 tx=0).stop 2024-08-17T02:26:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.983+0000 7f116f200640 1 -- 172.21.15.6:0/3871660025 shutdown_connections 2024-08-17T02:26:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.983+0000 7f116f200640 1 --2- 172.21.15.6:0/3871660025 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f114c065150 0x7f114c067600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.983+0000 7f116f200640 1 --2- 172.21.15.6:0/3871660025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1170158a00 0x7f117014e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.983+0000 7f116f200640 1 --2- 172.21.15.6:0/3871660025 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700cb190 0x7f117014dd50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.983+0000 7f116f200640 1 --2- 172.21.15.6:0/3871660025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f117006e590 0x7f1170159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.983+0000 7f116f200640 1 -- 172.21.15.6:0/3871660025 >> 172.21.15.6:0/3871660025 conn(0x7f11700cfb80 msgr2=0x7f11700cc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.983+0000 7f116f200640 1 -- 172.21.15.6:0/3871660025 shutdown_connections 2024-08-17T02:26:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.983+0000 7f116f200640 1 -- 172.21.15.6:0/3871660025 wait complete. 2024-08-17T02:26:40.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.984+0000 7ff9cfc00640 1 -- 172.21.15.6:0/2902536795 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff9a80651d0 msgr2=0x7ff9a8067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.984+0000 7ff9cfc00640 1 --2- 172.21.15.6:0/2902536795 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff9a80651d0 0x7ff9a8067680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8034000 tx=0x7ff9b8032000 comp rx=0 tx=0).stop 2024-08-17T02:26:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.985+0000 7ff9cfc00640 1 -- 172.21.15.6:0/2902536795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9c80cca30 msgr2=0x7ff9c80c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.985+0000 7ff9cfc00640 1 --2- 172.21.15.6:0/2902536795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9c80cca30 0x7ff9c80c6ee0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000b7e0 tx=0x7ff9c000b040 comp rx=0 tx=0).stop 2024-08-17T02:26:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.985+0000 7ff9cfc00640 1 -- 172.21.15.6:0/2902536795 shutdown_connections 2024-08-17T02:26:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.985+0000 7ff9cfc00640 1 --2- 172.21.15.6:0/2902536795 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff9a80651d0 0x7ff9a8067680 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.985+0000 7ff9cfc00640 1 --2- 172.21.15.6:0/2902536795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9c814fe00 0x7ff9c80c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.985+0000 7ff9cfc00640 1 --2- 172.21.15.6:0/2902536795 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9c80d0150 0x7ff9c80c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.985+0000 7ff9cfc00640 1 --2- 172.21.15.6:0/2902536795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9c80cca30 0x7ff9c80c6ee0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.985+0000 7ff9cfc00640 1 -- 172.21.15.6:0/2902536795 >> 172.21.15.6:0/2902536795 conn(0x7ff9c8068680 msgr2=0x7ff9c815a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.985+0000 7ff9cfc00640 1 -- 172.21.15.6:0/2902536795 shutdown_connections 2024-08-17T02:26:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:40.985+0000 7ff9cfc00640 1 -- 172.21.15.6:0/2902536795 wait complete. 2024-08-17T02:26:41.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2024-08-17T02:26:41.004 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:41.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-08-17T02:26:41.006 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:41.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2024-08-17T02:26:41.006 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:41.006 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:26:41.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.197+0000 7fb745a00640 1 Processor -- start 2024-08-17T02:26:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.198+0000 7fb745a00640 1 -- start start 2024-08-17T02:26:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.199+0000 7fb745a00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb740158990 0x7fb7400ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.199+0000 7fb745a00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7400ce930 con 0x7fb740158d60 2024-08-17T02:26:41.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.199+0000 7fb745a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7400cdd20 con 0x7fb7400cd810 2024-08-17T02:26:41.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.199+0000 7fb745a00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7400ce000 con 0x7fb740158990 2024-08-17T02:26:41.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.199+0000 7fb73fe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb740158990 0x7fb7400ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.199+0000 7fb73fe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb740158990 0x7fb7400ca210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57216/0 (socket says 172.21.15.6:57216) 2024-08-17T02:26:41.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.199+0000 7fb73fe00640 1 -- 172.21.15.6:0/961570013 learned_addr learned my addr 172.21.15.6:0/961570013 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:41.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.199+0000 7fb73fe00640 1 -- 172.21.15.6:0/961570013 >> v1:172.21.15.136:6789/0 conn(0x7fb7400cd810 legacy=0x7fb7400cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.199+0000 7fb73fe00640 1 -- 172.21.15.6:0/961570013 >> v1:172.21.15.6:6789/0 conn(0x7fb740158d60 legacy=0x7fb7400af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.199+0000 7fb73fe00640 1 -- 172.21.15.6:0/961570013 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7400ce2e0 con 0x7fb740158990 2024-08-17T02:26:41.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.199+0000 7fb73f400640 1 -- 172.21.15.6:0/961570013 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3764854256 0 0) 0x7fb7400ce930 con 0x7fb740158d60 2024-08-17T02:26:41.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.200+0000 7fb73fe00640 1 --2- 172.21.15.6:0/961570013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb740158990 0x7fb7400ca210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb730009910 tx=0x7fb7300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a825b8a3e866052 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.201+0000 7fb73f400640 1 -- 172.21.15.6:0/961570013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73002f510 con 0x7fb740158990 2024-08-17T02:26:41.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.201+0000 7fb73f400640 1 -- 172.21.15.6:0/961570013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73002d050 con 0x7fb740158990 2024-08-17T02:26:41.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.201+0000 7fb73f400640 1 -- 172.21.15.6:0/961570013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73002f8a0 con 0x7fb740158990 2024-08-17T02:26:41.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.201+0000 7fb745a00640 1 -- 172.21.15.6:0/961570013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb740158990 msgr2=0x7fb7400ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.201+0000 7fb745a00640 1 --2- 172.21.15.6:0/961570013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb740158990 0x7fb7400ca210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb730009910 tx=0x7fb7300091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.201+0000 7fb745a00640 1 -- 172.21.15.6:0/961570013 shutdown_connections 2024-08-17T02:26:41.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.201+0000 7fb745a00640 1 --2- 172.21.15.6:0/961570013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb740158990 0x7fb7400ca210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.201+0000 7fb745a00640 1 -- 172.21.15.6:0/961570013 >> 172.21.15.6:0/961570013 conn(0x7fb74006e590 msgr2=0x7fb74006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.201+0000 7fb745a00640 1 -- 172.21.15.6:0/961570013 shutdown_connections 2024-08-17T02:26:41.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.201+0000 7fb745a00640 1 -- 172.21.15.6:0/961570013 wait complete. 2024-08-17T02:26:41.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.203+0000 7fb745a00640 1 Processor -- start 2024-08-17T02:26:41.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.203+0000 7fb745a00640 1 -- start start 2024-08-17T02:26:41.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.204+0000 7fb745a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb7400cd810 0x7fb74015bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.204+0000 7fb745a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb740158990 0x7fb740159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.204+0000 7fb745a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb740158d60 0x7fb7400b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.204+0000 7fb745a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400c7510 con 0x7fb740158d60 2024-08-17T02:26:41.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.204+0000 7fb745a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb740159740 con 0x7fb740158990 2024-08-17T02:26:41.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.204+0000 7fb745a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400c6f50 con 0x7fb7400cd810 2024-08-17T02:26:41.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.204+0000 7fb73fe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb7400cd810 0x7fb74015bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.204+0000 7fb737e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb740158990 0x7fb740159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.204+0000 7fb745000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb740158d60 0x7fb7400b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.204+0000 7fb73fe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb7400cd810 0x7fb74015bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:49638/0 (socket says 172.21.15.6:49638) 2024-08-17T02:26:41.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.204+0000 7fb73fe00640 1 -- 172.21.15.6:0/2093231014 learned_addr learned my addr 172.21.15.6:0/2093231014 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.205+0000 7fb745000640 1 -- 172.21.15.6:0/2093231014 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb7400cd810 msgr2=0x7fb74015bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.205+0000 7fb745000640 1 --2- 172.21.15.6:0/2093231014 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb7400cd810 0x7fb74015bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.205+0000 7fb745000640 1 -- 172.21.15.6:0/2093231014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb740158990 msgr2=0x7fb740159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.205+0000 7fb745000640 1 --2- 172.21.15.6:0/2093231014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb740158990 0x7fb740159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.205+0000 7fb745000640 1 -- 172.21.15.6:0/2093231014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb730009450 con 0x7fb740158d60 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.205+0000 7fb745000640 1 --2- 172.21.15.6:0/2093231014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb740158d60 0x7fb7400b2db0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb73800c810 tx=0x7fb7380014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.205+0000 7fb737400640 1 -- 172.21.15.6:0/2093231014 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73800a640 con 0x7fb740158d60 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.205+0000 7fb737400640 1 -- 172.21.15.6:0/2093231014 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73800a7c0 con 0x7fb740158d60 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.205+0000 7fb737400640 1 -- 172.21.15.6:0/2093231014 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73800ab80 con 0x7fb740158d60 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.205+0000 7fb745a00640 1 -- 172.21.15.6:0/2093231014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7400c7230 con 0x7fb740158d60 2024-08-17T02:26:41.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.205+0000 7fb745a00640 1 -- 172.21.15.6:0/2093231014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7400c85d0 con 0x7fb740158d60 2024-08-17T02:26:41.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.207+0000 7fb745a00640 1 -- 172.21.15.6:0/2093231014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7400c87f0 con 0x7fb740158d60 2024-08-17T02:26:41.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.207+0000 7fb737400640 1 -- 172.21.15.6:0/2093231014 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb738003030 con 0x7fb740158d60 2024-08-17T02:26:41.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.208+0000 7fb737400640 1 --2- 172.21.15.6:0/2093231014 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb71c065150 0x7fb71c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.208+0000 7fb737400640 1 -- 172.21.15.6:0/2093231014 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb738082250 con 0x7fb740158d60 2024-08-17T02:26:41.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.209+0000 7fb73fe00640 1 --2- 172.21.15.6:0/2093231014 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb71c065150 0x7fb71c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.209+0000 7fb73fe00640 1 --2- 172.21.15.6:0/2093231014 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb71c065150 0x7fb71c067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb730009210 tx=0x7fb730035000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.212+0000 7fb737400640 1 -- 172.21.15.6:0/2093231014 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb7380503c0 con 0x7fb740158d60 2024-08-17T02:26:41.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.392+0000 7fb745a00640 1 -- 172.21.15.6:0/2093231014 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb740070720 con 0x7fb71c065150 2024-08-17T02:26:41.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.401+0000 7fb737400640 1 -- 172.21.15.6:0/2093231014 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264522 (secure 0 0 0) 0x7fb740070720 con 0x7fb71c065150 2024-08-17T02:26:41.405 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-08-17T02:26:41.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.405+0000 7fb745a00640 1 -- 172.21.15.6:0/2093231014 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb71c065150 msgr2=0x7fb71c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.405+0000 7fb745a00640 1 --2- 172.21.15.6:0/2093231014 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb71c065150 0x7fb71c067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb730009210 tx=0x7fb730035000 comp rx=0 tx=0).stop 2024-08-17T02:26:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.405+0000 7fb745a00640 1 -- 172.21.15.6:0/2093231014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb740158d60 msgr2=0x7fb7400b2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.405+0000 7fb745a00640 1 --2- 172.21.15.6:0/2093231014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb740158d60 0x7fb7400b2db0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb73800c810 tx=0x7fb7380014d0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.405+0000 7fb745a00640 1 -- 172.21.15.6:0/2093231014 shutdown_connections 2024-08-17T02:26:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.405+0000 7fb745a00640 1 --2- 172.21.15.6:0/2093231014 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb71c065150 0x7fb71c067600 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.405+0000 7fb745a00640 1 --2- 172.21.15.6:0/2093231014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb740158d60 0x7fb7400b2db0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.405+0000 7fb745a00640 1 --2- 172.21.15.6:0/2093231014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb740158990 0x7fb740159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.405+0000 7fb745a00640 1 --2- 172.21.15.6:0/2093231014 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb7400cd810 0x7fb74015bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.405+0000 7fb745a00640 1 -- 172.21.15.6:0/2093231014 >> 172.21.15.6:0/2093231014 conn(0x7fb74006e590 msgr2=0x7fb740155e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.405+0000 7fb745a00640 1 -- 172.21.15.6:0/2093231014 shutdown_connections 2024-08-17T02:26:41.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.405+0000 7fb745a00640 1 -- 172.21.15.6:0/2093231014 wait complete. 2024-08-17T02:26:41.421 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-17T02:26:39.409533+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381816,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592904,"statfs":{"total":773094113280,"available":770655133696,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001887"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.203459+0000","last_change":"2024-08-17T02:26:32.199441+0000","last_active":"2024-08-17T02:26:32.203459+0000","last_peered":"2024-08-17T02:26:32.203459+0000","last_clean":"2024-08-17T02:26:32.203459+0000","last_became_active":"2024-08-17T02:26:32.195327+0000","last_became_peered":"2024-08-17T02:26:32.195327+0000","last_unstale":"2024-08-17T02:26:32.203459+0000","last_undegraded":"2024-08-17T02:26:32.203459+0000","last_fullsized":"2024-08-17T02:26:32.203459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:23.907523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.202662+0000","last_change":"2024-08-17T02:26:32.199560+0000","last_active":"2024-08-17T02:26:32.202662+0000","last_peered":"2024-08-17T02:26:32.202662+0000","last_clean":"2024-08-17T02:26:32.202662+0000","last_became_active":"2024-08-17T02:26:32.199175+0000","last_became_peered":"2024-08-17T02:26:32.199175+0000","last_unstale":"2024-08-17T02:26:32.202662+0000","last_undegraded":"2024-08-17T02:26:32.202662+0000","last_fullsized":"2024-08-17T02:26:32.202662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:47.234447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.207600+0000","last_change":"2024-08-17T02:26:32.203519+0000","last_active":"2024-08-17T02:26:32.207600+0000","last_peered":"2024-08-17T02:26:32.207600+0000","last_clean":"2024-08-17T02:26:32.207600+0000","last_became_active":"2024-08-17T02:26:32.202958+0000","last_became_peered":"2024-08-17T02:26:32.202958+0000","last_unstale":"2024-08-17T02:26:32.207600+0000","last_undegraded":"2024-08-17T02:26:32.207600+0000","last_fullsized":"2024-08-17T02:26:32.207600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:18.537099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.227468+0000","last_change":"2024-08-17T02:26:32.225955+0000","last_active":"2024-08-17T02:26:32.227468+0000","last_peered":"2024-08-17T02:26:32.227468+0000","last_clean":"2024-08-17T02:26:32.227468+0000","last_became_active":"2024-08-17T02:26:32.225708+0000","last_became_peered":"2024-08-17T02:26:32.225708+0000","last_unstale":"2024-08-17T02:26:32.227468+0000","last_undegraded":"2024-08-17T02:26:32.227468+0000","last_fullsized":"2024-08-17T02:26:32.227468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:25:34.108888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.208559+0000","last_change":"2024-08-17T02:26:32.204692+0000","last_active":"2024-08-17T02:26:32.208559+0000","last_peered":"2024-08-17T02:26:32.208559+0000","last_clean":"2024-08-17T02:26:32.208559+0000","last_became_active":"2024-08-17T02:26:32.203666+0000","last_became_peered":"2024-08-17T02:26:32.203666+0000","last_unstale":"2024-08-17T02:26:32.208559+0000","last_undegraded":"2024-08-17T02:26:32.208559+0000","last_fullsized":"2024-08-17T02:26:32.208559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:25:34.108888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.214622+0000","last_change":"2024-08-17T02:26:32.209096+0000","last_active":"2024-08-17T02:26:32.214622+0000","last_peered":"2024-08-17T02:26:32.214622+0000","last_clean":"2024-08-17T02:26:32.214622+0000","last_became_active":"2024-08-17T02:26:32.208883+0000","last_became_peered":"2024-08-17T02:26:32.208883+0000","last_unstale":"2024-08-17T02:26:32.214622+0000","last_undegraded":"2024-08-17T02:26:32.214622+0000","last_fullsized":"2024-08-17T02:26:32.214622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:25.408345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.207833+0000","last_change":"2024-08-17T02:26:32.201368+0000","last_active":"2024-08-17T02:26:32.207833+0000","last_peered":"2024-08-17T02:26:32.207833+0000","last_clean":"2024-08-17T02:26:32.207833+0000","last_became_active":"2024-08-17T02:26:32.200370+0000","last_became_peered":"2024-08-17T02:26:32.200370+0000","last_unstale":"2024-08-17T02:26:32.207833+0000","last_undegraded":"2024-08-17T02:26:32.207833+0000","last_fullsized":"2024-08-17T02:26:32.207833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:15:23.868986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.220653+0000","last_change":"2024-08-17T02:26:32.215927+0000","last_active":"2024-08-17T02:26:32.220653+0000","last_peered":"2024-08-17T02:26:32.220653+0000","last_clean":"2024-08-17T02:26:32.220653+0000","last_became_active":"2024-08-17T02:26:32.215631+0000","last_became_peered":"2024-08-17T02:26:32.215631+0000","last_unstale":"2024-08-17T02:26:32.220653+0000","last_undegraded":"2024-08-17T02:26:32.220653+0000","last_fullsized":"2024-08-17T02:26:32.220653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223514+0000","last_change":"2024-08-17T02:26:32.218745+0000","last_active":"2024-08-17T02:26:32.223514+0000","last_peered":"2024-08-17T02:26:32.223514+0000","last_clean":"2024-08-17T02:26:32.223514+0000","last_became_active":"2024-08-17T02:26:32.218069+0000","last_became_peered":"2024-08-17T02:26:32.218069+0000","last_unstale":"2024-08-17T02:26:32.223514+0000","last_undegraded":"2024-08-17T02:26:32.223514+0000","last_fullsized":"2024-08-17T02:26:32.223514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:53.799652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.219488+0000","last_change":"2024-08-17T02:26:32.215519+0000","last_active":"2024-08-17T02:26:32.219488+0000","last_peered":"2024-08-17T02:26:32.219488+0000","last_clean":"2024-08-17T02:26:32.219488+0000","last_became_active":"2024-08-17T02:26:32.215218+0000","last_became_peered":"2024-08-17T02:26:32.215218+0000","last_unstale":"2024-08-17T02:26:32.219488+0000","last_undegraded":"2024-08-17T02:26:32.219488+0000","last_fullsized":"2024-08-17T02:26:32.219488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:39.950692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210439+0000","last_change":"2024-08-17T02:26:32.205449+0000","last_active":"2024-08-17T02:26:32.210439+0000","last_peered":"2024-08-17T02:26:32.210439+0000","last_clean":"2024-08-17T02:26:32.210439+0000","last_became_active":"2024-08-17T02:26:32.205156+0000","last_became_peered":"2024-08-17T02:26:32.205156+0000","last_unstale":"2024-08-17T02:26:32.210439+0000","last_undegraded":"2024-08-17T02:26:32.210439+0000","last_fullsized":"2024-08-17T02:26:32.210439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.221575+0000","last_change":"2024-08-17T02:26:32.203589+0000","last_active":"2024-08-17T02:26:32.221575+0000","last_peered":"2024-08-17T02:26:32.221575+0000","last_clean":"2024-08-17T02:26:32.221575+0000","last_became_active":"2024-08-17T02:26:32.200349+0000","last_became_peered":"2024-08-17T02:26:32.200349+0000","last_unstale":"2024-08-17T02:26:32.221575+0000","last_undegraded":"2024-08-17T02:26:32.221575+0000","last_fullsized":"2024-08-17T02:26:32.221575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:18.353263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.217316+0000","last_change":"2024-08-17T02:26:32.209097+0000","last_active":"2024-08-17T02:26:32.217316+0000","last_peered":"2024-08-17T02:26:32.217316+0000","last_clean":"2024-08-17T02:26:32.217316+0000","last_became_active":"2024-08-17T02:26:32.205693+0000","last_became_peered":"2024-08-17T02:26:32.205693+0000","last_unstale":"2024-08-17T02:26:32.217316+0000","last_undegraded":"2024-08-17T02:26:32.217316+0000","last_fullsized":"2024-08-17T02:26:32.217316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:47.234447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.206406+0000","last_change":"2024-08-17T02:26:32.202857+0000","last_active":"2024-08-17T02:26:32.206406+0000","last_peered":"2024-08-17T02:26:32.206406+0000","last_clean":"2024-08-17T02:26:32.206406+0000","last_became_active":"2024-08-17T02:26:32.202620+0000","last_became_peered":"2024-08-17T02:26:32.202620+0000","last_unstale":"2024-08-17T02:26:32.206406+0000","last_undegraded":"2024-08-17T02:26:32.206406+0000","last_fullsized":"2024-08-17T02:26:32.206406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:53.545799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.205254+0000","last_change":"2024-08-17T02:26:32.201410+0000","last_active":"2024-08-17T02:26:32.205254+0000","last_peered":"2024-08-17T02:26:32.205254+0000","last_clean":"2024-08-17T02:26:32.205254+0000","last_became_active":"2024-08-17T02:26:32.201146+0000","last_became_peered":"2024-08-17T02:26:32.201146+0000","last_unstale":"2024-08-17T02:26:32.205254+0000","last_undegraded":"2024-08-17T02:26:32.205254+0000","last_fullsized":"2024-08-17T02:26:32.205254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:39.950692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.213147+0000","last_change":"2024-08-17T02:26:32.209517+0000","last_active":"2024-08-17T02:26:32.213147+0000","last_peered":"2024-08-17T02:26:32.213147+0000","last_clean":"2024-08-17T02:26:32.213147+0000","last_became_active":"2024-08-17T02:26:32.209006+0000","last_became_peered":"2024-08-17T02:26:32.209006+0000","last_unstale":"2024-08-17T02:26:32.213147+0000","last_undegraded":"2024-08-17T02:26:32.213147+0000","last_fullsized":"2024-08-17T02:26:32.213147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:56:37.929984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.212900+0000","last_change":"2024-08-17T02:26:32.207200+0000","last_active":"2024-08-17T02:26:32.212900+0000","last_peered":"2024-08-17T02:26:32.212900+0000","last_clean":"2024-08-17T02:26:32.212900+0000","last_became_active":"2024-08-17T02:26:32.206936+0000","last_became_peered":"2024-08-17T02:26:32.206936+0000","last_unstale":"2024-08-17T02:26:32.212900+0000","last_undegraded":"2024-08-17T02:26:32.212900+0000","last_fullsized":"2024-08-17T02:26:32.212900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.201442+0000","last_change":"2024-08-17T02:26:32.197012+0000","last_active":"2024-08-17T02:26:32.201442+0000","last_peered":"2024-08-17T02:26:32.201442+0000","last_clean":"2024-08-17T02:26:32.201442+0000","last_became_active":"2024-08-17T02:26:32.196767+0000","last_became_peered":"2024-08-17T02:26:32.196767+0000","last_unstale":"2024-08-17T02:26:32.201442+0000","last_undegraded":"2024-08-17T02:26:32.201442+0000","last_fullsized":"2024-08-17T02:26:32.201442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:18.353263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.208488+0000","last_change":"2024-08-17T02:26:32.204201+0000","last_active":"2024-08-17T02:26:32.208488+0000","last_peered":"2024-08-17T02:26:32.208488+0000","last_clean":"2024-08-17T02:26:32.208488+0000","last_became_active":"2024-08-17T02:26:32.203698+0000","last_became_peered":"2024-08-17T02:26:32.203698+0000","last_unstale":"2024-08-17T02:26:32.208488+0000","last_undegraded":"2024-08-17T02:26:32.208488+0000","last_fullsized":"2024-08-17T02:26:32.208488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:19:31.787387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210386+0000","last_change":"2024-08-17T02:26:32.204316+0000","last_active":"2024-08-17T02:26:32.210386+0000","last_peered":"2024-08-17T02:26:32.210386+0000","last_clean":"2024-08-17T02:26:32.210386+0000","last_became_active":"2024-08-17T02:26:32.203847+0000","last_became_peered":"2024-08-17T02:26:32.203847+0000","last_unstale":"2024-08-17T02:26:32.210386+0000","last_undegraded":"2024-08-17T02:26:32.210386+0000","last_fullsized":"2024-08-17T02:26:32.210386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.212827+0000","last_change":"2024-08-17T02:26:32.210228+0000","last_active":"2024-08-17T02:26:32.212827+0000","last_peered":"2024-08-17T02:26:32.212827+0000","last_clean":"2024-08-17T02:26:32.212827+0000","last_became_active":"2024-08-17T02:26:32.209517+0000","last_became_peered":"2024-08-17T02:26:32.209517+0000","last_unstale":"2024-08-17T02:26:32.212827+0000","last_undegraded":"2024-08-17T02:26:32.212827+0000","last_fullsized":"2024-08-17T02:26:32.212827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.221242+0000","last_change":"2024-08-17T02:26:32.213782+0000","last_active":"2024-08-17T02:26:32.221242+0000","last_peered":"2024-08-17T02:26:32.221242+0000","last_clean":"2024-08-17T02:26:32.221242+0000","last_became_active":"2024-08-17T02:26:32.213525+0000","last_became_peered":"2024-08-17T02:26:32.213525+0000","last_unstale":"2024-08-17T02:26:32.221242+0000","last_undegraded":"2024-08-17T02:26:32.221242+0000","last_fullsized":"2024-08-17T02:26:32.221242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:59.385496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216837+0000","last_change":"2024-08-17T02:26:32.208770+0000","last_active":"2024-08-17T02:26:32.216837+0000","last_peered":"2024-08-17T02:26:32.216837+0000","last_clean":"2024-08-17T02:26:32.216837+0000","last_became_active":"2024-08-17T02:26:32.208425+0000","last_became_peered":"2024-08-17T02:26:32.208425+0000","last_unstale":"2024-08-17T02:26:32.216837+0000","last_undegraded":"2024-08-17T02:26:32.216837+0000","last_fullsized":"2024-08-17T02:26:32.216837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222669+0000","last_change":"2024-08-17T02:26:32.218955+0000","last_active":"2024-08-17T02:26:32.222669+0000","last_peered":"2024-08-17T02:26:32.222669+0000","last_clean":"2024-08-17T02:26:32.222669+0000","last_became_active":"2024-08-17T02:26:32.218670+0000","last_became_peered":"2024-08-17T02:26:32.218670+0000","last_unstale":"2024-08-17T02:26:32.222669+0000","last_undegraded":"2024-08-17T02:26:32.222669+0000","last_fullsized":"2024-08-17T02:26:32.222669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224570+0000","last_change":"2024-08-17T02:26:32.219168+0000","last_active":"2024-08-17T02:26:32.224570+0000","last_peered":"2024-08-17T02:26:32.224570+0000","last_clean":"2024-08-17T02:26:32.224570+0000","last_became_active":"2024-08-17T02:26:32.218856+0000","last_became_peered":"2024-08-17T02:26:32.218856+0000","last_unstale":"2024-08-17T02:26:32.224570+0000","last_undegraded":"2024-08-17T02:26:32.224570+0000","last_fullsized":"2024-08-17T02:26:32.224570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:12.730663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210090+0000","last_change":"2024-08-17T02:26:32.202312+0000","last_active":"2024-08-17T02:26:32.210090+0000","last_peered":"2024-08-17T02:26:32.210090+0000","last_clean":"2024-08-17T02:26:32.210090+0000","last_became_active":"2024-08-17T02:26:32.202077+0000","last_became_peered":"2024-08-17T02:26:32.202077+0000","last_unstale":"2024-08-17T02:26:32.210090+0000","last_undegraded":"2024-08-17T02:26:32.210090+0000","last_fullsized":"2024-08-17T02:26:32.210090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:12.730663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.205085+0000","last_change":"2024-08-17T02:26:32.201137+0000","last_active":"2024-08-17T02:26:32.205085+0000","last_peered":"2024-08-17T02:26:32.205085+0000","last_clean":"2024-08-17T02:26:32.205085+0000","last_became_active":"2024-08-17T02:26:32.200498+0000","last_became_peered":"2024-08-17T02:26:32.200498+0000","last_unstale":"2024-08-17T02:26:32.205085+0000","last_undegraded":"2024-08-17T02:26:32.205085+0000","last_fullsized":"2024-08-17T02:26:32.205085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:59.385496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.225211+0000","last_change":"2024-08-17T02:26:32.221220+0000","last_active":"2024-08-17T02:26:32.225211+0000","last_peered":"2024-08-17T02:26:32.225211+0000","last_clean":"2024-08-17T02:26:32.225211+0000","last_became_active":"2024-08-17T02:26:32.220959+0000","last_became_peered":"2024-08-17T02:26:32.220959+0000","last_unstale":"2024-08-17T02:26:32.225211+0000","last_undegraded":"2024-08-17T02:26:32.225211+0000","last_fullsized":"2024-08-17T02:26:32.225211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:39.950692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.202233+0000","last_change":"2024-08-17T02:26:32.199159+0000","last_active":"2024-08-17T02:26:32.202233+0000","last_peered":"2024-08-17T02:26:32.202233+0000","last_clean":"2024-08-17T02:26:32.202233+0000","last_became_active":"2024-08-17T02:26:32.198845+0000","last_became_peered":"2024-08-17T02:26:32.198845+0000","last_unstale":"2024-08-17T02:26:32.202233+0000","last_undegraded":"2024-08-17T02:26:32.202233+0000","last_fullsized":"2024-08-17T02:26:32.202233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:12.730663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222754+0000","last_change":"2024-08-17T02:26:32.218327+0000","last_active":"2024-08-17T02:26:32.222754+0000","last_peered":"2024-08-17T02:26:32.222754+0000","last_clean":"2024-08-17T02:26:32.222754+0000","last_became_active":"2024-08-17T02:26:32.218052+0000","last_became_peered":"2024-08-17T02:26:32.218052+0000","last_unstale":"2024-08-17T02:26:32.222754+0000","last_undegraded":"2024-08-17T02:26:32.222754+0000","last_fullsized":"2024-08-17T02:26:32.222754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:59.331351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.202572+0000","last_change":"2024-08-17T02:26:32.199446+0000","last_active":"2024-08-17T02:26:32.202572+0000","last_peered":"2024-08-17T02:26:32.202572+0000","last_clean":"2024-08-17T02:26:32.202572+0000","last_became_active":"2024-08-17T02:26:32.199139+0000","last_became_peered":"2024-08-17T02:26:32.199139+0000","last_unstale":"2024-08-17T02:26:32.202572+0000","last_undegraded":"2024-08-17T02:26:32.202572+0000","last_fullsized":"2024-08-17T02:26:32.202572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:08.860859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.209270+0000","last_change":"2024-08-17T02:26:32.199075+0000","last_active":"2024-08-17T02:26:32.209270+0000","last_peered":"2024-08-17T02:26:32.209270+0000","last_clean":"2024-08-17T02:26:32.209270+0000","last_became_active":"2024-08-17T02:26:32.198255+0000","last_became_peered":"2024-08-17T02:26:32.198255+0000","last_unstale":"2024-08-17T02:26:32.209270+0000","last_undegraded":"2024-08-17T02:26:32.209270+0000","last_fullsized":"2024-08-17T02:26:32.209270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:18.537099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.201883+0000","last_change":"2024-08-17T02:26:32.199005+0000","last_active":"2024-08-17T02:26:32.201883+0000","last_peered":"2024-08-17T02:26:32.201883+0000","last_clean":"2024-08-17T02:26:32.201883+0000","last_became_active":"2024-08-17T02:26:32.198711+0000","last_became_peered":"2024-08-17T02:26:32.198711+0000","last_unstale":"2024-08-17T02:26:32.201883+0000","last_undegraded":"2024-08-17T02:26:32.201883+0000","last_fullsized":"2024-08-17T02:26:32.201883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:22.633118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223675+0000","last_change":"2024-08-17T02:26:31.188549+0000","last_active":"2024-08-17T02:26:32.223675+0000","last_peered":"2024-08-17T02:26:32.223675+0000","last_clean":"2024-08-17T02:26:32.223675+0000","last_became_active":"2024-08-17T02:26:31.188272+0000","last_became_peered":"2024-08-17T02:26:31.188272+0000","last_unstale":"2024-08-17T02:26:32.223675+0000","last_undegraded":"2024-08-17T02:26:32.223675+0000","last_fullsized":"2024-08-17T02:26:32.223675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:46.029644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222700+0000","last_change":"2024-08-17T02:26:32.214370+0000","last_active":"2024-08-17T02:26:32.222700+0000","last_peered":"2024-08-17T02:26:32.222700+0000","last_clean":"2024-08-17T02:26:32.222700+0000","last_became_active":"2024-08-17T02:26:32.214126+0000","last_became_peered":"2024-08-17T02:26:32.214126+0000","last_unstale":"2024-08-17T02:26:32.222700+0000","last_undegraded":"2024-08-17T02:26:32.222700+0000","last_fullsized":"2024-08-17T02:26:32.222700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:39.950692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224831+0000","last_change":"2024-08-17T02:26:31.203526+0000","last_active":"2024-08-17T02:26:32.224831+0000","last_peered":"2024-08-17T02:26:32.224831+0000","last_clean":"2024-08-17T02:26:32.224831+0000","last_became_active":"2024-08-17T02:26:31.202971+0000","last_became_peered":"2024-08-17T02:26:31.202971+0000","last_unstale":"2024-08-17T02:26:32.224831+0000","last_undegraded":"2024-08-17T02:26:32.224831+0000","last_fullsized":"2024-08-17T02:26:32.224831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:29.752289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.191559+0000","last_change":"2024-08-17T02:26:31.200001+0000","last_active":"2024-08-17T02:26:32.191559+0000","last_peered":"2024-08-17T02:26:32.191559+0000","last_clean":"2024-08-17T02:26:32.191559+0000","last_became_active":"2024-08-17T02:26:31.199719+0000","last_became_peered":"2024-08-17T02:26:31.199719+0000","last_unstale":"2024-08-17T02:26:32.191559+0000","last_undegraded":"2024-08-17T02:26:32.191559+0000","last_fullsized":"2024-08-17T02:26:32.191559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:13:53.155805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216384+0000","last_change":"2024-08-17T02:26:32.204465+0000","last_active":"2024-08-17T02:26:32.216384+0000","last_peered":"2024-08-17T02:26:32.216384+0000","last_clean":"2024-08-17T02:26:32.216384+0000","last_became_active":"2024-08-17T02:26:32.204203+0000","last_became_peered":"2024-08-17T02:26:32.204203+0000","last_unstale":"2024-08-17T02:26:32.216384+0000","last_undegraded":"2024-08-17T02:26:32.216384+0000","last_fullsized":"2024-08-17T02:26:32.216384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:22.493908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.192718+0000","last_change":"2024-08-17T02:26:31.195728+0000","last_active":"2024-08-17T02:26:32.192718+0000","last_peered":"2024-08-17T02:26:32.192718+0000","last_clean":"2024-08-17T02:26:32.192718+0000","last_became_active":"2024-08-17T02:26:31.195461+0000","last_became_peered":"2024-08-17T02:26:31.195461+0000","last_unstale":"2024-08-17T02:26:32.192718+0000","last_undegraded":"2024-08-17T02:26:32.192718+0000","last_fullsized":"2024-08-17T02:26:32.192718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:00.267868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.205273+0000","last_change":"2024-08-17T02:26:32.201225+0000","last_active":"2024-08-17T02:26:32.205273+0000","last_peered":"2024-08-17T02:26:32.205273+0000","last_clean":"2024-08-17T02:26:32.205273+0000","last_became_active":"2024-08-17T02:26:32.200883+0000","last_became_peered":"2024-08-17T02:26:32.200883+0000","last_unstale":"2024-08-17T02:26:32.205273+0000","last_undegraded":"2024-08-17T02:26:32.205273+0000","last_fullsized":"2024-08-17T02:26:32.205273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.196667+0000","last_change":"2024-08-17T02:26:31.203729+0000","last_active":"2024-08-17T02:26:32.196667+0000","last_peered":"2024-08-17T02:26:32.196667+0000","last_clean":"2024-08-17T02:26:32.196667+0000","last_became_active":"2024-08-17T02:26:31.203402+0000","last_became_peered":"2024-08-17T02:26:31.203402+0000","last_unstale":"2024-08-17T02:26:32.196667+0000","last_undegraded":"2024-08-17T02:26:32.196667+0000","last_fullsized":"2024-08-17T02:26:32.196667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:21.626630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.214196+0000","last_change":"2024-08-17T02:26:32.209985+0000","last_active":"2024-08-17T02:26:32.214196+0000","last_peered":"2024-08-17T02:26:32.214196+0000","last_clean":"2024-08-17T02:26:32.214196+0000","last_became_active":"2024-08-17T02:26:32.209542+0000","last_became_peered":"2024-08-17T02:26:32.209542+0000","last_unstale":"2024-08-17T02:26:32.214196+0000","last_undegraded":"2024-08-17T02:26:32.214196+0000","last_fullsized":"2024-08-17T02:26:32.214196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:47.234447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.209840+0000","last_change":"2024-08-17T02:26:31.205754+0000","last_active":"2024-08-17T02:26:32.209840+0000","last_peered":"2024-08-17T02:26:32.209840+0000","last_clean":"2024-08-17T02:26:32.209840+0000","last_became_active":"2024-08-17T02:26:31.205187+0000","last_became_peered":"2024-08-17T02:26:31.205187+0000","last_unstale":"2024-08-17T02:26:32.209840+0000","last_undegraded":"2024-08-17T02:26:32.209840+0000","last_fullsized":"2024-08-17T02:26:32.209840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:36.476579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222736+0000","last_change":"2024-08-17T02:26:32.213334+0000","last_active":"2024-08-17T02:26:32.222736+0000","last_peered":"2024-08-17T02:26:32.222736+0000","last_clean":"2024-08-17T02:26:32.222736+0000","last_became_active":"2024-08-17T02:26:32.213073+0000","last_became_peered":"2024-08-17T02:26:32.213073+0000","last_unstale":"2024-08-17T02:26:32.222736+0000","last_undegraded":"2024-08-17T02:26:32.222736+0000","last_fullsized":"2024-08-17T02:26:32.222736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:16:50.112486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.226031+0000","last_change":"2024-08-17T02:26:31.193999+0000","last_active":"2024-08-17T02:26:32.226031+0000","last_peered":"2024-08-17T02:26:32.226031+0000","last_clean":"2024-08-17T02:26:32.226031+0000","last_became_active":"2024-08-17T02:26:31.193689+0000","last_became_peered":"2024-08-17T02:26:31.193689+0000","last_unstale":"2024-08-17T02:26:32.226031+0000","last_undegraded":"2024-08-17T02:26:32.226031+0000","last_fullsized":"2024-08-17T02:26:32.226031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:07.854371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.221598+0000","last_change":"2024-08-17T02:26:32.210669+0000","last_active":"2024-08-17T02:26:32.221598+0000","last_peered":"2024-08-17T02:26:32.221598+0000","last_clean":"2024-08-17T02:26:32.221598+0000","last_became_active":"2024-08-17T02:26:32.203230+0000","last_became_peered":"2024-08-17T02:26:32.203230+0000","last_unstale":"2024-08-17T02:26:32.221598+0000","last_undegraded":"2024-08-17T02:26:32.221598+0000","last_fullsized":"2024-08-17T02:26:32.221598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:35.520908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.228823+0000","last_change":"2024-08-17T02:26:31.204431+0000","last_active":"2024-08-17T02:26:32.228823+0000","last_peered":"2024-08-17T02:26:32.228823+0000","last_clean":"2024-08-17T02:26:32.228823+0000","last_became_active":"2024-08-17T02:26:31.204173+0000","last_became_peered":"2024-08-17T02:26:31.204173+0000","last_unstale":"2024-08-17T02:26:32.228823+0000","last_undegraded":"2024-08-17T02:26:32.228823+0000","last_fullsized":"2024-08-17T02:26:32.228823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:36.476579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223479+0000","last_change":"2024-08-17T02:26:32.216157+0000","last_active":"2024-08-17T02:26:32.223479+0000","last_peered":"2024-08-17T02:26:32.223479+0000","last_clean":"2024-08-17T02:26:32.223479+0000","last_became_active":"2024-08-17T02:26:32.215849+0000","last_became_peered":"2024-08-17T02:26:32.215849+0000","last_unstale":"2024-08-17T02:26:32.223479+0000","last_undegraded":"2024-08-17T02:26:32.223479+0000","last_fullsized":"2024-08-17T02:26:32.223479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:47.234447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.225699+0000","last_change":"2024-08-17T02:26:31.203059+0000","last_active":"2024-08-17T02:26:32.225699+0000","last_peered":"2024-08-17T02:26:32.225699+0000","last_clean":"2024-08-17T02:26:32.225699+0000","last_became_active":"2024-08-17T02:26:31.202794+0000","last_became_peered":"2024-08-17T02:26:31.202794+0000","last_unstale":"2024-08-17T02:26:32.225699+0000","last_undegraded":"2024-08-17T02:26:32.225699+0000","last_fullsized":"2024-08-17T02:26:32.225699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:46.029644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216333+0000","last_change":"2024-08-17T02:26:32.210912+0000","last_active":"2024-08-17T02:26:32.216333+0000","last_peered":"2024-08-17T02:26:32.216333+0000","last_clean":"2024-08-17T02:26:32.216333+0000","last_became_active":"2024-08-17T02:26:32.210509+0000","last_became_peered":"2024-08-17T02:26:32.210509+0000","last_unstale":"2024-08-17T02:26:32.216333+0000","last_undegraded":"2024-08-17T02:26:32.216333+0000","last_fullsized":"2024-08-17T02:26:32.216333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:08.860859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210217+0000","last_change":"2024-08-17T02:26:31.197665+0000","last_active":"2024-08-17T02:26:32.210217+0000","last_peered":"2024-08-17T02:26:32.210217+0000","last_clean":"2024-08-17T02:26:32.210217+0000","last_became_active":"2024-08-17T02:26:31.197429+0000","last_became_peered":"2024-08-17T02:26:31.197429+0000","last_unstale":"2024-08-17T02:26:32.210217+0000","last_undegraded":"2024-08-17T02:26:32.210217+0000","last_fullsized":"2024-08-17T02:26:32.210217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:14.675670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.208532+0000","last_change":"2024-08-17T02:26:32.204360+0000","last_active":"2024-08-17T02:26:32.208532+0000","last_peered":"2024-08-17T02:26:32.208532+0000","last_clean":"2024-08-17T02:26:32.208532+0000","last_became_active":"2024-08-17T02:26:32.197360+0000","last_became_peered":"2024-08-17T02:26:32.197360+0000","last_unstale":"2024-08-17T02:26:32.208532+0000","last_undegraded":"2024-08-17T02:26:32.208532+0000","last_fullsized":"2024-08-17T02:26:32.208532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:04:17.552404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.193585+0000","last_change":"2024-08-17T02:26:31.203360+0000","last_active":"2024-08-17T02:26:32.193585+0000","last_peered":"2024-08-17T02:26:32.193585+0000","last_clean":"2024-08-17T02:26:32.193585+0000","last_became_active":"2024-08-17T02:26:31.202988+0000","last_became_peered":"2024-08-17T02:26:31.202988+0000","last_unstale":"2024-08-17T02:26:32.193585+0000","last_undegraded":"2024-08-17T02:26:32.193585+0000","last_fullsized":"2024-08-17T02:26:32.193585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:53:03.434511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.214346+0000","last_change":"2024-08-17T02:26:32.198486+0000","last_active":"2024-08-17T02:26:32.214346+0000","last_peered":"2024-08-17T02:26:32.214346+0000","last_clean":"2024-08-17T02:26:32.214346+0000","last_became_active":"2024-08-17T02:26:32.197905+0000","last_became_peered":"2024-08-17T02:26:32.197905+0000","last_unstale":"2024-08-17T02:26:32.214346+0000","last_undegraded":"2024-08-17T02:26:32.214346+0000","last_fullsized":"2024-08-17T02:26:32.214346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:53.545799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.226669+0000","last_change":"2024-08-17T02:26:31.193931+0000","last_active":"2024-08-17T02:26:32.226669+0000","last_peered":"2024-08-17T02:26:32.226669+0000","last_clean":"2024-08-17T02:26:32.226669+0000","last_became_active":"2024-08-17T02:26:31.192003+0000","last_became_peered":"2024-08-17T02:26:31.192003+0000","last_unstale":"2024-08-17T02:26:32.226669+0000","last_undegraded":"2024-08-17T02:26:32.226669+0000","last_fullsized":"2024-08-17T02:26:32.226669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:14.675670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.209304+0000","last_change":"2024-08-17T02:26:32.206117+0000","last_active":"2024-08-17T02:26:32.209304+0000","last_peered":"2024-08-17T02:26:32.209304+0000","last_clean":"2024-08-17T02:26:32.209304+0000","last_became_active":"2024-08-17T02:26:32.205803+0000","last_became_peered":"2024-08-17T02:26:32.205803+0000","last_unstale":"2024-08-17T02:26:32.209304+0000","last_undegraded":"2024-08-17T02:26:32.209304+0000","last_fullsized":"2024-08-17T02:26:32.209304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:59.331351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224293+0000","last_change":"2024-08-17T02:26:31.198233+0000","last_active":"2024-08-17T02:26:32.224293+0000","last_peered":"2024-08-17T02:26:32.224293+0000","last_clean":"2024-08-17T02:26:32.224293+0000","last_became_active":"2024-08-17T02:26:31.197699+0000","last_became_peered":"2024-08-17T02:26:31.197699+0000","last_unstale":"2024-08-17T02:26:32.224293+0000","last_undegraded":"2024-08-17T02:26:32.224293+0000","last_fullsized":"2024-08-17T02:26:32.224293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:46.029644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210402+0000","last_change":"2024-08-17T02:26:32.207718+0000","last_active":"2024-08-17T02:26:32.210402+0000","last_peered":"2024-08-17T02:26:32.210402+0000","last_clean":"2024-08-17T02:26:32.210402+0000","last_became_active":"2024-08-17T02:26:32.204744+0000","last_became_peered":"2024-08-17T02:26:32.204744+0000","last_unstale":"2024-08-17T02:26:32.210402+0000","last_undegraded":"2024-08-17T02:26:32.210402+0000","last_fullsized":"2024-08-17T02:26:32.210402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:56:37.929984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224554+0000","last_change":"2024-08-17T02:26:31.195725+0000","last_active":"2024-08-17T02:26:32.224554+0000","last_peered":"2024-08-17T02:26:32.224554+0000","last_clean":"2024-08-17T02:26:32.224554+0000","last_became_active":"2024-08-17T02:26:31.195446+0000","last_became_peered":"2024-08-17T02:26:31.195446+0000","last_unstale":"2024-08-17T02:26:32.224554+0000","last_undegraded":"2024-08-17T02:26:32.224554+0000","last_fullsized":"2024-08-17T02:26:32.224554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:00.267868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.209351+0000","last_change":"2024-08-17T02:26:32.207003+0000","last_active":"2024-08-17T02:26:32.209351+0000","last_peered":"2024-08-17T02:26:32.209351+0000","last_clean":"2024-08-17T02:26:32.209351+0000","last_became_active":"2024-08-17T02:26:32.206741+0000","last_became_peered":"2024-08-17T02:26:32.206741+0000","last_unstale":"2024-08-17T02:26:32.209351+0000","last_undegraded":"2024-08-17T02:26:32.209351+0000","last_fullsized":"2024-08-17T02:26:32.209351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:44.277870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.225797+0000","last_change":"2024-08-17T02:26:31.188727+0000","last_active":"2024-08-17T02:26:32.225797+0000","last_peered":"2024-08-17T02:26:32.225797+0000","last_clean":"2024-08-17T02:26:32.225797+0000","last_became_active":"2024-08-17T02:26:31.187702+0000","last_became_peered":"2024-08-17T02:26:31.187702+0000","last_unstale":"2024-08-17T02:26:32.225797+0000","last_undegraded":"2024-08-17T02:26:32.225797+0000","last_fullsized":"2024-08-17T02:26:32.225797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:29.752289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.227485+0000","last_change":"2024-08-17T02:26:32.226432+0000","last_active":"2024-08-17T02:26:32.227485+0000","last_peered":"2024-08-17T02:26:32.227485+0000","last_clean":"2024-08-17T02:26:32.227485+0000","last_became_active":"2024-08-17T02:26:32.226202+0000","last_became_peered":"2024-08-17T02:26:32.226202+0000","last_unstale":"2024-08-17T02:26:32.227485+0000","last_undegraded":"2024-08-17T02:26:32.227485+0000","last_fullsized":"2024-08-17T02:26:32.227485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:19:31.787387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.188823+0000","last_change":"2024-08-17T02:26:31.196292+0000","last_active":"2024-08-17T02:26:32.188823+0000","last_peered":"2024-08-17T02:26:32.188823+0000","last_clean":"2024-08-17T02:26:32.188823+0000","last_became_active":"2024-08-17T02:26:31.196030+0000","last_became_peered":"2024-08-17T02:26:31.196030+0000","last_unstale":"2024-08-17T02:26:32.188823+0000","last_undegraded":"2024-08-17T02:26:32.188823+0000","last_fullsized":"2024-08-17T02:26:32.188823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:36.476579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223492+0000","last_change":"2024-08-17T02:26:32.217034+0000","last_active":"2024-08-17T02:26:32.223492+0000","last_peered":"2024-08-17T02:26:32.223492+0000","last_clean":"2024-08-17T02:26:32.223492+0000","last_became_active":"2024-08-17T02:26:32.215414+0000","last_became_peered":"2024-08-17T02:26:32.215414+0000","last_unstale":"2024-08-17T02:26:32.223492+0000","last_undegraded":"2024-08-17T02:26:32.223492+0000","last_fullsized":"2024-08-17T02:26:32.223492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:22.327159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.185570+0000","last_change":"2024-08-17T02:26:27.275086+0000","last_active":"2024-08-17T02:26:32.185570+0000","last_peered":"2024-08-17T02:26:32.185570+0000","last_clean":"2024-08-17T02:26:32.185570+0000","last_became_active":"2024-08-17T02:26:27.274075+0000","last_became_peered":"2024-08-17T02:26:27.274075+0000","last_unstale":"2024-08-17T02:26:32.185570+0000","last_undegraded":"2024-08-17T02:26:32.185570+0000","last_fullsized":"2024-08-17T02:26:32.185570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_clean_scrub_stamp":"2024-08-17T02:26:26.139133+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:52.161982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210441+0000","last_change":"2024-08-17T02:26:31.198699+0000","last_active":"2024-08-17T02:26:32.210441+0000","last_peered":"2024-08-17T02:26:32.210441+0000","last_clean":"2024-08-17T02:26:32.210441+0000","last_became_active":"2024-08-17T02:26:31.198462+0000","last_became_peered":"2024-08-17T02:26:31.198462+0000","last_unstale":"2024-08-17T02:26:32.210441+0000","last_undegraded":"2024-08-17T02:26:32.210441+0000","last_fullsized":"2024-08-17T02:26:32.210441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:13:53.155805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224120+0000","last_change":"2024-08-17T02:26:32.217116+0000","last_active":"2024-08-17T02:26:32.224120+0000","last_peered":"2024-08-17T02:26:32.224120+0000","last_clean":"2024-08-17T02:26:32.224120+0000","last_became_active":"2024-08-17T02:26:32.216502+0000","last_became_peered":"2024-08-17T02:26:32.216502+0000","last_unstale":"2024-08-17T02:26:32.224120+0000","last_undegraded":"2024-08-17T02:26:32.224120+0000","last_fullsized":"2024-08-17T02:26:32.224120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:59.385496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.185482+0000","last_change":"2024-08-17T02:26:31.194925+0000","last_active":"2024-08-17T02:26:32.185482+0000","last_peered":"2024-08-17T02:26:32.185482+0000","last_clean":"2024-08-17T02:26:32.185482+0000","last_became_active":"2024-08-17T02:26:31.194668+0000","last_became_peered":"2024-08-17T02:26:31.194668+0000","last_unstale":"2024-08-17T02:26:32.185482+0000","last_undegraded":"2024-08-17T02:26:32.185482+0000","last_fullsized":"2024-08-17T02:26:32.185482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:17.346775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216389+0000","last_change":"2024-08-17T02:26:32.212095+0000","last_active":"2024-08-17T02:26:32.216389+0000","last_peered":"2024-08-17T02:26:32.216389+0000","last_clean":"2024-08-17T02:26:32.216389+0000","last_became_active":"2024-08-17T02:26:32.211786+0000","last_became_peered":"2024-08-17T02:26:32.211786+0000","last_unstale":"2024-08-17T02:26:32.216389+0000","last_undegraded":"2024-08-17T02:26:32.216389+0000","last_fullsized":"2024-08-17T02:26:32.216389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:12:08.917953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.189462+0000","last_change":"2024-08-17T02:26:31.190007+0000","last_active":"2024-08-17T02:26:32.189462+0000","last_peered":"2024-08-17T02:26:32.189462+0000","last_clean":"2024-08-17T02:26:32.189462+0000","last_became_active":"2024-08-17T02:26:31.189669+0000","last_became_peered":"2024-08-17T02:26:31.189669+0000","last_unstale":"2024-08-17T02:26:32.189462+0000","last_undegraded":"2024-08-17T02:26:32.189462+0000","last_fullsized":"2024-08-17T02:26:32.189462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:13:53.155805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.201194+0000","last_change":"2024-08-17T02:26:32.195428+0000","last_active":"2024-08-17T02:26:32.201194+0000","last_peered":"2024-08-17T02:26:32.201194+0000","last_clean":"2024-08-17T02:26:32.201194+0000","last_became_active":"2024-08-17T02:26:32.195121+0000","last_became_peered":"2024-08-17T02:26:32.195121+0000","last_unstale":"2024-08-17T02:26:32.201194+0000","last_undegraded":"2024-08-17T02:26:32.201194+0000","last_fullsized":"2024-08-17T02:26:32.201194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210311+0000","last_change":"2024-08-17T02:26:31.196698+0000","last_active":"2024-08-17T02:26:32.210311+0000","last_peered":"2024-08-17T02:26:32.210311+0000","last_clean":"2024-08-17T02:26:32.210311+0000","last_became_active":"2024-08-17T02:26:31.195740+0000","last_became_peered":"2024-08-17T02:26:31.195740+0000","last_unstale":"2024-08-17T02:26:32.210311+0000","last_undegraded":"2024-08-17T02:26:32.210311+0000","last_fullsized":"2024-08-17T02:26:32.210311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:29.752289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223829+0000","last_change":"2024-08-17T02:26:32.214042+0000","last_active":"2024-08-17T02:26:32.223829+0000","last_peered":"2024-08-17T02:26:32.223829+0000","last_clean":"2024-08-17T02:26:32.223829+0000","last_became_active":"2024-08-17T02:26:32.211384+0000","last_became_peered":"2024-08-17T02:26:32.211384+0000","last_unstale":"2024-08-17T02:26:32.223829+0000","last_undegraded":"2024-08-17T02:26:32.223829+0000","last_fullsized":"2024-08-17T02:26:32.223829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:08.860859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.184099+0000","last_change":"2024-08-17T02:26:31.199414+0000","last_active":"2024-08-17T02:26:32.184099+0000","last_peered":"2024-08-17T02:26:32.184099+0000","last_clean":"2024-08-17T02:26:32.184099+0000","last_became_active":"2024-08-17T02:26:31.199123+0000","last_became_peered":"2024-08-17T02:26:31.199123+0000","last_unstale":"2024-08-17T02:26:32.184099+0000","last_undegraded":"2024-08-17T02:26:32.184099+0000","last_fullsized":"2024-08-17T02:26:32.184099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:21.626630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222976+0000","last_change":"2024-08-17T02:26:32.219444+0000","last_active":"2024-08-17T02:26:32.222976+0000","last_peered":"2024-08-17T02:26:32.222976+0000","last_clean":"2024-08-17T02:26:32.222976+0000","last_became_active":"2024-08-17T02:26:32.219214+0000","last_became_peered":"2024-08-17T02:26:32.219214+0000","last_unstale":"2024-08-17T02:26:32.222976+0000","last_undegraded":"2024-08-17T02:26:32.222976+0000","last_fullsized":"2024-08-17T02:26:32.222976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:44.277870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.189655+0000","last_change":"2024-08-17T02:26:31.200700+0000","last_active":"2024-08-17T02:26:32.189655+0000","last_peered":"2024-08-17T02:26:32.189655+0000","last_clean":"2024-08-17T02:26:32.189655+0000","last_became_active":"2024-08-17T02:26:31.200119+0000","last_became_peered":"2024-08-17T02:26:31.200119+0000","last_unstale":"2024-08-17T02:26:32.189655+0000","last_undegraded":"2024-08-17T02:26:32.189655+0000","last_fullsized":"2024-08-17T02:26:32.189655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:21.626630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.205241+0000","last_change":"2024-08-17T02:26:32.204045+0000","last_active":"2024-08-17T02:26:32.205241+0000","last_peered":"2024-08-17T02:26:32.205241+0000","last_clean":"2024-08-17T02:26:32.205241+0000","last_became_active":"2024-08-17T02:26:32.201851+0000","last_became_peered":"2024-08-17T02:26:32.201851+0000","last_unstale":"2024-08-17T02:26:32.205241+0000","last_undegraded":"2024-08-17T02:26:32.205241+0000","last_fullsized":"2024-08-17T02:26:32.205241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:16:50.112486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:33.922747+0000","last_change":"2024-08-17T02:26:31.201702+0000","last_active":"2024-08-17T02:26:33.922747+0000","last_peered":"2024-08-17T02:26:33.922747+0000","last_clean":"2024-08-17T02:26:33.922747+0000","last_became_active":"2024-08-17T02:26:31.201252+0000","last_became_peered":"2024-08-17T02:26:31.201252+0000","last_unstale":"2024-08-17T02:26:33.922747+0000","last_undegraded":"2024-08-17T02:26:33.922747+0000","last_fullsized":"2024-08-17T02:26:33.922747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:34.514420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216794+0000","last_change":"2024-08-17T02:26:32.209105+0000","last_active":"2024-08-17T02:26:32.216794+0000","last_peered":"2024-08-17T02:26:32.216794+0000","last_clean":"2024-08-17T02:26:32.216794+0000","last_became_active":"2024-08-17T02:26:32.208827+0000","last_became_peered":"2024-08-17T02:26:32.208827+0000","last_unstale":"2024-08-17T02:26:32.216794+0000","last_undegraded":"2024-08-17T02:26:32.216794+0000","last_fullsized":"2024-08-17T02:26:32.216794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:12:08.917953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224248+0000","last_change":"2024-08-17T02:26:31.198056+0000","last_active":"2024-08-17T02:26:32.224248+0000","last_peered":"2024-08-17T02:26:32.224248+0000","last_clean":"2024-08-17T02:26:32.224248+0000","last_became_active":"2024-08-17T02:26:31.197375+0000","last_became_peered":"2024-08-17T02:26:31.197375+0000","last_unstale":"2024-08-17T02:26:32.224248+0000","last_undegraded":"2024-08-17T02:26:32.224248+0000","last_fullsized":"2024-08-17T02:26:32.224248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:14.675670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.207777+0000","last_change":"2024-08-17T02:26:32.204547+0000","last_active":"2024-08-17T02:26:32.207777+0000","last_peered":"2024-08-17T02:26:32.207777+0000","last_clean":"2024-08-17T02:26:32.207777+0000","last_became_active":"2024-08-17T02:26:32.204234+0000","last_became_peered":"2024-08-17T02:26:32.204234+0000","last_unstale":"2024-08-17T02:26:32.207777+0000","last_undegraded":"2024-08-17T02:26:32.207777+0000","last_fullsized":"2024-08-17T02:26:32.207777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:22.493908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.185436+0000","last_change":"2024-08-17T02:26:31.199235+0000","last_active":"2024-08-17T02:26:32.185436+0000","last_peered":"2024-08-17T02:26:32.185436+0000","last_clean":"2024-08-17T02:26:32.185436+0000","last_became_active":"2024-08-17T02:26:31.198951+0000","last_became_peered":"2024-08-17T02:26:31.198951+0000","last_unstale":"2024-08-17T02:26:32.185436+0000","last_undegraded":"2024-08-17T02:26:32.185436+0000","last_fullsized":"2024-08-17T02:26:32.185436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:29.752289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.218771+0000","last_change":"2024-08-17T02:26:32.202792+0000","last_active":"2024-08-17T02:26:32.218771+0000","last_peered":"2024-08-17T02:26:32.218771+0000","last_clean":"2024-08-17T02:26:32.218771+0000","last_became_active":"2024-08-17T02:26:32.201978+0000","last_became_peered":"2024-08-17T02:26:32.201978+0000","last_unstale":"2024-08-17T02:26:32.218771+0000","last_undegraded":"2024-08-17T02:26:32.218771+0000","last_fullsized":"2024-08-17T02:26:32.218771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:25.946664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.184248+0000","last_change":"2024-08-17T02:26:31.199305+0000","last_active":"2024-08-17T02:26:32.184248+0000","last_peered":"2024-08-17T02:26:32.184248+0000","last_clean":"2024-08-17T02:26:32.184248+0000","last_became_active":"2024-08-17T02:26:31.199023+0000","last_became_peered":"2024-08-17T02:26:31.199023+0000","last_unstale":"2024-08-17T02:26:32.184248+0000","last_undegraded":"2024-08-17T02:26:32.184248+0000","last_fullsized":"2024-08-17T02:26:32.184248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:36.476579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216869+0000","last_change":"2024-08-17T02:26:32.211397+0000","last_active":"2024-08-17T02:26:32.216869+0000","last_peered":"2024-08-17T02:26:32.216869+0000","last_clean":"2024-08-17T02:26:32.216869+0000","last_became_active":"2024-08-17T02:26:32.211105+0000","last_became_peered":"2024-08-17T02:26:32.211105+0000","last_unstale":"2024-08-17T02:26:32.216869+0000","last_undegraded":"2024-08-17T02:26:32.216869+0000","last_fullsized":"2024-08-17T02:26:32.216869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:49.834790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.183924+0000","last_change":"2024-08-17T02:26:31.194944+0000","last_active":"2024-08-17T02:26:32.183924+0000","last_peered":"2024-08-17T02:26:32.183924+0000","last_clean":"2024-08-17T02:26:32.183924+0000","last_became_active":"2024-08-17T02:26:31.194583+0000","last_became_peered":"2024-08-17T02:26:31.194583+0000","last_unstale":"2024-08-17T02:26:32.183924+0000","last_undegraded":"2024-08-17T02:26:32.183924+0000","last_fullsized":"2024-08-17T02:26:32.183924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:24.940176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.217295+0000","last_change":"2024-08-17T02:26:32.208192+0000","last_active":"2024-08-17T02:26:32.217295+0000","last_peered":"2024-08-17T02:26:32.217295+0000","last_clean":"2024-08-17T02:26:32.217295+0000","last_became_active":"2024-08-17T02:26:32.205401+0000","last_became_peered":"2024-08-17T02:26:32.205401+0000","last_unstale":"2024-08-17T02:26:32.217295+0000","last_undegraded":"2024-08-17T02:26:32.217295+0000","last_fullsized":"2024-08-17T02:26:32.217295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:01:56.405892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224746+0000","last_change":"2024-08-17T02:26:31.188577+0000","last_active":"2024-08-17T02:26:32.224746+0000","last_peered":"2024-08-17T02:26:32.224746+0000","last_clean":"2024-08-17T02:26:32.224746+0000","last_became_active":"2024-08-17T02:26:31.188261+0000","last_became_peered":"2024-08-17T02:26:31.188261+0000","last_unstale":"2024-08-17T02:26:32.224746+0000","last_undegraded":"2024-08-17T02:26:32.224746+0000","last_fullsized":"2024-08-17T02:26:32.224746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:07.854371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210736+0000","last_change":"2024-08-17T02:26:32.204687+0000","last_active":"2024-08-17T02:26:32.210736+0000","last_peered":"2024-08-17T02:26:32.210736+0000","last_clean":"2024-08-17T02:26:32.210736+0000","last_became_active":"2024-08-17T02:26:32.203288+0000","last_became_peered":"2024-08-17T02:26:32.203288+0000","last_unstale":"2024-08-17T02:26:32.210736+0000","last_undegraded":"2024-08-17T02:26:32.210736+0000","last_fullsized":"2024-08-17T02:26:32.210736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:59.385496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.212562+0000","last_change":"2024-08-17T02:26:32.205101+0000","last_active":"2024-08-17T02:26:32.212562+0000","last_peered":"2024-08-17T02:26:32.212562+0000","last_clean":"2024-08-17T02:26:32.212562+0000","last_became_active":"2024-08-17T02:26:32.204789+0000","last_became_peered":"2024-08-17T02:26:32.204789+0000","last_unstale":"2024-08-17T02:26:32.212562+0000","last_undegraded":"2024-08-17T02:26:32.212562+0000","last_fullsized":"2024-08-17T02:26:32.212562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:53.799652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.226792+0000","last_change":"2024-08-17T02:26:31.192488+0000","last_active":"2024-08-17T02:26:32.226792+0000","last_peered":"2024-08-17T02:26:32.226792+0000","last_clean":"2024-08-17T02:26:32.226792+0000","last_became_active":"2024-08-17T02:26:31.191791+0000","last_became_peered":"2024-08-17T02:26:31.191791+0000","last_unstale":"2024-08-17T02:26:32.226792+0000","last_undegraded":"2024-08-17T02:26:32.226792+0000","last_fullsized":"2024-08-17T02:26:32.226792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:24.940176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222373+0000","last_change":"2024-08-17T02:26:32.214245+0000","last_active":"2024-08-17T02:26:32.222373+0000","last_peered":"2024-08-17T02:26:32.222373+0000","last_clean":"2024-08-17T02:26:32.222373+0000","last_became_active":"2024-08-17T02:26:32.212733+0000","last_became_peered":"2024-08-17T02:26:32.212733+0000","last_unstale":"2024-08-17T02:26:32.222373+0000","last_undegraded":"2024-08-17T02:26:32.222373+0000","last_fullsized":"2024-08-17T02:26:32.222373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:22.493908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.225876+0000","last_change":"2024-08-17T02:26:31.201149+0000","last_active":"2024-08-17T02:26:32.225876+0000","last_peered":"2024-08-17T02:26:32.225876+0000","last_clean":"2024-08-17T02:26:32.225876+0000","last_became_active":"2024-08-17T02:26:31.200976+0000","last_became_peered":"2024-08-17T02:26:31.200976+0000","last_unstale":"2024-08-17T02:26:32.225876+0000","last_undegraded":"2024-08-17T02:26:32.225876+0000","last_fullsized":"2024-08-17T02:26:32.225876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:34.514420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222755+0000","last_change":"2024-08-17T02:26:32.213833+0000","last_active":"2024-08-17T02:26:32.222755+0000","last_peered":"2024-08-17T02:26:32.222755+0000","last_clean":"2024-08-17T02:26:32.222755+0000","last_became_active":"2024-08-17T02:26:32.213562+0000","last_became_peered":"2024-08-17T02:26:32.213562+0000","last_unstale":"2024-08-17T02:26:32.222755+0000","last_undegraded":"2024-08-17T02:26:32.222755+0000","last_fullsized":"2024-08-17T02:26:32.222755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223551+0000","last_change":"2024-08-17T02:26:31.198494+0000","last_active":"2024-08-17T02:26:32.223551+0000","last_peered":"2024-08-17T02:26:32.223551+0000","last_clean":"2024-08-17T02:26:32.223551+0000","last_became_active":"2024-08-17T02:26:31.198155+0000","last_became_peered":"2024-08-17T02:26:31.198155+0000","last_unstale":"2024-08-17T02:26:32.223551+0000","last_undegraded":"2024-08-17T02:26:32.223551+0000","last_fullsized":"2024-08-17T02:26:32.223551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:53:03.434511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216630+0000","last_change":"2024-08-17T02:26:32.206009+0000","last_active":"2024-08-17T02:26:32.216630+0000","last_peered":"2024-08-17T02:26:32.216630+0000","last_clean":"2024-08-17T02:26:32.216630+0000","last_became_active":"2024-08-17T02:26:32.205332+0000","last_became_peered":"2024-08-17T02:26:32.205332+0000","last_unstale":"2024-08-17T02:26:32.216630+0000","last_undegraded":"2024-08-17T02:26:32.216630+0000","last_fullsized":"2024-08-17T02:26:32.216630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:25.408345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.226730+0000","last_change":"2024-08-17T02:26:31.198180+0000","last_active":"2024-08-17T02:26:32.226730+0000","last_peered":"2024-08-17T02:26:32.226730+0000","last_clean":"2024-08-17T02:26:32.226730+0000","last_became_active":"2024-08-17T02:26:31.197718+0000","last_became_peered":"2024-08-17T02:26:31.197718+0000","last_unstale":"2024-08-17T02:26:32.226730+0000","last_undegraded":"2024-08-17T02:26:32.226730+0000","last_fullsized":"2024-08-17T02:26:32.226730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:24:55.382440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3130000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.871}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0030000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3119999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7040000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7429999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.944}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:41.425 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:41.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.611+0000 7efeaec00640 1 Processor -- start 2024-08-17T02:26:41.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.612+0000 7efeaec00640 1 -- start start 2024-08-17T02:26:41.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.613+0000 7efeaec00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efea80ccc10 0x7efea8163720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.613+0000 7efeaec00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea80cf600 con 0x7efea8158c90 2024-08-17T02:26:41.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.613+0000 7efeaec00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea80cea90 con 0x7efea80cadc0 2024-08-17T02:26:41.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.613+0000 7efeaec00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea80ce890 con 0x7efea80ccc10 2024-08-17T02:26:41.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.613+0000 7efead800640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efea8158c90 0x7efea80ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38418/0 (socket says 172.21.15.6:38418) 2024-08-17T02:26:41.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.613+0000 7efead800640 1 -- 172.21.15.6:0/4000502478 learned_addr learned my addr 172.21.15.6:0/4000502478 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:41.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.613+0000 7efeae200640 1 --2- 172.21.15.6:0/4000502478 >> v2:172.21.15.6:3300/0 conn(0x7efea80ccc10 0x7efea8163720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.613+0000 7efea7e00640 1 -- 172.21.15.6:0/4000502478 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609617420 0 0) 0x7efea80cf600 con 0x7efea8158c90 2024-08-17T02:26:41.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.613+0000 7efea7e00640 1 -- 172.21.15.6:0/4000502478 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe900034e0 con 0x7efea8158c90 2024-08-17T02:26:41.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.613+0000 7efeae200640 1 -- 172.21.15.6:0/4000502478 >> v1:172.21.15.136:6789/0 conn(0x7efea80cadc0 legacy=0x7efea80cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.613+0000 7efeae200640 1 -- 172.21.15.6:0/4000502478 >> v1:172.21.15.6:6789/0 conn(0x7efea8158c90 legacy=0x7efea80ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.614+0000 7efeae200640 1 -- 172.21.15.6:0/4000502478 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea80ced30 con 0x7efea80ccc10 2024-08-17T02:26:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.615+0000 7efeae200640 1 --2- 172.21.15.6:0/4000502478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efea80ccc10 0x7efea8163720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efea0009e60 tx=0x7efea0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e477ee476b78a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.615+0000 7efea7e00640 1 -- 172.21.15.6:0/4000502478 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0007550 con 0x7efea80ccc10 2024-08-17T02:26:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.615+0000 7efea7e00640 1 -- 172.21.15.6:0/4000502478 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea002d050 con 0x7efea80ccc10 2024-08-17T02:26:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.615+0000 7efea7e00640 1 -- 172.21.15.6:0/4000502478 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea00078c0 con 0x7efea80ccc10 2024-08-17T02:26:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.615+0000 7efeaec00640 1 -- 172.21.15.6:0/4000502478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efea80ccc10 msgr2=0x7efea8163720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.615+0000 7efeaec00640 1 --2- 172.21.15.6:0/4000502478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efea80ccc10 0x7efea8163720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efea0009e60 tx=0x7efea0009780 comp rx=0 tx=0).stop 2024-08-17T02:26:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.615+0000 7efeaec00640 1 -- 172.21.15.6:0/4000502478 shutdown_connections 2024-08-17T02:26:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.615+0000 7efeaec00640 1 --2- 172.21.15.6:0/4000502478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efea80ccc10 0x7efea8163720 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.615+0000 7efeaec00640 1 -- 172.21.15.6:0/4000502478 >> 172.21.15.6:0/4000502478 conn(0x7efea8087a80 msgr2=0x7efea806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.616+0000 7efeaec00640 1 -- 172.21.15.6:0/4000502478 shutdown_connections 2024-08-17T02:26:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.616+0000 7efeaec00640 1 -- 172.21.15.6:0/4000502478 wait complete. 2024-08-17T02:26:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.617+0000 7efeaec00640 1 Processor -- start 2024-08-17T02:26:41.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.617+0000 7efeaec00640 1 -- start start 2024-08-17T02:26:41.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.618+0000 7efeaec00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efea80cadc0 0x7efea80c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.618+0000 7efeaec00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efea80ccc10 0x7efea80c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.618+0000 7efeaec00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efea8158c90 0x7efea816b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.618+0000 7efeaec00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea80b2940 con 0x7efea80ccc10 2024-08-17T02:26:41.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.618+0000 7efeaec00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea80b06e0 con 0x7efea8158c90 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.618+0000 7efeaec00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea80b09c0 con 0x7efea80cadc0 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.618+0000 7efeace00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efea80ccc10 0x7efea80c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.618+0000 7efeace00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efea80ccc10 0x7efea80c6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57238/0 (socket says 172.21.15.6:57238) 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.618+0000 7efeace00640 1 -- 172.21.15.6:0/3836213789 learned_addr learned my addr 172.21.15.6:0/3836213789 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.618+0000 7efead800640 1 --2- 172.21.15.6:0/3836213789 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efea80cadc0 0x7efea80c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.618+0000 7efeae200640 1 --2- 172.21.15.6:0/3836213789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efea8158c90 0x7efea816b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.619+0000 7efeace00640 1 -- 172.21.15.6:0/3836213789 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efea80cadc0 msgr2=0x7efea80c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.619+0000 7efeace00640 1 --2- 172.21.15.6:0/3836213789 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efea80cadc0 0x7efea80c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.619+0000 7efeace00640 1 -- 172.21.15.6:0/3836213789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efea8158c90 msgr2=0x7efea816b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.619+0000 7efeace00640 1 --2- 172.21.15.6:0/3836213789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efea8158c90 0x7efea816b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.619+0000 7efeace00640 1 -- 172.21.15.6:0/3836213789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea0009a20 con 0x7efea80ccc10 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.619+0000 7efeace00640 1 --2- 172.21.15.6:0/3836213789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efea80ccc10 0x7efea80c6e80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efe9400c560 tx=0x7efe94007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.619+0000 7efea4c00640 1 -- 172.21.15.6:0/3836213789 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe94011590 con 0x7efea80ccc10 2024-08-17T02:26:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.619+0000 7efea4c00640 1 -- 172.21.15.6:0/3836213789 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe94011710 con 0x7efea80ccc10 2024-08-17T02:26:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.619+0000 7efeaec00640 1 -- 172.21.15.6:0/3836213789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea80b0ca0 con 0x7efea80ccc10 2024-08-17T02:26:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.619+0000 7efea4c00640 1 -- 172.21.15.6:0/3836213789 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe94011ad0 con 0x7efea80ccc10 2024-08-17T02:26:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.619+0000 7efeaec00640 1 -- 172.21.15.6:0/3836213789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea80c9900 con 0x7efea80ccc10 2024-08-17T02:26:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.620+0000 7efeaec00640 1 -- 172.21.15.6:0/3836213789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea8070720 con 0x7efea80ccc10 2024-08-17T02:26:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.621+0000 7efea4c00640 1 -- 172.21.15.6:0/3836213789 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efe9401b3b0 con 0x7efea80ccc10 2024-08-17T02:26:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.622+0000 7efea4c00640 1 --2- 172.21.15.6:0/3836213789 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7efe88065150 0x7efe88067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.622+0000 7efea4c00640 1 -- 172.21.15.6:0/3836213789 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efe94081a60 con 0x7efea80ccc10 2024-08-17T02:26:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.622+0000 7efead800640 1 --2- 172.21.15.6:0/3836213789 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7efe88065150 0x7efe88067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.623+0000 7efead800640 1 --2- 172.21.15.6:0/3836213789 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7efe88065150 0x7efe88067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efe9c005840 tx=0x7efe9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.626+0000 7efea4c00640 1 -- 172.21.15.6:0/3836213789 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efe9404fa80 con 0x7efea80ccc10 2024-08-17T02:26:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.808+0000 7efeaec00640 1 -- 172.21.15.6:0/3836213789 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efea80b2a80 con 0x7efe88065150 2024-08-17T02:26:41.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.816+0000 7efea4c00640 1 -- 172.21.15.6:0/3836213789 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264494 (secure 0 0 0) 0x7efe9c0013f0 con 0x7efe88065150 2024-08-17T02:26:41.820 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:41.821 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-08-17T02:26:41.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.820+0000 7efeaec00640 1 -- 172.21.15.6:0/3836213789 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7efe88065150 msgr2=0x7efe88067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.820+0000 7efeaec00640 1 --2- 172.21.15.6:0/3836213789 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7efe88065150 0x7efe88067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efe9c005840 tx=0x7efe9c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:41.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.820+0000 7efeaec00640 1 -- 172.21.15.6:0/3836213789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efea80ccc10 msgr2=0x7efea80c6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.820+0000 7efeaec00640 1 --2- 172.21.15.6:0/3836213789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efea80ccc10 0x7efea80c6e80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efe9400c560 tx=0x7efe94007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.820+0000 7efeaec00640 1 -- 172.21.15.6:0/3836213789 shutdown_connections 2024-08-17T02:26:41.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.820+0000 7efeaec00640 1 --2- 172.21.15.6:0/3836213789 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7efe88065150 0x7efe88067600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.820+0000 7efeaec00640 1 --2- 172.21.15.6:0/3836213789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efea8158c90 0x7efea816b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.820+0000 7efeaec00640 1 --2- 172.21.15.6:0/3836213789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efea80ccc10 0x7efea80c6e80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.820+0000 7efeaec00640 1 --2- 172.21.15.6:0/3836213789 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efea80cadc0 0x7efea80c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.820+0000 7efeaec00640 1 -- 172.21.15.6:0/3836213789 >> 172.21.15.6:0/3836213789 conn(0x7efea8087a80 msgr2=0x7efea80ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.820+0000 7efeaec00640 1 -- 172.21.15.6:0/3836213789 shutdown_connections 2024-08-17T02:26:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:41.820+0000 7efeaec00640 1 -- 172.21.15.6:0/3836213789 wait complete. 2024-08-17T02:26:41.835 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-17T02:26:41.410392+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381816,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592904,"statfs":{"total":773094113280,"available":770655133696,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.228288"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.203459+0000","last_change":"2024-08-17T02:26:32.199441+0000","last_active":"2024-08-17T02:26:32.203459+0000","last_peered":"2024-08-17T02:26:32.203459+0000","last_clean":"2024-08-17T02:26:32.203459+0000","last_became_active":"2024-08-17T02:26:32.195327+0000","last_became_peered":"2024-08-17T02:26:32.195327+0000","last_unstale":"2024-08-17T02:26:32.203459+0000","last_undegraded":"2024-08-17T02:26:32.203459+0000","last_fullsized":"2024-08-17T02:26:32.203459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:23.907523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.202662+0000","last_change":"2024-08-17T02:26:32.199560+0000","last_active":"2024-08-17T02:26:32.202662+0000","last_peered":"2024-08-17T02:26:32.202662+0000","last_clean":"2024-08-17T02:26:32.202662+0000","last_became_active":"2024-08-17T02:26:32.199175+0000","last_became_peered":"2024-08-17T02:26:32.199175+0000","last_unstale":"2024-08-17T02:26:32.202662+0000","last_undegraded":"2024-08-17T02:26:32.202662+0000","last_fullsized":"2024-08-17T02:26:32.202662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:47.234447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.207600+0000","last_change":"2024-08-17T02:26:32.203519+0000","last_active":"2024-08-17T02:26:32.207600+0000","last_peered":"2024-08-17T02:26:32.207600+0000","last_clean":"2024-08-17T02:26:32.207600+0000","last_became_active":"2024-08-17T02:26:32.202958+0000","last_became_peered":"2024-08-17T02:26:32.202958+0000","last_unstale":"2024-08-17T02:26:32.207600+0000","last_undegraded":"2024-08-17T02:26:32.207600+0000","last_fullsized":"2024-08-17T02:26:32.207600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:18.537099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.227468+0000","last_change":"2024-08-17T02:26:32.225955+0000","last_active":"2024-08-17T02:26:32.227468+0000","last_peered":"2024-08-17T02:26:32.227468+0000","last_clean":"2024-08-17T02:26:32.227468+0000","last_became_active":"2024-08-17T02:26:32.225708+0000","last_became_peered":"2024-08-17T02:26:32.225708+0000","last_unstale":"2024-08-17T02:26:32.227468+0000","last_undegraded":"2024-08-17T02:26:32.227468+0000","last_fullsized":"2024-08-17T02:26:32.227468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:25:34.108888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.208559+0000","last_change":"2024-08-17T02:26:32.204692+0000","last_active":"2024-08-17T02:26:32.208559+0000","last_peered":"2024-08-17T02:26:32.208559+0000","last_clean":"2024-08-17T02:26:32.208559+0000","last_became_active":"2024-08-17T02:26:32.203666+0000","last_became_peered":"2024-08-17T02:26:32.203666+0000","last_unstale":"2024-08-17T02:26:32.208559+0000","last_undegraded":"2024-08-17T02:26:32.208559+0000","last_fullsized":"2024-08-17T02:26:32.208559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:25:34.108888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.214622+0000","last_change":"2024-08-17T02:26:32.209096+0000","last_active":"2024-08-17T02:26:32.214622+0000","last_peered":"2024-08-17T02:26:32.214622+0000","last_clean":"2024-08-17T02:26:32.214622+0000","last_became_active":"2024-08-17T02:26:32.208883+0000","last_became_peered":"2024-08-17T02:26:32.208883+0000","last_unstale":"2024-08-17T02:26:32.214622+0000","last_undegraded":"2024-08-17T02:26:32.214622+0000","last_fullsized":"2024-08-17T02:26:32.214622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:25.408345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.207833+0000","last_change":"2024-08-17T02:26:32.201368+0000","last_active":"2024-08-17T02:26:32.207833+0000","last_peered":"2024-08-17T02:26:32.207833+0000","last_clean":"2024-08-17T02:26:32.207833+0000","last_became_active":"2024-08-17T02:26:32.200370+0000","last_became_peered":"2024-08-17T02:26:32.200370+0000","last_unstale":"2024-08-17T02:26:32.207833+0000","last_undegraded":"2024-08-17T02:26:32.207833+0000","last_fullsized":"2024-08-17T02:26:32.207833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:15:23.868986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.220653+0000","last_change":"2024-08-17T02:26:32.215927+0000","last_active":"2024-08-17T02:26:32.220653+0000","last_peered":"2024-08-17T02:26:32.220653+0000","last_clean":"2024-08-17T02:26:32.220653+0000","last_became_active":"2024-08-17T02:26:32.215631+0000","last_became_peered":"2024-08-17T02:26:32.215631+0000","last_unstale":"2024-08-17T02:26:32.220653+0000","last_undegraded":"2024-08-17T02:26:32.220653+0000","last_fullsized":"2024-08-17T02:26:32.220653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223514+0000","last_change":"2024-08-17T02:26:32.218745+0000","last_active":"2024-08-17T02:26:32.223514+0000","last_peered":"2024-08-17T02:26:32.223514+0000","last_clean":"2024-08-17T02:26:32.223514+0000","last_became_active":"2024-08-17T02:26:32.218069+0000","last_became_peered":"2024-08-17T02:26:32.218069+0000","last_unstale":"2024-08-17T02:26:32.223514+0000","last_undegraded":"2024-08-17T02:26:32.223514+0000","last_fullsized":"2024-08-17T02:26:32.223514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:53.799652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.219488+0000","last_change":"2024-08-17T02:26:32.215519+0000","last_active":"2024-08-17T02:26:32.219488+0000","last_peered":"2024-08-17T02:26:32.219488+0000","last_clean":"2024-08-17T02:26:32.219488+0000","last_became_active":"2024-08-17T02:26:32.215218+0000","last_became_peered":"2024-08-17T02:26:32.215218+0000","last_unstale":"2024-08-17T02:26:32.219488+0000","last_undegraded":"2024-08-17T02:26:32.219488+0000","last_fullsized":"2024-08-17T02:26:32.219488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:39.950692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210439+0000","last_change":"2024-08-17T02:26:32.205449+0000","last_active":"2024-08-17T02:26:32.210439+0000","last_peered":"2024-08-17T02:26:32.210439+0000","last_clean":"2024-08-17T02:26:32.210439+0000","last_became_active":"2024-08-17T02:26:32.205156+0000","last_became_peered":"2024-08-17T02:26:32.205156+0000","last_unstale":"2024-08-17T02:26:32.210439+0000","last_undegraded":"2024-08-17T02:26:32.210439+0000","last_fullsized":"2024-08-17T02:26:32.210439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.221575+0000","last_change":"2024-08-17T02:26:32.203589+0000","last_active":"2024-08-17T02:26:32.221575+0000","last_peered":"2024-08-17T02:26:32.221575+0000","last_clean":"2024-08-17T02:26:32.221575+0000","last_became_active":"2024-08-17T02:26:32.200349+0000","last_became_peered":"2024-08-17T02:26:32.200349+0000","last_unstale":"2024-08-17T02:26:32.221575+0000","last_undegraded":"2024-08-17T02:26:32.221575+0000","last_fullsized":"2024-08-17T02:26:32.221575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:18.353263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.217316+0000","last_change":"2024-08-17T02:26:32.209097+0000","last_active":"2024-08-17T02:26:32.217316+0000","last_peered":"2024-08-17T02:26:32.217316+0000","last_clean":"2024-08-17T02:26:32.217316+0000","last_became_active":"2024-08-17T02:26:32.205693+0000","last_became_peered":"2024-08-17T02:26:32.205693+0000","last_unstale":"2024-08-17T02:26:32.217316+0000","last_undegraded":"2024-08-17T02:26:32.217316+0000","last_fullsized":"2024-08-17T02:26:32.217316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:47.234447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.206406+0000","last_change":"2024-08-17T02:26:32.202857+0000","last_active":"2024-08-17T02:26:32.206406+0000","last_peered":"2024-08-17T02:26:32.206406+0000","last_clean":"2024-08-17T02:26:32.206406+0000","last_became_active":"2024-08-17T02:26:32.202620+0000","last_became_peered":"2024-08-17T02:26:32.202620+0000","last_unstale":"2024-08-17T02:26:32.206406+0000","last_undegraded":"2024-08-17T02:26:32.206406+0000","last_fullsized":"2024-08-17T02:26:32.206406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:53.545799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.205254+0000","last_change":"2024-08-17T02:26:32.201410+0000","last_active":"2024-08-17T02:26:32.205254+0000","last_peered":"2024-08-17T02:26:32.205254+0000","last_clean":"2024-08-17T02:26:32.205254+0000","last_became_active":"2024-08-17T02:26:32.201146+0000","last_became_peered":"2024-08-17T02:26:32.201146+0000","last_unstale":"2024-08-17T02:26:32.205254+0000","last_undegraded":"2024-08-17T02:26:32.205254+0000","last_fullsized":"2024-08-17T02:26:32.205254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:39.950692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.213147+0000","last_change":"2024-08-17T02:26:32.209517+0000","last_active":"2024-08-17T02:26:32.213147+0000","last_peered":"2024-08-17T02:26:32.213147+0000","last_clean":"2024-08-17T02:26:32.213147+0000","last_became_active":"2024-08-17T02:26:32.209006+0000","last_became_peered":"2024-08-17T02:26:32.209006+0000","last_unstale":"2024-08-17T02:26:32.213147+0000","last_undegraded":"2024-08-17T02:26:32.213147+0000","last_fullsized":"2024-08-17T02:26:32.213147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:56:37.929984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.212900+0000","last_change":"2024-08-17T02:26:32.207200+0000","last_active":"2024-08-17T02:26:32.212900+0000","last_peered":"2024-08-17T02:26:32.212900+0000","last_clean":"2024-08-17T02:26:32.212900+0000","last_became_active":"2024-08-17T02:26:32.206936+0000","last_became_peered":"2024-08-17T02:26:32.206936+0000","last_unstale":"2024-08-17T02:26:32.212900+0000","last_undegraded":"2024-08-17T02:26:32.212900+0000","last_fullsized":"2024-08-17T02:26:32.212900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.201442+0000","last_change":"2024-08-17T02:26:32.197012+0000","last_active":"2024-08-17T02:26:32.201442+0000","last_peered":"2024-08-17T02:26:32.201442+0000","last_clean":"2024-08-17T02:26:32.201442+0000","last_became_active":"2024-08-17T02:26:32.196767+0000","last_became_peered":"2024-08-17T02:26:32.196767+0000","last_unstale":"2024-08-17T02:26:32.201442+0000","last_undegraded":"2024-08-17T02:26:32.201442+0000","last_fullsized":"2024-08-17T02:26:32.201442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:18.353263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.208488+0000","last_change":"2024-08-17T02:26:32.204201+0000","last_active":"2024-08-17T02:26:32.208488+0000","last_peered":"2024-08-17T02:26:32.208488+0000","last_clean":"2024-08-17T02:26:32.208488+0000","last_became_active":"2024-08-17T02:26:32.203698+0000","last_became_peered":"2024-08-17T02:26:32.203698+0000","last_unstale":"2024-08-17T02:26:32.208488+0000","last_undegraded":"2024-08-17T02:26:32.208488+0000","last_fullsized":"2024-08-17T02:26:32.208488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:19:31.787387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210386+0000","last_change":"2024-08-17T02:26:32.204316+0000","last_active":"2024-08-17T02:26:32.210386+0000","last_peered":"2024-08-17T02:26:32.210386+0000","last_clean":"2024-08-17T02:26:32.210386+0000","last_became_active":"2024-08-17T02:26:32.203847+0000","last_became_peered":"2024-08-17T02:26:32.203847+0000","last_unstale":"2024-08-17T02:26:32.210386+0000","last_undegraded":"2024-08-17T02:26:32.210386+0000","last_fullsized":"2024-08-17T02:26:32.210386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.212827+0000","last_change":"2024-08-17T02:26:32.210228+0000","last_active":"2024-08-17T02:26:32.212827+0000","last_peered":"2024-08-17T02:26:32.212827+0000","last_clean":"2024-08-17T02:26:32.212827+0000","last_became_active":"2024-08-17T02:26:32.209517+0000","last_became_peered":"2024-08-17T02:26:32.209517+0000","last_unstale":"2024-08-17T02:26:32.212827+0000","last_undegraded":"2024-08-17T02:26:32.212827+0000","last_fullsized":"2024-08-17T02:26:32.212827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.221242+0000","last_change":"2024-08-17T02:26:32.213782+0000","last_active":"2024-08-17T02:26:32.221242+0000","last_peered":"2024-08-17T02:26:32.221242+0000","last_clean":"2024-08-17T02:26:32.221242+0000","last_became_active":"2024-08-17T02:26:32.213525+0000","last_became_peered":"2024-08-17T02:26:32.213525+0000","last_unstale":"2024-08-17T02:26:32.221242+0000","last_undegraded":"2024-08-17T02:26:32.221242+0000","last_fullsized":"2024-08-17T02:26:32.221242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:59.385496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216837+0000","last_change":"2024-08-17T02:26:32.208770+0000","last_active":"2024-08-17T02:26:32.216837+0000","last_peered":"2024-08-17T02:26:32.216837+0000","last_clean":"2024-08-17T02:26:32.216837+0000","last_became_active":"2024-08-17T02:26:32.208425+0000","last_became_peered":"2024-08-17T02:26:32.208425+0000","last_unstale":"2024-08-17T02:26:32.216837+0000","last_undegraded":"2024-08-17T02:26:32.216837+0000","last_fullsized":"2024-08-17T02:26:32.216837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222669+0000","last_change":"2024-08-17T02:26:32.218955+0000","last_active":"2024-08-17T02:26:32.222669+0000","last_peered":"2024-08-17T02:26:32.222669+0000","last_clean":"2024-08-17T02:26:32.222669+0000","last_became_active":"2024-08-17T02:26:32.218670+0000","last_became_peered":"2024-08-17T02:26:32.218670+0000","last_unstale":"2024-08-17T02:26:32.222669+0000","last_undegraded":"2024-08-17T02:26:32.222669+0000","last_fullsized":"2024-08-17T02:26:32.222669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224570+0000","last_change":"2024-08-17T02:26:32.219168+0000","last_active":"2024-08-17T02:26:32.224570+0000","last_peered":"2024-08-17T02:26:32.224570+0000","last_clean":"2024-08-17T02:26:32.224570+0000","last_became_active":"2024-08-17T02:26:32.218856+0000","last_became_peered":"2024-08-17T02:26:32.218856+0000","last_unstale":"2024-08-17T02:26:32.224570+0000","last_undegraded":"2024-08-17T02:26:32.224570+0000","last_fullsized":"2024-08-17T02:26:32.224570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:12.730663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210090+0000","last_change":"2024-08-17T02:26:32.202312+0000","last_active":"2024-08-17T02:26:32.210090+0000","last_peered":"2024-08-17T02:26:32.210090+0000","last_clean":"2024-08-17T02:26:32.210090+0000","last_became_active":"2024-08-17T02:26:32.202077+0000","last_became_peered":"2024-08-17T02:26:32.202077+0000","last_unstale":"2024-08-17T02:26:32.210090+0000","last_undegraded":"2024-08-17T02:26:32.210090+0000","last_fullsized":"2024-08-17T02:26:32.210090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:12.730663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.205085+0000","last_change":"2024-08-17T02:26:32.201137+0000","last_active":"2024-08-17T02:26:32.205085+0000","last_peered":"2024-08-17T02:26:32.205085+0000","last_clean":"2024-08-17T02:26:32.205085+0000","last_became_active":"2024-08-17T02:26:32.200498+0000","last_became_peered":"2024-08-17T02:26:32.200498+0000","last_unstale":"2024-08-17T02:26:32.205085+0000","last_undegraded":"2024-08-17T02:26:32.205085+0000","last_fullsized":"2024-08-17T02:26:32.205085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:59.385496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.225211+0000","last_change":"2024-08-17T02:26:32.221220+0000","last_active":"2024-08-17T02:26:32.225211+0000","last_peered":"2024-08-17T02:26:32.225211+0000","last_clean":"2024-08-17T02:26:32.225211+0000","last_became_active":"2024-08-17T02:26:32.220959+0000","last_became_peered":"2024-08-17T02:26:32.220959+0000","last_unstale":"2024-08-17T02:26:32.225211+0000","last_undegraded":"2024-08-17T02:26:32.225211+0000","last_fullsized":"2024-08-17T02:26:32.225211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:39.950692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.202233+0000","last_change":"2024-08-17T02:26:32.199159+0000","last_active":"2024-08-17T02:26:32.202233+0000","last_peered":"2024-08-17T02:26:32.202233+0000","last_clean":"2024-08-17T02:26:32.202233+0000","last_became_active":"2024-08-17T02:26:32.198845+0000","last_became_peered":"2024-08-17T02:26:32.198845+0000","last_unstale":"2024-08-17T02:26:32.202233+0000","last_undegraded":"2024-08-17T02:26:32.202233+0000","last_fullsized":"2024-08-17T02:26:32.202233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:12.730663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222754+0000","last_change":"2024-08-17T02:26:32.218327+0000","last_active":"2024-08-17T02:26:32.222754+0000","last_peered":"2024-08-17T02:26:32.222754+0000","last_clean":"2024-08-17T02:26:32.222754+0000","last_became_active":"2024-08-17T02:26:32.218052+0000","last_became_peered":"2024-08-17T02:26:32.218052+0000","last_unstale":"2024-08-17T02:26:32.222754+0000","last_undegraded":"2024-08-17T02:26:32.222754+0000","last_fullsized":"2024-08-17T02:26:32.222754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:59.331351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.202572+0000","last_change":"2024-08-17T02:26:32.199446+0000","last_active":"2024-08-17T02:26:32.202572+0000","last_peered":"2024-08-17T02:26:32.202572+0000","last_clean":"2024-08-17T02:26:32.202572+0000","last_became_active":"2024-08-17T02:26:32.199139+0000","last_became_peered":"2024-08-17T02:26:32.199139+0000","last_unstale":"2024-08-17T02:26:32.202572+0000","last_undegraded":"2024-08-17T02:26:32.202572+0000","last_fullsized":"2024-08-17T02:26:32.202572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:08.860859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.209270+0000","last_change":"2024-08-17T02:26:32.199075+0000","last_active":"2024-08-17T02:26:32.209270+0000","last_peered":"2024-08-17T02:26:32.209270+0000","last_clean":"2024-08-17T02:26:32.209270+0000","last_became_active":"2024-08-17T02:26:32.198255+0000","last_became_peered":"2024-08-17T02:26:32.198255+0000","last_unstale":"2024-08-17T02:26:32.209270+0000","last_undegraded":"2024-08-17T02:26:32.209270+0000","last_fullsized":"2024-08-17T02:26:32.209270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:18.537099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.201883+0000","last_change":"2024-08-17T02:26:32.199005+0000","last_active":"2024-08-17T02:26:32.201883+0000","last_peered":"2024-08-17T02:26:32.201883+0000","last_clean":"2024-08-17T02:26:32.201883+0000","last_became_active":"2024-08-17T02:26:32.198711+0000","last_became_peered":"2024-08-17T02:26:32.198711+0000","last_unstale":"2024-08-17T02:26:32.201883+0000","last_undegraded":"2024-08-17T02:26:32.201883+0000","last_fullsized":"2024-08-17T02:26:32.201883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:22.633118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223675+0000","last_change":"2024-08-17T02:26:31.188549+0000","last_active":"2024-08-17T02:26:32.223675+0000","last_peered":"2024-08-17T02:26:32.223675+0000","last_clean":"2024-08-17T02:26:32.223675+0000","last_became_active":"2024-08-17T02:26:31.188272+0000","last_became_peered":"2024-08-17T02:26:31.188272+0000","last_unstale":"2024-08-17T02:26:32.223675+0000","last_undegraded":"2024-08-17T02:26:32.223675+0000","last_fullsized":"2024-08-17T02:26:32.223675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:46.029644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222700+0000","last_change":"2024-08-17T02:26:32.214370+0000","last_active":"2024-08-17T02:26:32.222700+0000","last_peered":"2024-08-17T02:26:32.222700+0000","last_clean":"2024-08-17T02:26:32.222700+0000","last_became_active":"2024-08-17T02:26:32.214126+0000","last_became_peered":"2024-08-17T02:26:32.214126+0000","last_unstale":"2024-08-17T02:26:32.222700+0000","last_undegraded":"2024-08-17T02:26:32.222700+0000","last_fullsized":"2024-08-17T02:26:32.222700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:39.950692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224831+0000","last_change":"2024-08-17T02:26:31.203526+0000","last_active":"2024-08-17T02:26:32.224831+0000","last_peered":"2024-08-17T02:26:32.224831+0000","last_clean":"2024-08-17T02:26:32.224831+0000","last_became_active":"2024-08-17T02:26:31.202971+0000","last_became_peered":"2024-08-17T02:26:31.202971+0000","last_unstale":"2024-08-17T02:26:32.224831+0000","last_undegraded":"2024-08-17T02:26:32.224831+0000","last_fullsized":"2024-08-17T02:26:32.224831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:29.752289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.191559+0000","last_change":"2024-08-17T02:26:31.200001+0000","last_active":"2024-08-17T02:26:32.191559+0000","last_peered":"2024-08-17T02:26:32.191559+0000","last_clean":"2024-08-17T02:26:32.191559+0000","last_became_active":"2024-08-17T02:26:31.199719+0000","last_became_peered":"2024-08-17T02:26:31.199719+0000","last_unstale":"2024-08-17T02:26:32.191559+0000","last_undegraded":"2024-08-17T02:26:32.191559+0000","last_fullsized":"2024-08-17T02:26:32.191559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:13:53.155805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216384+0000","last_change":"2024-08-17T02:26:32.204465+0000","last_active":"2024-08-17T02:26:32.216384+0000","last_peered":"2024-08-17T02:26:32.216384+0000","last_clean":"2024-08-17T02:26:32.216384+0000","last_became_active":"2024-08-17T02:26:32.204203+0000","last_became_peered":"2024-08-17T02:26:32.204203+0000","last_unstale":"2024-08-17T02:26:32.216384+0000","last_undegraded":"2024-08-17T02:26:32.216384+0000","last_fullsized":"2024-08-17T02:26:32.216384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:22.493908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.192718+0000","last_change":"2024-08-17T02:26:31.195728+0000","last_active":"2024-08-17T02:26:32.192718+0000","last_peered":"2024-08-17T02:26:32.192718+0000","last_clean":"2024-08-17T02:26:32.192718+0000","last_became_active":"2024-08-17T02:26:31.195461+0000","last_became_peered":"2024-08-17T02:26:31.195461+0000","last_unstale":"2024-08-17T02:26:32.192718+0000","last_undegraded":"2024-08-17T02:26:32.192718+0000","last_fullsized":"2024-08-17T02:26:32.192718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:00.267868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.205273+0000","last_change":"2024-08-17T02:26:32.201225+0000","last_active":"2024-08-17T02:26:32.205273+0000","last_peered":"2024-08-17T02:26:32.205273+0000","last_clean":"2024-08-17T02:26:32.205273+0000","last_became_active":"2024-08-17T02:26:32.200883+0000","last_became_peered":"2024-08-17T02:26:32.200883+0000","last_unstale":"2024-08-17T02:26:32.205273+0000","last_undegraded":"2024-08-17T02:26:32.205273+0000","last_fullsized":"2024-08-17T02:26:32.205273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.196667+0000","last_change":"2024-08-17T02:26:31.203729+0000","last_active":"2024-08-17T02:26:32.196667+0000","last_peered":"2024-08-17T02:26:32.196667+0000","last_clean":"2024-08-17T02:26:32.196667+0000","last_became_active":"2024-08-17T02:26:31.203402+0000","last_became_peered":"2024-08-17T02:26:31.203402+0000","last_unstale":"2024-08-17T02:26:32.196667+0000","last_undegraded":"2024-08-17T02:26:32.196667+0000","last_fullsized":"2024-08-17T02:26:32.196667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:21.626630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.214196+0000","last_change":"2024-08-17T02:26:32.209985+0000","last_active":"2024-08-17T02:26:32.214196+0000","last_peered":"2024-08-17T02:26:32.214196+0000","last_clean":"2024-08-17T02:26:32.214196+0000","last_became_active":"2024-08-17T02:26:32.209542+0000","last_became_peered":"2024-08-17T02:26:32.209542+0000","last_unstale":"2024-08-17T02:26:32.214196+0000","last_undegraded":"2024-08-17T02:26:32.214196+0000","last_fullsized":"2024-08-17T02:26:32.214196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:47.234447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.209840+0000","last_change":"2024-08-17T02:26:31.205754+0000","last_active":"2024-08-17T02:26:32.209840+0000","last_peered":"2024-08-17T02:26:32.209840+0000","last_clean":"2024-08-17T02:26:32.209840+0000","last_became_active":"2024-08-17T02:26:31.205187+0000","last_became_peered":"2024-08-17T02:26:31.205187+0000","last_unstale":"2024-08-17T02:26:32.209840+0000","last_undegraded":"2024-08-17T02:26:32.209840+0000","last_fullsized":"2024-08-17T02:26:32.209840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:36.476579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222736+0000","last_change":"2024-08-17T02:26:32.213334+0000","last_active":"2024-08-17T02:26:32.222736+0000","last_peered":"2024-08-17T02:26:32.222736+0000","last_clean":"2024-08-17T02:26:32.222736+0000","last_became_active":"2024-08-17T02:26:32.213073+0000","last_became_peered":"2024-08-17T02:26:32.213073+0000","last_unstale":"2024-08-17T02:26:32.222736+0000","last_undegraded":"2024-08-17T02:26:32.222736+0000","last_fullsized":"2024-08-17T02:26:32.222736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:16:50.112486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.226031+0000","last_change":"2024-08-17T02:26:31.193999+0000","last_active":"2024-08-17T02:26:32.226031+0000","last_peered":"2024-08-17T02:26:32.226031+0000","last_clean":"2024-08-17T02:26:32.226031+0000","last_became_active":"2024-08-17T02:26:31.193689+0000","last_became_peered":"2024-08-17T02:26:31.193689+0000","last_unstale":"2024-08-17T02:26:32.226031+0000","last_undegraded":"2024-08-17T02:26:32.226031+0000","last_fullsized":"2024-08-17T02:26:32.226031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:07.854371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.221598+0000","last_change":"2024-08-17T02:26:32.210669+0000","last_active":"2024-08-17T02:26:32.221598+0000","last_peered":"2024-08-17T02:26:32.221598+0000","last_clean":"2024-08-17T02:26:32.221598+0000","last_became_active":"2024-08-17T02:26:32.203230+0000","last_became_peered":"2024-08-17T02:26:32.203230+0000","last_unstale":"2024-08-17T02:26:32.221598+0000","last_undegraded":"2024-08-17T02:26:32.221598+0000","last_fullsized":"2024-08-17T02:26:32.221598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:35.520908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.228823+0000","last_change":"2024-08-17T02:26:31.204431+0000","last_active":"2024-08-17T02:26:32.228823+0000","last_peered":"2024-08-17T02:26:32.228823+0000","last_clean":"2024-08-17T02:26:32.228823+0000","last_became_active":"2024-08-17T02:26:31.204173+0000","last_became_peered":"2024-08-17T02:26:31.204173+0000","last_unstale":"2024-08-17T02:26:32.228823+0000","last_undegraded":"2024-08-17T02:26:32.228823+0000","last_fullsized":"2024-08-17T02:26:32.228823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:36.476579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223479+0000","last_change":"2024-08-17T02:26:32.216157+0000","last_active":"2024-08-17T02:26:32.223479+0000","last_peered":"2024-08-17T02:26:32.223479+0000","last_clean":"2024-08-17T02:26:32.223479+0000","last_became_active":"2024-08-17T02:26:32.215849+0000","last_became_peered":"2024-08-17T02:26:32.215849+0000","last_unstale":"2024-08-17T02:26:32.223479+0000","last_undegraded":"2024-08-17T02:26:32.223479+0000","last_fullsized":"2024-08-17T02:26:32.223479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:47.234447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.225699+0000","last_change":"2024-08-17T02:26:31.203059+0000","last_active":"2024-08-17T02:26:32.225699+0000","last_peered":"2024-08-17T02:26:32.225699+0000","last_clean":"2024-08-17T02:26:32.225699+0000","last_became_active":"2024-08-17T02:26:31.202794+0000","last_became_peered":"2024-08-17T02:26:31.202794+0000","last_unstale":"2024-08-17T02:26:32.225699+0000","last_undegraded":"2024-08-17T02:26:32.225699+0000","last_fullsized":"2024-08-17T02:26:32.225699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:46.029644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216333+0000","last_change":"2024-08-17T02:26:32.210912+0000","last_active":"2024-08-17T02:26:32.216333+0000","last_peered":"2024-08-17T02:26:32.216333+0000","last_clean":"2024-08-17T02:26:32.216333+0000","last_became_active":"2024-08-17T02:26:32.210509+0000","last_became_peered":"2024-08-17T02:26:32.210509+0000","last_unstale":"2024-08-17T02:26:32.216333+0000","last_undegraded":"2024-08-17T02:26:32.216333+0000","last_fullsized":"2024-08-17T02:26:32.216333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:08.860859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210217+0000","last_change":"2024-08-17T02:26:31.197665+0000","last_active":"2024-08-17T02:26:32.210217+0000","last_peered":"2024-08-17T02:26:32.210217+0000","last_clean":"2024-08-17T02:26:32.210217+0000","last_became_active":"2024-08-17T02:26:31.197429+0000","last_became_peered":"2024-08-17T02:26:31.197429+0000","last_unstale":"2024-08-17T02:26:32.210217+0000","last_undegraded":"2024-08-17T02:26:32.210217+0000","last_fullsized":"2024-08-17T02:26:32.210217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:14.675670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.208532+0000","last_change":"2024-08-17T02:26:32.204360+0000","last_active":"2024-08-17T02:26:32.208532+0000","last_peered":"2024-08-17T02:26:32.208532+0000","last_clean":"2024-08-17T02:26:32.208532+0000","last_became_active":"2024-08-17T02:26:32.197360+0000","last_became_peered":"2024-08-17T02:26:32.197360+0000","last_unstale":"2024-08-17T02:26:32.208532+0000","last_undegraded":"2024-08-17T02:26:32.208532+0000","last_fullsized":"2024-08-17T02:26:32.208532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:04:17.552404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.193585+0000","last_change":"2024-08-17T02:26:31.203360+0000","last_active":"2024-08-17T02:26:32.193585+0000","last_peered":"2024-08-17T02:26:32.193585+0000","last_clean":"2024-08-17T02:26:32.193585+0000","last_became_active":"2024-08-17T02:26:31.202988+0000","last_became_peered":"2024-08-17T02:26:31.202988+0000","last_unstale":"2024-08-17T02:26:32.193585+0000","last_undegraded":"2024-08-17T02:26:32.193585+0000","last_fullsized":"2024-08-17T02:26:32.193585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:53:03.434511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.214346+0000","last_change":"2024-08-17T02:26:32.198486+0000","last_active":"2024-08-17T02:26:32.214346+0000","last_peered":"2024-08-17T02:26:32.214346+0000","last_clean":"2024-08-17T02:26:32.214346+0000","last_became_active":"2024-08-17T02:26:32.197905+0000","last_became_peered":"2024-08-17T02:26:32.197905+0000","last_unstale":"2024-08-17T02:26:32.214346+0000","last_undegraded":"2024-08-17T02:26:32.214346+0000","last_fullsized":"2024-08-17T02:26:32.214346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:53.545799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.226669+0000","last_change":"2024-08-17T02:26:31.193931+0000","last_active":"2024-08-17T02:26:32.226669+0000","last_peered":"2024-08-17T02:26:32.226669+0000","last_clean":"2024-08-17T02:26:32.226669+0000","last_became_active":"2024-08-17T02:26:31.192003+0000","last_became_peered":"2024-08-17T02:26:31.192003+0000","last_unstale":"2024-08-17T02:26:32.226669+0000","last_undegraded":"2024-08-17T02:26:32.226669+0000","last_fullsized":"2024-08-17T02:26:32.226669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:14.675670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.209304+0000","last_change":"2024-08-17T02:26:32.206117+0000","last_active":"2024-08-17T02:26:32.209304+0000","last_peered":"2024-08-17T02:26:32.209304+0000","last_clean":"2024-08-17T02:26:32.209304+0000","last_became_active":"2024-08-17T02:26:32.205803+0000","last_became_peered":"2024-08-17T02:26:32.205803+0000","last_unstale":"2024-08-17T02:26:32.209304+0000","last_undegraded":"2024-08-17T02:26:32.209304+0000","last_fullsized":"2024-08-17T02:26:32.209304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:59.331351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224293+0000","last_change":"2024-08-17T02:26:31.198233+0000","last_active":"2024-08-17T02:26:32.224293+0000","last_peered":"2024-08-17T02:26:32.224293+0000","last_clean":"2024-08-17T02:26:32.224293+0000","last_became_active":"2024-08-17T02:26:31.197699+0000","last_became_peered":"2024-08-17T02:26:31.197699+0000","last_unstale":"2024-08-17T02:26:32.224293+0000","last_undegraded":"2024-08-17T02:26:32.224293+0000","last_fullsized":"2024-08-17T02:26:32.224293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:46.029644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210402+0000","last_change":"2024-08-17T02:26:32.207718+0000","last_active":"2024-08-17T02:26:32.210402+0000","last_peered":"2024-08-17T02:26:32.210402+0000","last_clean":"2024-08-17T02:26:32.210402+0000","last_became_active":"2024-08-17T02:26:32.204744+0000","last_became_peered":"2024-08-17T02:26:32.204744+0000","last_unstale":"2024-08-17T02:26:32.210402+0000","last_undegraded":"2024-08-17T02:26:32.210402+0000","last_fullsized":"2024-08-17T02:26:32.210402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:56:37.929984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224554+0000","last_change":"2024-08-17T02:26:31.195725+0000","last_active":"2024-08-17T02:26:32.224554+0000","last_peered":"2024-08-17T02:26:32.224554+0000","last_clean":"2024-08-17T02:26:32.224554+0000","last_became_active":"2024-08-17T02:26:31.195446+0000","last_became_peered":"2024-08-17T02:26:31.195446+0000","last_unstale":"2024-08-17T02:26:32.224554+0000","last_undegraded":"2024-08-17T02:26:32.224554+0000","last_fullsized":"2024-08-17T02:26:32.224554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:00.267868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.209351+0000","last_change":"2024-08-17T02:26:32.207003+0000","last_active":"2024-08-17T02:26:32.209351+0000","last_peered":"2024-08-17T02:26:32.209351+0000","last_clean":"2024-08-17T02:26:32.209351+0000","last_became_active":"2024-08-17T02:26:32.206741+0000","last_became_peered":"2024-08-17T02:26:32.206741+0000","last_unstale":"2024-08-17T02:26:32.209351+0000","last_undegraded":"2024-08-17T02:26:32.209351+0000","last_fullsized":"2024-08-17T02:26:32.209351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:44.277870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.225797+0000","last_change":"2024-08-17T02:26:31.188727+0000","last_active":"2024-08-17T02:26:32.225797+0000","last_peered":"2024-08-17T02:26:32.225797+0000","last_clean":"2024-08-17T02:26:32.225797+0000","last_became_active":"2024-08-17T02:26:31.187702+0000","last_became_peered":"2024-08-17T02:26:31.187702+0000","last_unstale":"2024-08-17T02:26:32.225797+0000","last_undegraded":"2024-08-17T02:26:32.225797+0000","last_fullsized":"2024-08-17T02:26:32.225797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:29.752289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.227485+0000","last_change":"2024-08-17T02:26:32.226432+0000","last_active":"2024-08-17T02:26:32.227485+0000","last_peered":"2024-08-17T02:26:32.227485+0000","last_clean":"2024-08-17T02:26:32.227485+0000","last_became_active":"2024-08-17T02:26:32.226202+0000","last_became_peered":"2024-08-17T02:26:32.226202+0000","last_unstale":"2024-08-17T02:26:32.227485+0000","last_undegraded":"2024-08-17T02:26:32.227485+0000","last_fullsized":"2024-08-17T02:26:32.227485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:19:31.787387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.188823+0000","last_change":"2024-08-17T02:26:31.196292+0000","last_active":"2024-08-17T02:26:32.188823+0000","last_peered":"2024-08-17T02:26:32.188823+0000","last_clean":"2024-08-17T02:26:32.188823+0000","last_became_active":"2024-08-17T02:26:31.196030+0000","last_became_peered":"2024-08-17T02:26:31.196030+0000","last_unstale":"2024-08-17T02:26:32.188823+0000","last_undegraded":"2024-08-17T02:26:32.188823+0000","last_fullsized":"2024-08-17T02:26:32.188823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:36.476579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223492+0000","last_change":"2024-08-17T02:26:32.217034+0000","last_active":"2024-08-17T02:26:32.223492+0000","last_peered":"2024-08-17T02:26:32.223492+0000","last_clean":"2024-08-17T02:26:32.223492+0000","last_became_active":"2024-08-17T02:26:32.215414+0000","last_became_peered":"2024-08-17T02:26:32.215414+0000","last_unstale":"2024-08-17T02:26:32.223492+0000","last_undegraded":"2024-08-17T02:26:32.223492+0000","last_fullsized":"2024-08-17T02:26:32.223492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:22.327159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.185570+0000","last_change":"2024-08-17T02:26:27.275086+0000","last_active":"2024-08-17T02:26:32.185570+0000","last_peered":"2024-08-17T02:26:32.185570+0000","last_clean":"2024-08-17T02:26:32.185570+0000","last_became_active":"2024-08-17T02:26:27.274075+0000","last_became_peered":"2024-08-17T02:26:27.274075+0000","last_unstale":"2024-08-17T02:26:32.185570+0000","last_undegraded":"2024-08-17T02:26:32.185570+0000","last_fullsized":"2024-08-17T02:26:32.185570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_clean_scrub_stamp":"2024-08-17T02:26:26.139133+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:52.161982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210441+0000","last_change":"2024-08-17T02:26:31.198699+0000","last_active":"2024-08-17T02:26:32.210441+0000","last_peered":"2024-08-17T02:26:32.210441+0000","last_clean":"2024-08-17T02:26:32.210441+0000","last_became_active":"2024-08-17T02:26:31.198462+0000","last_became_peered":"2024-08-17T02:26:31.198462+0000","last_unstale":"2024-08-17T02:26:32.210441+0000","last_undegraded":"2024-08-17T02:26:32.210441+0000","last_fullsized":"2024-08-17T02:26:32.210441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:13:53.155805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224120+0000","last_change":"2024-08-17T02:26:32.217116+0000","last_active":"2024-08-17T02:26:32.224120+0000","last_peered":"2024-08-17T02:26:32.224120+0000","last_clean":"2024-08-17T02:26:32.224120+0000","last_became_active":"2024-08-17T02:26:32.216502+0000","last_became_peered":"2024-08-17T02:26:32.216502+0000","last_unstale":"2024-08-17T02:26:32.224120+0000","last_undegraded":"2024-08-17T02:26:32.224120+0000","last_fullsized":"2024-08-17T02:26:32.224120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:59.385496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.185482+0000","last_change":"2024-08-17T02:26:31.194925+0000","last_active":"2024-08-17T02:26:32.185482+0000","last_peered":"2024-08-17T02:26:32.185482+0000","last_clean":"2024-08-17T02:26:32.185482+0000","last_became_active":"2024-08-17T02:26:31.194668+0000","last_became_peered":"2024-08-17T02:26:31.194668+0000","last_unstale":"2024-08-17T02:26:32.185482+0000","last_undegraded":"2024-08-17T02:26:32.185482+0000","last_fullsized":"2024-08-17T02:26:32.185482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:17.346775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216389+0000","last_change":"2024-08-17T02:26:32.212095+0000","last_active":"2024-08-17T02:26:32.216389+0000","last_peered":"2024-08-17T02:26:32.216389+0000","last_clean":"2024-08-17T02:26:32.216389+0000","last_became_active":"2024-08-17T02:26:32.211786+0000","last_became_peered":"2024-08-17T02:26:32.211786+0000","last_unstale":"2024-08-17T02:26:32.216389+0000","last_undegraded":"2024-08-17T02:26:32.216389+0000","last_fullsized":"2024-08-17T02:26:32.216389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:12:08.917953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.189462+0000","last_change":"2024-08-17T02:26:31.190007+0000","last_active":"2024-08-17T02:26:32.189462+0000","last_peered":"2024-08-17T02:26:32.189462+0000","last_clean":"2024-08-17T02:26:32.189462+0000","last_became_active":"2024-08-17T02:26:31.189669+0000","last_became_peered":"2024-08-17T02:26:31.189669+0000","last_unstale":"2024-08-17T02:26:32.189462+0000","last_undegraded":"2024-08-17T02:26:32.189462+0000","last_fullsized":"2024-08-17T02:26:32.189462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:13:53.155805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.201194+0000","last_change":"2024-08-17T02:26:32.195428+0000","last_active":"2024-08-17T02:26:32.201194+0000","last_peered":"2024-08-17T02:26:32.201194+0000","last_clean":"2024-08-17T02:26:32.201194+0000","last_became_active":"2024-08-17T02:26:32.195121+0000","last_became_peered":"2024-08-17T02:26:32.195121+0000","last_unstale":"2024-08-17T02:26:32.201194+0000","last_undegraded":"2024-08-17T02:26:32.201194+0000","last_fullsized":"2024-08-17T02:26:32.201194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:32.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210311+0000","last_change":"2024-08-17T02:26:31.196698+0000","last_active":"2024-08-17T02:26:32.210311+0000","last_peered":"2024-08-17T02:26:32.210311+0000","last_clean":"2024-08-17T02:26:32.210311+0000","last_became_active":"2024-08-17T02:26:31.195740+0000","last_became_peered":"2024-08-17T02:26:31.195740+0000","last_unstale":"2024-08-17T02:26:32.210311+0000","last_undegraded":"2024-08-17T02:26:32.210311+0000","last_fullsized":"2024-08-17T02:26:32.210311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:29.752289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223829+0000","last_change":"2024-08-17T02:26:32.214042+0000","last_active":"2024-08-17T02:26:32.223829+0000","last_peered":"2024-08-17T02:26:32.223829+0000","last_clean":"2024-08-17T02:26:32.223829+0000","last_became_active":"2024-08-17T02:26:32.211384+0000","last_became_peered":"2024-08-17T02:26:32.211384+0000","last_unstale":"2024-08-17T02:26:32.223829+0000","last_undegraded":"2024-08-17T02:26:32.223829+0000","last_fullsized":"2024-08-17T02:26:32.223829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:08.860859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.184099+0000","last_change":"2024-08-17T02:26:31.199414+0000","last_active":"2024-08-17T02:26:32.184099+0000","last_peered":"2024-08-17T02:26:32.184099+0000","last_clean":"2024-08-17T02:26:32.184099+0000","last_became_active":"2024-08-17T02:26:31.199123+0000","last_became_peered":"2024-08-17T02:26:31.199123+0000","last_unstale":"2024-08-17T02:26:32.184099+0000","last_undegraded":"2024-08-17T02:26:32.184099+0000","last_fullsized":"2024-08-17T02:26:32.184099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:21.626630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222976+0000","last_change":"2024-08-17T02:26:32.219444+0000","last_active":"2024-08-17T02:26:32.222976+0000","last_peered":"2024-08-17T02:26:32.222976+0000","last_clean":"2024-08-17T02:26:32.222976+0000","last_became_active":"2024-08-17T02:26:32.219214+0000","last_became_peered":"2024-08-17T02:26:32.219214+0000","last_unstale":"2024-08-17T02:26:32.222976+0000","last_undegraded":"2024-08-17T02:26:32.222976+0000","last_fullsized":"2024-08-17T02:26:32.222976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:44.277870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.189655+0000","last_change":"2024-08-17T02:26:31.200700+0000","last_active":"2024-08-17T02:26:32.189655+0000","last_peered":"2024-08-17T02:26:32.189655+0000","last_clean":"2024-08-17T02:26:32.189655+0000","last_became_active":"2024-08-17T02:26:31.200119+0000","last_became_peered":"2024-08-17T02:26:31.200119+0000","last_unstale":"2024-08-17T02:26:32.189655+0000","last_undegraded":"2024-08-17T02:26:32.189655+0000","last_fullsized":"2024-08-17T02:26:32.189655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:21.626630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.205241+0000","last_change":"2024-08-17T02:26:32.204045+0000","last_active":"2024-08-17T02:26:32.205241+0000","last_peered":"2024-08-17T02:26:32.205241+0000","last_clean":"2024-08-17T02:26:32.205241+0000","last_became_active":"2024-08-17T02:26:32.201851+0000","last_became_peered":"2024-08-17T02:26:32.201851+0000","last_unstale":"2024-08-17T02:26:32.205241+0000","last_undegraded":"2024-08-17T02:26:32.205241+0000","last_fullsized":"2024-08-17T02:26:32.205241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:16:50.112486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:33.922747+0000","last_change":"2024-08-17T02:26:31.201702+0000","last_active":"2024-08-17T02:26:33.922747+0000","last_peered":"2024-08-17T02:26:33.922747+0000","last_clean":"2024-08-17T02:26:33.922747+0000","last_became_active":"2024-08-17T02:26:31.201252+0000","last_became_peered":"2024-08-17T02:26:31.201252+0000","last_unstale":"2024-08-17T02:26:33.922747+0000","last_undegraded":"2024-08-17T02:26:33.922747+0000","last_fullsized":"2024-08-17T02:26:33.922747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:34.514420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216794+0000","last_change":"2024-08-17T02:26:32.209105+0000","last_active":"2024-08-17T02:26:32.216794+0000","last_peered":"2024-08-17T02:26:32.216794+0000","last_clean":"2024-08-17T02:26:32.216794+0000","last_became_active":"2024-08-17T02:26:32.208827+0000","last_became_peered":"2024-08-17T02:26:32.208827+0000","last_unstale":"2024-08-17T02:26:32.216794+0000","last_undegraded":"2024-08-17T02:26:32.216794+0000","last_fullsized":"2024-08-17T02:26:32.216794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:12:08.917953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224248+0000","last_change":"2024-08-17T02:26:31.198056+0000","last_active":"2024-08-17T02:26:32.224248+0000","last_peered":"2024-08-17T02:26:32.224248+0000","last_clean":"2024-08-17T02:26:32.224248+0000","last_became_active":"2024-08-17T02:26:31.197375+0000","last_became_peered":"2024-08-17T02:26:31.197375+0000","last_unstale":"2024-08-17T02:26:32.224248+0000","last_undegraded":"2024-08-17T02:26:32.224248+0000","last_fullsized":"2024-08-17T02:26:32.224248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:14.675670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.207777+0000","last_change":"2024-08-17T02:26:32.204547+0000","last_active":"2024-08-17T02:26:32.207777+0000","last_peered":"2024-08-17T02:26:32.207777+0000","last_clean":"2024-08-17T02:26:32.207777+0000","last_became_active":"2024-08-17T02:26:32.204234+0000","last_became_peered":"2024-08-17T02:26:32.204234+0000","last_unstale":"2024-08-17T02:26:32.207777+0000","last_undegraded":"2024-08-17T02:26:32.207777+0000","last_fullsized":"2024-08-17T02:26:32.207777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:22.493908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.185436+0000","last_change":"2024-08-17T02:26:31.199235+0000","last_active":"2024-08-17T02:26:32.185436+0000","last_peered":"2024-08-17T02:26:32.185436+0000","last_clean":"2024-08-17T02:26:32.185436+0000","last_became_active":"2024-08-17T02:26:31.198951+0000","last_became_peered":"2024-08-17T02:26:31.198951+0000","last_unstale":"2024-08-17T02:26:32.185436+0000","last_undegraded":"2024-08-17T02:26:32.185436+0000","last_fullsized":"2024-08-17T02:26:32.185436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:29.752289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.218771+0000","last_change":"2024-08-17T02:26:32.202792+0000","last_active":"2024-08-17T02:26:32.218771+0000","last_peered":"2024-08-17T02:26:32.218771+0000","last_clean":"2024-08-17T02:26:32.218771+0000","last_became_active":"2024-08-17T02:26:32.201978+0000","last_became_peered":"2024-08-17T02:26:32.201978+0000","last_unstale":"2024-08-17T02:26:32.218771+0000","last_undegraded":"2024-08-17T02:26:32.218771+0000","last_fullsized":"2024-08-17T02:26:32.218771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:25.946664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.184248+0000","last_change":"2024-08-17T02:26:31.199305+0000","last_active":"2024-08-17T02:26:32.184248+0000","last_peered":"2024-08-17T02:26:32.184248+0000","last_clean":"2024-08-17T02:26:32.184248+0000","last_became_active":"2024-08-17T02:26:31.199023+0000","last_became_peered":"2024-08-17T02:26:31.199023+0000","last_unstale":"2024-08-17T02:26:32.184248+0000","last_undegraded":"2024-08-17T02:26:32.184248+0000","last_fullsized":"2024-08-17T02:26:32.184248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:36.476579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216869+0000","last_change":"2024-08-17T02:26:32.211397+0000","last_active":"2024-08-17T02:26:32.216869+0000","last_peered":"2024-08-17T02:26:32.216869+0000","last_clean":"2024-08-17T02:26:32.216869+0000","last_became_active":"2024-08-17T02:26:32.211105+0000","last_became_peered":"2024-08-17T02:26:32.211105+0000","last_unstale":"2024-08-17T02:26:32.216869+0000","last_undegraded":"2024-08-17T02:26:32.216869+0000","last_fullsized":"2024-08-17T02:26:32.216869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:49.834790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.183924+0000","last_change":"2024-08-17T02:26:31.194944+0000","last_active":"2024-08-17T02:26:32.183924+0000","last_peered":"2024-08-17T02:26:32.183924+0000","last_clean":"2024-08-17T02:26:32.183924+0000","last_became_active":"2024-08-17T02:26:31.194583+0000","last_became_peered":"2024-08-17T02:26:31.194583+0000","last_unstale":"2024-08-17T02:26:32.183924+0000","last_undegraded":"2024-08-17T02:26:32.183924+0000","last_fullsized":"2024-08-17T02:26:32.183924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:24.940176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.217295+0000","last_change":"2024-08-17T02:26:32.208192+0000","last_active":"2024-08-17T02:26:32.217295+0000","last_peered":"2024-08-17T02:26:32.217295+0000","last_clean":"2024-08-17T02:26:32.217295+0000","last_became_active":"2024-08-17T02:26:32.205401+0000","last_became_peered":"2024-08-17T02:26:32.205401+0000","last_unstale":"2024-08-17T02:26:32.217295+0000","last_undegraded":"2024-08-17T02:26:32.217295+0000","last_fullsized":"2024-08-17T02:26:32.217295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:01:56.405892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.224746+0000","last_change":"2024-08-17T02:26:31.188577+0000","last_active":"2024-08-17T02:26:32.224746+0000","last_peered":"2024-08-17T02:26:32.224746+0000","last_clean":"2024-08-17T02:26:32.224746+0000","last_became_active":"2024-08-17T02:26:31.188261+0000","last_became_peered":"2024-08-17T02:26:31.188261+0000","last_unstale":"2024-08-17T02:26:32.224746+0000","last_undegraded":"2024-08-17T02:26:32.224746+0000","last_fullsized":"2024-08-17T02:26:32.224746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:07.854371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.210736+0000","last_change":"2024-08-17T02:26:32.204687+0000","last_active":"2024-08-17T02:26:32.210736+0000","last_peered":"2024-08-17T02:26:32.210736+0000","last_clean":"2024-08-17T02:26:32.210736+0000","last_became_active":"2024-08-17T02:26:32.203288+0000","last_became_peered":"2024-08-17T02:26:32.203288+0000","last_unstale":"2024-08-17T02:26:32.210736+0000","last_undegraded":"2024-08-17T02:26:32.210736+0000","last_fullsized":"2024-08-17T02:26:32.210736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:19:59.385496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.212562+0000","last_change":"2024-08-17T02:26:32.205101+0000","last_active":"2024-08-17T02:26:32.212562+0000","last_peered":"2024-08-17T02:26:32.212562+0000","last_clean":"2024-08-17T02:26:32.212562+0000","last_became_active":"2024-08-17T02:26:32.204789+0000","last_became_peered":"2024-08-17T02:26:32.204789+0000","last_unstale":"2024-08-17T02:26:32.212562+0000","last_undegraded":"2024-08-17T02:26:32.212562+0000","last_fullsized":"2024-08-17T02:26:32.212562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:53.799652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.226792+0000","last_change":"2024-08-17T02:26:31.192488+0000","last_active":"2024-08-17T02:26:32.226792+0000","last_peered":"2024-08-17T02:26:32.226792+0000","last_clean":"2024-08-17T02:26:32.226792+0000","last_became_active":"2024-08-17T02:26:31.191791+0000","last_became_peered":"2024-08-17T02:26:31.191791+0000","last_unstale":"2024-08-17T02:26:32.226792+0000","last_undegraded":"2024-08-17T02:26:32.226792+0000","last_fullsized":"2024-08-17T02:26:32.226792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:24.940176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222373+0000","last_change":"2024-08-17T02:26:32.214245+0000","last_active":"2024-08-17T02:26:32.222373+0000","last_peered":"2024-08-17T02:26:32.222373+0000","last_clean":"2024-08-17T02:26:32.222373+0000","last_became_active":"2024-08-17T02:26:32.212733+0000","last_became_peered":"2024-08-17T02:26:32.212733+0000","last_unstale":"2024-08-17T02:26:32.222373+0000","last_undegraded":"2024-08-17T02:26:32.222373+0000","last_fullsized":"2024-08-17T02:26:32.222373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:22.493908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.225876+0000","last_change":"2024-08-17T02:26:31.201149+0000","last_active":"2024-08-17T02:26:32.225876+0000","last_peered":"2024-08-17T02:26:32.225876+0000","last_clean":"2024-08-17T02:26:32.225876+0000","last_became_active":"2024-08-17T02:26:31.200976+0000","last_became_peered":"2024-08-17T02:26:31.200976+0000","last_unstale":"2024-08-17T02:26:32.225876+0000","last_undegraded":"2024-08-17T02:26:32.225876+0000","last_fullsized":"2024-08-17T02:26:32.225876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:34.514420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.222755+0000","last_change":"2024-08-17T02:26:32.213833+0000","last_active":"2024-08-17T02:26:32.222755+0000","last_peered":"2024-08-17T02:26:32.222755+0000","last_clean":"2024-08-17T02:26:32.222755+0000","last_became_active":"2024-08-17T02:26:32.213562+0000","last_became_peered":"2024-08-17T02:26:32.213562+0000","last_unstale":"2024-08-17T02:26:32.222755+0000","last_undegraded":"2024-08-17T02:26:32.222755+0000","last_fullsized":"2024-08-17T02:26:32.222755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:36.468882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.223551+0000","last_change":"2024-08-17T02:26:31.198494+0000","last_active":"2024-08-17T02:26:32.223551+0000","last_peered":"2024-08-17T02:26:32.223551+0000","last_clean":"2024-08-17T02:26:32.223551+0000","last_became_active":"2024-08-17T02:26:31.198155+0000","last_became_peered":"2024-08-17T02:26:31.198155+0000","last_unstale":"2024-08-17T02:26:32.223551+0000","last_undegraded":"2024-08-17T02:26:32.223551+0000","last_fullsized":"2024-08-17T02:26:32.223551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:53:03.434511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.216630+0000","last_change":"2024-08-17T02:26:32.206009+0000","last_active":"2024-08-17T02:26:32.216630+0000","last_peered":"2024-08-17T02:26:32.216630+0000","last_clean":"2024-08-17T02:26:32.216630+0000","last_became_active":"2024-08-17T02:26:32.205332+0000","last_became_peered":"2024-08-17T02:26:32.205332+0000","last_unstale":"2024-08-17T02:26:32.216630+0000","last_undegraded":"2024-08-17T02:26:32.216630+0000","last_fullsized":"2024-08-17T02:26:32.216630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:31.166465+0000","last_clean_scrub_stamp":"2024-08-17T02:26:31.166465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:25.408345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:32.226730+0000","last_change":"2024-08-17T02:26:31.198180+0000","last_active":"2024-08-17T02:26:32.226730+0000","last_peered":"2024-08-17T02:26:32.226730+0000","last_clean":"2024-08-17T02:26:32.226730+0000","last_became_active":"2024-08-17T02:26:31.197718+0000","last_became_peered":"2024-08-17T02:26:31.197718+0000","last_unstale":"2024-08-17T02:26:32.226730+0000","last_undegraded":"2024-08-17T02:26:32.226730+0000","last_fullsized":"2024-08-17T02:26:32.226730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:30.159977+0000","last_clean_scrub_stamp":"2024-08-17T02:26:30.159977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:24:55.382440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3130000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.871}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0030000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3119999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7040000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7429999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.944}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:41.841 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:26:41.841 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:26:41.842 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:26:41.842 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:26:42.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.025+0000 7f7105200640 1 Processor -- start 2024-08-17T02:26:42.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.025+0000 7f7105200640 1 -- start start 2024-08-17T02:26:42.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.026+0000 7f7105200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7100158c60 0x7f71000b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.026+0000 7f7105200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7100159030 0x7f71000b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.026+0000 7f7105200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71000b2ae0 con 0x7f71000cbd40 2024-08-17T02:26:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.026+0000 7f7105200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71000b2dc0 con 0x7f7100159030 2024-08-17T02:26:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.026+0000 7f7105200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71000b25f0 con 0x7f7100158c60 2024-08-17T02:26:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.026+0000 7f70fd400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7100159030 0x7f71000b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.027+0000 7f70fd400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7100159030 0x7f71000b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57250/0 (socket says 172.21.15.6:57250) 2024-08-17T02:26:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.027+0000 7f70fd400640 1 -- 172.21.15.6:0/1226225475 learned_addr learned my addr 172.21.15.6:0/1226225475 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.027+0000 7f70fde00640 1 --2- 172.21.15.6:0/1226225475 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7100158c60 0x7f71000b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.027+0000 7f70fd400640 1 -- 172.21.15.6:0/1226225475 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7100158c60 msgr2=0x7f71000b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.027+0000 7f70fd400640 1 --2- 172.21.15.6:0/1226225475 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7100158c60 0x7f71000b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.027+0000 7f70fd400640 1 -- 172.21.15.6:0/1226225475 >> v1:172.21.15.136:6789/0 conn(0x7f71000cbd40 legacy=0x7f71000cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.027+0000 7f70fd400640 1 -- 172.21.15.6:0/1226225475 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71000cca80 con 0x7f7100159030 2024-08-17T02:26:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.027+0000 7f70fde00640 1 --2- 172.21.15.6:0/1226225475 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7100158c60 0x7f71000b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:42.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.028+0000 7f70fd400640 1 --2- 172.21.15.6:0/1226225475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7100159030 0x7f71000b20b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009910 tx=0x7f70ec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4db63010b23fc1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.028+0000 7f70fca00640 1 -- 172.21.15.6:0/1226225475 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec02add0 con 0x7f7100159030 2024-08-17T02:26:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.028+0000 7f70fca00640 1 -- 172.21.15.6:0/1226225475 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec032440 con 0x7f7100159030 2024-08-17T02:26:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.028+0000 7f70fca00640 1 -- 172.21.15.6:0/1226225475 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec032820 con 0x7f7100159030 2024-08-17T02:26:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.029+0000 7f7105200640 1 -- 172.21.15.6:0/1226225475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7100159030 msgr2=0x7f71000b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.029+0000 7f7105200640 1 --2- 172.21.15.6:0/1226225475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7100159030 0x7f71000b20b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009910 tx=0x7f70ec0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.029+0000 7f7105200640 1 -- 172.21.15.6:0/1226225475 shutdown_connections 2024-08-17T02:26:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.029+0000 7f7105200640 1 --2- 172.21.15.6:0/1226225475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7100159030 0x7f71000b20b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.029+0000 7f7105200640 1 --2- 172.21.15.6:0/1226225475 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7100158c60 0x7f71000b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.029+0000 7f7105200640 1 -- 172.21.15.6:0/1226225475 >> 172.21.15.6:0/1226225475 conn(0x7f710006e590 msgr2=0x7f710006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.029+0000 7f7105200640 1 -- 172.21.15.6:0/1226225475 shutdown_connections 2024-08-17T02:26:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.029+0000 7f7105200640 1 -- 172.21.15.6:0/1226225475 wait complete. 2024-08-17T02:26:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.030+0000 7f7105200640 1 Processor -- start 2024-08-17T02:26:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.030+0000 7f7105200640 1 -- start start 2024-08-17T02:26:42.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.031+0000 7f7105200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71000cbd40 0x7f71001519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.031+0000 7f7105200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7100158c60 0x7f71000c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.031+0000 7f7105200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7100159030 0x7f71001522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.031+0000 7f7105200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7100152d70 con 0x7f7100159030 2024-08-17T02:26:42.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.031+0000 7f7105200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710016c4d0 con 0x7f7100158c60 2024-08-17T02:26:42.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.031+0000 7f7105200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71000c84a0 con 0x7f71000cbd40 2024-08-17T02:26:42.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.032+0000 7f70fe800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7100159030 0x7f71001522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.032+0000 7f70fe800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7100159030 0x7f71001522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57262/0 (socket says 172.21.15.6:57262) 2024-08-17T02:26:42.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.032+0000 7f70fe800640 1 -- 172.21.15.6:0/2884298292 learned_addr learned my addr 172.21.15.6:0/2884298292 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:42.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.032+0000 7f70fde00640 1 --2- 172.21.15.6:0/2884298292 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71000cbd40 0x7f71001519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.032+0000 7f70fd400640 1 --2- 172.21.15.6:0/2884298292 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7100158c60 0x7f71000c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.032+0000 7f70fe800640 1 -- 172.21.15.6:0/2884298292 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71000cbd40 msgr2=0x7f71001519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.032+0000 7f70fe800640 1 --2- 172.21.15.6:0/2884298292 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71000cbd40 0x7f71001519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.032+0000 7f70fe800640 1 -- 172.21.15.6:0/2884298292 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7100158c60 msgr2=0x7f71000c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.032+0000 7f70fe800640 1 --2- 172.21.15.6:0/2884298292 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7100158c60 0x7f71000c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.032+0000 7f70fe800640 1 -- 172.21.15.6:0/2884298292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec009450 con 0x7f7100159030 2024-08-17T02:26:42.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.032+0000 7f70fde00640 1 --2- 172.21.15.6:0/2884298292 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71000cbd40 0x7f71001519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.032+0000 7f70fd400640 1 --2- 172.21.15.6:0/2884298292 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7100158c60 0x7f71000c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.032+0000 7f70fe800640 1 --2- 172.21.15.6:0/2884298292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7100159030 0x7f71001522b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f70f800c7c0 tx=0x7f70f80015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.033+0000 7f70f5600640 1 -- 172.21.15.6:0/2884298292 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f800a640 con 0x7f7100159030 2024-08-17T02:26:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.033+0000 7f70f5600640 1 -- 172.21.15.6:0/2884298292 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f800a7c0 con 0x7f7100159030 2024-08-17T02:26:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.033+0000 7f70f5600640 1 -- 172.21.15.6:0/2884298292 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f800ab80 con 0x7f7100159030 2024-08-17T02:26:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.033+0000 7f7105200640 1 -- 172.21.15.6:0/2884298292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7100152f80 con 0x7f7100159030 2024-08-17T02:26:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.033+0000 7f7105200640 1 -- 172.21.15.6:0/2884298292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7100153820 con 0x7f7100159030 2024-08-17T02:26:42.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.034+0000 7f7105200640 1 -- 172.21.15.6:0/2884298292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710016c680 con 0x7f7100159030 2024-08-17T02:26:42.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.034+0000 7f70f5600640 1 -- 172.21.15.6:0/2884298292 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f70f8003030 con 0x7f7100159030 2024-08-17T02:26:42.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.036+0000 7f70f5600640 1 --2- 172.21.15.6:0/2884298292 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f70e0065150 0x7f70e0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.036+0000 7f70f5600640 1 -- 172.21.15.6:0/2884298292 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f70f8082440 con 0x7f7100159030 2024-08-17T02:26:42.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.036+0000 7f70fde00640 1 --2- 172.21.15.6:0/2884298292 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f70e0065150 0x7f70e0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.037+0000 7f70fde00640 1 --2- 172.21.15.6:0/2884298292 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f70e0065150 0x7f70e0067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f70f000bc20 tx=0x7f70f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.040+0000 7f70f5600640 1 -- 172.21.15.6:0/2884298292 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f710016c680 con 0x7f7100159030 2024-08-17T02:26:42.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.260+0000 7f7105200640 1 -- 172.21.15.6:0/2884298292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f710016c680 con 0x7f7100159030 2024-08-17T02:26:42.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.260+0000 7f70f5600640 1 -- 172.21.15.6:0/2884298292 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f710016c680 con 0x7f7100159030 2024-08-17T02:26:42.261 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:42.261 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:26:42.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.262+0000 7f7105200640 1 -- 172.21.15.6:0/2884298292 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f70e0065150 msgr2=0x7f70e0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.262+0000 7f7105200640 1 --2- 172.21.15.6:0/2884298292 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f70e0065150 0x7f70e0067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f70f000bc20 tx=0x7f70f0008040 comp rx=0 tx=0).stop 2024-08-17T02:26:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.262+0000 7f7105200640 1 -- 172.21.15.6:0/2884298292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7100159030 msgr2=0x7f71001522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.262+0000 7f7105200640 1 --2- 172.21.15.6:0/2884298292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7100159030 0x7f71001522b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f70f800c7c0 tx=0x7f70f80015f0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.263+0000 7f7105200640 1 -- 172.21.15.6:0/2884298292 shutdown_connections 2024-08-17T02:26:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.263+0000 7f7105200640 1 --2- 172.21.15.6:0/2884298292 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f70e0065150 0x7f70e0067600 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.263+0000 7f7105200640 1 --2- 172.21.15.6:0/2884298292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7100159030 0x7f71001522b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.263+0000 7f7105200640 1 --2- 172.21.15.6:0/2884298292 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7100158c60 0x7f71000c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.263+0000 7f7105200640 1 --2- 172.21.15.6:0/2884298292 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71000cbd40 0x7f71001519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.263+0000 7f7105200640 1 -- 172.21.15.6:0/2884298292 >> 172.21.15.6:0/2884298292 conn(0x7f710006e590 msgr2=0x7f7100159500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.263+0000 7f7105200640 1 -- 172.21.15.6:0/2884298292 shutdown_connections 2024-08-17T02:26:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.263+0000 7f7105200640 1 -- 172.21.15.6:0/2884298292 wait complete. 2024-08-17T02:26:42.279 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:26:42.279 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:42.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.429+0000 7f21cee00640 1 Processor -- start 2024-08-17T02:26:42.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.429+0000 7f21cee00640 1 -- start start 2024-08-17T02:26:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.430+0000 7f21cee00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f21c80ad960 0x7f21c815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.430+0000 7f21cee00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f21c80ca050 0x7f21c8156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.430+0000 7f21cee00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c815b5e0 con 0x7f21c80add30 2024-08-17T02:26:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.430+0000 7f21cee00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c80cb160 con 0x7f21c80ca050 2024-08-17T02:26:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.430+0000 7f21cee00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c80b0d10 con 0x7f21c80ad960 2024-08-17T02:26:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.430+0000 7f21c7400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f21c80ca050 0x7f21c8156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.431+0000 7f21c7400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f21c80ca050 0x7f21c8156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57274/0 (socket says 172.21.15.6:57274) 2024-08-17T02:26:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.431+0000 7f21c7400640 1 -- 172.21.15.6:0/2544051178 learned_addr learned my addr 172.21.15.6:0/2544051178 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.431+0000 7f21c7e00640 1 --2- 172.21.15.6:0/2544051178 >> v2:172.21.15.136:3300/0 conn(0x7f21c80ad960 0x7f21c815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.431+0000 7f21c7400640 1 -- 172.21.15.6:0/2544051178 >> v2:172.21.15.136:3300/0 conn(0x7f21c80ad960 msgr2=0x7f21c815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.431+0000 7f21c7400640 1 --2- 172.21.15.6:0/2544051178 >> v2:172.21.15.136:3300/0 conn(0x7f21c80ad960 0x7f21c815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.431+0000 7f21c7400640 1 -- 172.21.15.6:0/2544051178 >> v1:172.21.15.136:6789/0 conn(0x7f21c80add30 legacy=0x7f21c8156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.431+0000 7f21c7400640 1 -- 172.21.15.6:0/2544051178 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c80ca550 con 0x7f21c80ca050 2024-08-17T02:26:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.432+0000 7f21c7400640 1 --2- 172.21.15.6:0/2544051178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21c80ca050 0x7f21c8156420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f21c80cc910 tx=0x7f21b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2980ca80e6db3a29 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.432+0000 7f21c6a00640 1 -- 172.21.15.6:0/2544051178 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b4032440 con 0x7f21c80ca050 2024-08-17T02:26:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.432+0000 7f21c6a00640 1 -- 172.21.15.6:0/2544051178 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b40325a0 con 0x7f21c80ca050 2024-08-17T02:26:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.432+0000 7f21c6a00640 1 -- 172.21.15.6:0/2544051178 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b4032980 con 0x7f21c80ca050 2024-08-17T02:26:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.433+0000 7f21cee00640 1 -- 172.21.15.6:0/2544051178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21c80ca050 msgr2=0x7f21c8156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.433+0000 7f21cee00640 1 --2- 172.21.15.6:0/2544051178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21c80ca050 0x7f21c8156420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f21c80cc910 tx=0x7f21b40091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.433+0000 7f21cee00640 1 -- 172.21.15.6:0/2544051178 shutdown_connections 2024-08-17T02:26:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.433+0000 7f21cee00640 1 --2- 172.21.15.6:0/2544051178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21c80ca050 0x7f21c8156420 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.433+0000 7f21cee00640 1 --2- 172.21.15.6:0/2544051178 >> v2:172.21.15.136:3300/0 conn(0x7f21c80ad960 0x7f21c815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.433+0000 7f21cee00640 1 -- 172.21.15.6:0/2544051178 >> 172.21.15.6:0/2544051178 conn(0x7f21c8066e60 msgr2=0x7f21c8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.433+0000 7f21cee00640 1 -- 172.21.15.6:0/2544051178 shutdown_connections 2024-08-17T02:26:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.433+0000 7f21cee00640 1 -- 172.21.15.6:0/2544051178 wait complete. 2024-08-17T02:26:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.434+0000 7f21cee00640 1 Processor -- start 2024-08-17T02:26:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.435+0000 7f21cee00640 1 -- start start 2024-08-17T02:26:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.435+0000 7f21cee00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21c80ad960 0x7f21c8148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.435+0000 7f21cee00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21c80add30 0x7f21c80a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.435+0000 7f21cee00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c80ca050 0x7f21c8158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.435+0000 7f21cee00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c8148c80 con 0x7f21c80ad960 2024-08-17T02:26:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.435+0000 7f21cee00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c80aa400 con 0x7f21c80ca050 2024-08-17T02:26:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.435+0000 7f21cee00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c80a9360 con 0x7f21c80add30 2024-08-17T02:26:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.436+0000 7f21c7e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21c80ad960 0x7f21c8148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.436+0000 7f21c7e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21c80ad960 0x7f21c8148740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57280/0 (socket says 172.21.15.6:57280) 2024-08-17T02:26:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.436+0000 7f21c7e00640 1 -- 172.21.15.6:0/1024973780 learned_addr learned my addr 172.21.15.6:0/1024973780 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.436+0000 7f21c7400640 1 --2- 172.21.15.6:0/1024973780 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21c80add30 0x7f21c80a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.436+0000 7f21cce00640 1 --2- 172.21.15.6:0/1024973780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c80ca050 0x7f21c8158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.436+0000 7f21c7e00640 1 -- 172.21.15.6:0/1024973780 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21c80add30 msgr2=0x7f21c80a88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.436+0000 7f21c7e00640 1 --2- 172.21.15.6:0/1024973780 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21c80add30 0x7f21c80a88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.436+0000 7f21c7e00640 1 -- 172.21.15.6:0/1024973780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c80ca050 msgr2=0x7f21c8158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.436+0000 7f21c7e00640 1 --2- 172.21.15.6:0/1024973780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c80ca050 0x7f21c8158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.436+0000 7f21c7e00640 1 -- 172.21.15.6:0/1024973780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b4009450 con 0x7f21c80ad960 2024-08-17T02:26:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.436+0000 7f21c7e00640 1 --2- 172.21.15.6:0/1024973780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21c80ad960 0x7f21c8148740 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f21b800d890 tx=0x7f21b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.437+0000 7f21bf400640 1 -- 172.21.15.6:0/1024973780 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800de20 con 0x7f21c80ad960 2024-08-17T02:26:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.437+0000 7f21bf400640 1 -- 172.21.15.6:0/1024973780 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b80098b0 con 0x7f21c80ad960 2024-08-17T02:26:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.437+0000 7f21bf400640 1 -- 172.21.15.6:0/1024973780 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8009c50 con 0x7f21c80ad960 2024-08-17T02:26:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.437+0000 7f21cee00640 1 -- 172.21.15.6:0/1024973780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c80a9640 con 0x7f21c80ad960 2024-08-17T02:26:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.437+0000 7f21cee00640 1 -- 172.21.15.6:0/1024973780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c80a9c00 con 0x7f21c80ad960 2024-08-17T02:26:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.438+0000 7f21cee00640 1 -- 172.21.15.6:0/1024973780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c8063fb0 con 0x7f21c80ad960 2024-08-17T02:26:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.439+0000 7f21bf400640 1 -- 172.21.15.6:0/1024973780 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f21b8014620 con 0x7f21c80ad960 2024-08-17T02:26:42.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.439+0000 7f21bf400640 1 --2- 172.21.15.6:0/1024973780 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f21a8065180 0x7f21a8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.439+0000 7f21bf400640 1 -- 172.21.15.6:0/1024973780 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21b8082b70 con 0x7f21c80ad960 2024-08-17T02:26:42.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.440+0000 7f21c7400640 1 --2- 172.21.15.6:0/1024973780 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f21a8065180 0x7f21a8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.440+0000 7f21c7400640 1 --2- 172.21.15.6:0/1024973780 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f21a8065180 0x7f21a8067630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f21b4034000 tx=0x7f21b4032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.443+0000 7f21bf400640 1 -- 172.21.15.6:0/1024973780 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f21b8050c40 con 0x7f21c80ad960 2024-08-17T02:26:42.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.624+0000 7f21cee00640 1 -- 172.21.15.6:0/1024973780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21c806ba30 con 0x7f21c80ad960 2024-08-17T02:26:42.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.625+0000 7f21bf400640 1 -- 172.21.15.6:0/1024973780 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f21b8054260 con 0x7f21c80ad960 2024-08-17T02:26:42.626 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:42.626 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:33.190571+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:29.257601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:30.596556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.627+0000 7f21cee00640 1 -- 172.21.15.6:0/1024973780 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f21a8065180 msgr2=0x7f21a8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.627+0000 7f21cee00640 1 --2- 172.21.15.6:0/1024973780 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f21a8065180 0x7f21a8067630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f21b4034000 tx=0x7f21b4032000 comp rx=0 tx=0).stop 2024-08-17T02:26:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.627+0000 7f21cee00640 1 -- 172.21.15.6:0/1024973780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21c80ad960 msgr2=0x7f21c8148740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.627+0000 7f21cee00640 1 --2- 172.21.15.6:0/1024973780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21c80ad960 0x7f21c8148740 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f21b800d890 tx=0x7f21b8008040 comp rx=0 tx=0).stop 2024-08-17T02:26:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.627+0000 7f21cee00640 1 -- 172.21.15.6:0/1024973780 shutdown_connections 2024-08-17T02:26:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.627+0000 7f21cee00640 1 --2- 172.21.15.6:0/1024973780 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f21a8065180 0x7f21a8067630 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.627+0000 7f21cee00640 1 --2- 172.21.15.6:0/1024973780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c80ca050 0x7f21c8158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.627+0000 7f21cee00640 1 --2- 172.21.15.6:0/1024973780 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21c80add30 0x7f21c80a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.627+0000 7f21cee00640 1 --2- 172.21.15.6:0/1024973780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21c80ad960 0x7f21c8148740 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.627+0000 7f21cee00640 1 -- 172.21.15.6:0/1024973780 >> 172.21.15.6:0/1024973780 conn(0x7f21c8066e60 msgr2=0x7f21c81532c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.627+0000 7f21cee00640 1 -- 172.21.15.6:0/1024973780 shutdown_connections 2024-08-17T02:26:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.627+0000 7f21cee00640 1 -- 172.21.15.6:0/1024973780 wait complete. 2024-08-17T02:26:42.642 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:25.463503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:29.257601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:30.596556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:42.643 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.795+0000 7f1939c00640 1 Processor -- start 2024-08-17T02:26:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.795+0000 7f1939c00640 1 -- start start 2024-08-17T02:26:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.796+0000 7f1939c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1934156bd0 0x7f19340b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.796+0000 7f1939c00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f19340adf90 0x7f19340b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.796+0000 7f1939c00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340ac040 con 0x7f1934156fa0 2024-08-17T02:26:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.796+0000 7f1939c00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1934067810 con 0x7f19340adf90 2024-08-17T02:26:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.796+0000 7f1939c00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19340ab150 con 0x7f1934156bd0 2024-08-17T02:26:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.796+0000 7f1932000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f19340adf90 0x7f19340b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.796+0000 7f1933400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1934156fa0 0x7f19340ac4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38426/0 (socket says 172.21.15.6:38426) 2024-08-17T02:26:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.796+0000 7f1933400640 1 -- 172.21.15.6:0/1691333001 learned_addr learned my addr 172.21.15.6:0/1691333001 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.797+0000 7f1932a00640 1 --2- 172.21.15.6:0/1691333001 >> v2:172.21.15.136:3300/0 conn(0x7f1934156bd0 0x7f19340b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.797+0000 7f1932000640 1 -- 172.21.15.6:0/1691333001 >> v2:172.21.15.136:3300/0 conn(0x7f1934156bd0 msgr2=0x7f19340b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.797+0000 7f1932000640 1 --2- 172.21.15.6:0/1691333001 >> v2:172.21.15.136:3300/0 conn(0x7f1934156bd0 0x7f19340b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.797+0000 7f1932000640 1 -- 172.21.15.6:0/1691333001 >> v1:172.21.15.6:6789/0 conn(0x7f1934156fa0 legacy=0x7f19340ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.797+0000 7f1932000640 1 -- 172.21.15.6:0/1691333001 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19340ab430 con 0x7f19340adf90 2024-08-17T02:26:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.797+0000 7f1932a00640 1 --2- 172.21.15.6:0/1691333001 >> v2:172.21.15.136:3300/0 conn(0x7f1934156bd0 0x7f19340b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:42.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.798+0000 7f1932000640 1 --2- 172.21.15.6:0/1691333001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19340adf90 0x7f19340b10b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1920009850 tx=0x7f19200090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9735276fe8c7cff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.798+0000 7f1931600640 1 -- 172.21.15.6:0/1691333001 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192002ad90 con 0x7f19340adf90 2024-08-17T02:26:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.798+0000 7f1931600640 1 -- 172.21.15.6:0/1691333001 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1920032440 con 0x7f19340adf90 2024-08-17T02:26:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.798+0000 7f1931600640 1 -- 172.21.15.6:0/1691333001 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920032820 con 0x7f19340adf90 2024-08-17T02:26:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.799+0000 7f1939c00640 1 -- 172.21.15.6:0/1691333001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19340adf90 msgr2=0x7f19340b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.799+0000 7f1939c00640 1 --2- 172.21.15.6:0/1691333001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19340adf90 0x7f19340b10b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1920009850 tx=0x7f19200090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.799+0000 7f1939c00640 1 -- 172.21.15.6:0/1691333001 shutdown_connections 2024-08-17T02:26:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.799+0000 7f1939c00640 1 --2- 172.21.15.6:0/1691333001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19340adf90 0x7f19340b10b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.799+0000 7f1939c00640 1 --2- 172.21.15.6:0/1691333001 >> v2:172.21.15.136:3300/0 conn(0x7f1934156bd0 0x7f19340b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.799+0000 7f1939c00640 1 -- 172.21.15.6:0/1691333001 >> 172.21.15.6:0/1691333001 conn(0x7f19340cc390 msgr2=0x7f1934066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.799+0000 7f1939c00640 1 -- 172.21.15.6:0/1691333001 shutdown_connections 2024-08-17T02:26:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.799+0000 7f1939c00640 1 -- 172.21.15.6:0/1691333001 wait complete. 2024-08-17T02:26:42.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.800+0000 7f1939c00640 1 Processor -- start 2024-08-17T02:26:42.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.800+0000 7f1939c00640 1 -- start start 2024-08-17T02:26:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.801+0000 7f1939c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19340adf90 0x7f193413bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.801+0000 7f1939c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1934156bd0 0x7f193415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.801+0000 7f1939c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1934156fa0 0x7f1934169f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.801+0000 7f1939c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193415cc40 con 0x7f19340adf90 2024-08-17T02:26:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.801+0000 7f1939c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19341586f0 con 0x7f1934156fa0 2024-08-17T02:26:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.801+0000 7f1939c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193415bba0 con 0x7f1934156bd0 2024-08-17T02:26:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.801+0000 7f1932a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19340adf90 0x7f193413bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.801+0000 7f1932a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19340adf90 0x7f193413bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57298/0 (socket says 172.21.15.6:57298) 2024-08-17T02:26:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.801+0000 7f1932a00640 1 -- 172.21.15.6:0/4016782695 learned_addr learned my addr 172.21.15.6:0/4016782695 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.801+0000 7f1933400640 1 --2- 172.21.15.6:0/4016782695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1934156fa0 0x7f1934169f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.802+0000 7f1932000640 1 --2- 172.21.15.6:0/4016782695 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1934156bd0 0x7f193415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.802+0000 7f1932a00640 1 -- 172.21.15.6:0/4016782695 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1934156bd0 msgr2=0x7f193415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.802+0000 7f1932a00640 1 --2- 172.21.15.6:0/4016782695 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1934156bd0 0x7f193415b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.802+0000 7f1932a00640 1 -- 172.21.15.6:0/4016782695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1934156fa0 msgr2=0x7f1934169f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.802+0000 7f1932a00640 1 --2- 172.21.15.6:0/4016782695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1934156fa0 0x7f1934169f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.802+0000 7f1932a00640 1 -- 172.21.15.6:0/4016782695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1920009390 con 0x7f19340adf90 2024-08-17T02:26:42.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.802+0000 7f1932a00640 1 --2- 172.21.15.6:0/4016782695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19340adf90 0x7f193413bf60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f192400d890 tx=0x7f1924008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.802+0000 7f192a000640 1 -- 172.21.15.6:0/4016782695 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192400de80 con 0x7f19340adf90 2024-08-17T02:26:42.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.802+0000 7f192a000640 1 -- 172.21.15.6:0/4016782695 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192400b8d0 con 0x7f19340adf90 2024-08-17T02:26:42.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.802+0000 7f192a000640 1 -- 172.21.15.6:0/4016782695 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192400bc90 con 0x7f19340adf90 2024-08-17T02:26:42.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.802+0000 7f1939c00640 1 -- 172.21.15.6:0/4016782695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193415be80 con 0x7f19340adf90 2024-08-17T02:26:42.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.803+0000 7f1939c00640 1 -- 172.21.15.6:0/4016782695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193415c440 con 0x7f19340adf90 2024-08-17T02:26:42.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.804+0000 7f1939c00640 1 -- 172.21.15.6:0/4016782695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1934063fb0 con 0x7f19340adf90 2024-08-17T02:26:42.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.804+0000 7f192a000640 1 -- 172.21.15.6:0/4016782695 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f192401e460 con 0x7f19340adf90 2024-08-17T02:26:42.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.805+0000 7f192a000640 1 --2- 172.21.15.6:0/4016782695 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1914065150 0x7f1914067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.805+0000 7f192a000640 1 -- 172.21.15.6:0/4016782695 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1924082a50 con 0x7f19340adf90 2024-08-17T02:26:42.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.806+0000 7f1932000640 1 --2- 172.21.15.6:0/4016782695 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1914065150 0x7f1914067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.806+0000 7f1932000640 1 --2- 172.21.15.6:0/4016782695 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1914065150 0x7f1914067600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1920034000 tx=0x7f1920032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.809+0000 7f192a000640 1 -- 172.21.15.6:0/4016782695 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1924050b20 con 0x7f19340adf90 2024-08-17T02:26:42.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.990+0000 7f1939c00640 1 -- 172.21.15.6:0/4016782695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19340b1110 con 0x7f19340adf90 2024-08-17T02:26:42.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.991+0000 7f192a000640 1 -- 172.21.15.6:0/4016782695 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1924054140 con 0x7f19340adf90 2024-08-17T02:26:42.992 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-08-17T02:26:42.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.993+0000 7f1939c00640 1 -- 172.21.15.6:0/4016782695 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1914065150 msgr2=0x7f1914067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.993+0000 7f1939c00640 1 --2- 172.21.15.6:0/4016782695 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1914065150 0x7f1914067600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1920034000 tx=0x7f1920032000 comp rx=0 tx=0).stop 2024-08-17T02:26:42.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.993+0000 7f1939c00640 1 -- 172.21.15.6:0/4016782695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19340adf90 msgr2=0x7f193413bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.993+0000 7f1939c00640 1 --2- 172.21.15.6:0/4016782695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19340adf90 0x7f193413bf60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f192400d890 tx=0x7f1924008040 comp rx=0 tx=0).stop 2024-08-17T02:26:42.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.993+0000 7f1939c00640 1 -- 172.21.15.6:0/4016782695 shutdown_connections 2024-08-17T02:26:42.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.993+0000 7f1939c00640 1 --2- 172.21.15.6:0/4016782695 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1914065150 0x7f1914067600 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.993+0000 7f1939c00640 1 --2- 172.21.15.6:0/4016782695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1934156fa0 0x7f1934169f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.993+0000 7f1939c00640 1 --2- 172.21.15.6:0/4016782695 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1934156bd0 0x7f193415b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.993+0000 7f1939c00640 1 --2- 172.21.15.6:0/4016782695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19340adf90 0x7f193413bf60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.993+0000 7f1939c00640 1 -- 172.21.15.6:0/4016782695 >> 172.21.15.6:0/4016782695 conn(0x7f19340cc390 msgr2=0x7f19340ac390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.993+0000 7f1939c00640 1 -- 172.21.15.6:0/4016782695 shutdown_connections 2024-08-17T02:26:42.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:42.993+0000 7f1939c00640 1 -- 172.21.15.6:0/4016782695 wait complete. 2024-08-17T02:26:43.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:43.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.161+0000 7f4634200640 1 Processor -- start 2024-08-17T02:26:43.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.161+0000 7f4634200640 1 -- start start 2024-08-17T02:26:43.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.162+0000 7f4634200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f462c06e060 0x7f462c06e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.162+0000 7f4634200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f462c0af340 0x7f462c0af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.162+0000 7f4634200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462c0aeeb0 con 0x7f462c155040 2024-08-17T02:26:43.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.162+0000 7f4634200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462c06e9f0 con 0x7f462c0af340 2024-08-17T02:26:43.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.162+0000 7f4634200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0aadd0 con 0x7f462c06e060 2024-08-17T02:26:43.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.163+0000 7f4632200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f462c0af340 0x7f462c0af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.163+0000 7f4631800640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f462c155040 0x7f462c158c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:56712/0 (socket says 172.21.15.6:56712) 2024-08-17T02:26:43.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.163+0000 7f4631800640 1 -- 172.21.15.6:0/3960290190 learned_addr learned my addr 172.21.15.6:0/3960290190 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:43.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.163+0000 7f4630e00640 1 --2- 172.21.15.6:0/3960290190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f462c06e060 0x7f462c06e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.163+0000 7f4632200640 1 -- 172.21.15.6:0/3960290190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f462c06e060 msgr2=0x7f462c06e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:43.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.163+0000 7f4632200640 1 --2- 172.21.15.6:0/3960290190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f462c06e060 0x7f462c06e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.163+0000 7f4632200640 1 -- 172.21.15.6:0/3960290190 >> v1:172.21.15.136:6789/0 conn(0x7f462c155040 legacy=0x7f462c158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.163+0000 7f462be00640 1 -- 172.21.15.6:0/3960290190 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393090504 0 0) 0x7f462c0aeeb0 con 0x7f462c155040 2024-08-17T02:26:43.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.163+0000 7f4632200640 1 -- 172.21.15.6:0/3960290190 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c1597f0 con 0x7f462c0af340 2024-08-17T02:26:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.164+0000 7f4632200640 1 --2- 172.21.15.6:0/3960290190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c0af340 0x7f462c0af780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4624009e60 tx=0x7f4624009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7b237dd2c21d57 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.164+0000 7f462be00640 1 -- 172.21.15.6:0/3960290190 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4624007550 con 0x7f462c0af340 2024-08-17T02:26:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.164+0000 7f462be00640 1 -- 172.21.15.6:0/3960290190 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462402d050 con 0x7f462c0af340 2024-08-17T02:26:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.164+0000 7f462be00640 1 -- 172.21.15.6:0/3960290190 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46240078e0 con 0x7f462c0af340 2024-08-17T02:26:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.165+0000 7f4634200640 1 -- 172.21.15.6:0/3960290190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c0af340 msgr2=0x7f462c0af780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.165+0000 7f4634200640 1 --2- 172.21.15.6:0/3960290190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c0af340 0x7f462c0af780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4624009e60 tx=0x7f4624009780 comp rx=0 tx=0).stop 2024-08-17T02:26:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.165+0000 7f4634200640 1 -- 172.21.15.6:0/3960290190 shutdown_connections 2024-08-17T02:26:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.165+0000 7f4634200640 1 --2- 172.21.15.6:0/3960290190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c0af340 0x7f462c0af780 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.165+0000 7f4634200640 1 --2- 172.21.15.6:0/3960290190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f462c06e060 0x7f462c06e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.165+0000 7f4634200640 1 -- 172.21.15.6:0/3960290190 >> 172.21.15.6:0/3960290190 conn(0x7f462c066e60 msgr2=0x7f462c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.165+0000 7f4634200640 1 -- 172.21.15.6:0/3960290190 shutdown_connections 2024-08-17T02:26:43.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.165+0000 7f4634200640 1 -- 172.21.15.6:0/3960290190 wait complete. 2024-08-17T02:26:43.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.166+0000 7f4634200640 1 Processor -- start 2024-08-17T02:26:43.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.166+0000 7f4634200640 1 -- start start 2024-08-17T02:26:43.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.167+0000 7f4634200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f462c06e060 0x7f462c0a8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.167+0000 7f4634200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c0af340 0x7f462c0af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.167+0000 7f4634200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f462c155040 0x7f462c0afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.167+0000 7f4634200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0aa0b0 con 0x7f462c0af340 2024-08-17T02:26:43.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.167+0000 7f4634200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c169e50 con 0x7f462c155040 2024-08-17T02:26:43.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.167+0000 7f4634200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c16cca0 con 0x7f462c06e060 2024-08-17T02:26:43.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.168+0000 7f4630e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c0af340 0x7f462c0af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.168+0000 7f4630e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c0af340 0x7f462c0af740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57320/0 (socket says 172.21.15.6:57320) 2024-08-17T02:26:43.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.168+0000 7f4630e00640 1 -- 172.21.15.6:0/1003191466 learned_addr learned my addr 172.21.15.6:0/1003191466 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:43.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.168+0000 7f4631800640 1 --2- 172.21.15.6:0/1003191466 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f462c06e060 0x7f462c0a8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.168+0000 7f4632200640 1 --2- 172.21.15.6:0/1003191466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f462c155040 0x7f462c0afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.168+0000 7f4630e00640 1 -- 172.21.15.6:0/1003191466 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f462c06e060 msgr2=0x7f462c0a8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.168+0000 7f4630e00640 1 --2- 172.21.15.6:0/1003191466 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f462c06e060 0x7f462c0a8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.168+0000 7f4630e00640 1 -- 172.21.15.6:0/1003191466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f462c155040 msgr2=0x7f462c0afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.168+0000 7f4630e00640 1 --2- 172.21.15.6:0/1003191466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f462c155040 0x7f462c0afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.168+0000 7f4630e00640 1 -- 172.21.15.6:0/1003191466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4624009a20 con 0x7f462c0af340 2024-08-17T02:26:43.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.168+0000 7f4630e00640 1 --2- 172.21.15.6:0/1003191466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c0af340 0x7f462c0af740 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f461800ea20 tx=0x7f46180090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.168+0000 7f4628c00640 1 -- 172.21.15.6:0/1003191466 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461800ca10 con 0x7f462c0af340 2024-08-17T02:26:43.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.169+0000 7f4628c00640 1 -- 172.21.15.6:0/1003191466 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461800cb70 con 0x7f462c0af340 2024-08-17T02:26:43.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.169+0000 7f4634200640 1 -- 172.21.15.6:0/1003191466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462c169b70 con 0x7f462c0af340 2024-08-17T02:26:43.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.169+0000 7f4628c00640 1 -- 172.21.15.6:0/1003191466 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4618013470 con 0x7f462c0af340 2024-08-17T02:26:43.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.169+0000 7f4634200640 1 -- 172.21.15.6:0/1003191466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462c16c930 con 0x7f462c0af340 2024-08-17T02:26:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.170+0000 7f4634200640 1 -- 172.21.15.6:0/1003191466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462c068120 con 0x7f462c0af340 2024-08-17T02:26:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.171+0000 7f4628c00640 1 -- 172.21.15.6:0/1003191466 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4618013860 con 0x7f462c0af340 2024-08-17T02:26:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.172+0000 7f4628c00640 1 --2- 172.21.15.6:0/1003191466 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f460c065150 0x7f460c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.172+0000 7f4628c00640 1 -- 172.21.15.6:0/1003191466 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4618082940 con 0x7f462c0af340 2024-08-17T02:26:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.172+0000 7f4631800640 1 --2- 172.21.15.6:0/1003191466 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f460c065150 0x7f460c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.173+0000 7f4631800640 1 --2- 172.21.15.6:0/1003191466 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f460c065150 0x7f460c067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f462000c870 tx=0x7f4620009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.176+0000 7f4628c00640 1 -- 172.21.15.6:0/1003191466 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4618050a20 con 0x7f462c0af340 2024-08-17T02:26:43.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.357+0000 7f4634200640 1 -- 172.21.15.6:0/1003191466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f462c0ac650 con 0x7f462c0af340 2024-08-17T02:26:43.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.357+0000 7f4628c00640 1 -- 172.21.15.6:0/1003191466 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4618054040 con 0x7f462c0af340 2024-08-17T02:26:43.358 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-08-17T02:26:43.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.360+0000 7f4634200640 1 -- 172.21.15.6:0/1003191466 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f460c065150 msgr2=0x7f460c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.360+0000 7f4634200640 1 --2- 172.21.15.6:0/1003191466 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f460c065150 0x7f460c067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f462000c870 tx=0x7f4620009040 comp rx=0 tx=0).stop 2024-08-17T02:26:43.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.360+0000 7f4634200640 1 -- 172.21.15.6:0/1003191466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c0af340 msgr2=0x7f462c0af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.360+0000 7f4634200640 1 --2- 172.21.15.6:0/1003191466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c0af340 0x7f462c0af740 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f461800ea20 tx=0x7f46180090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.360+0000 7f4634200640 1 -- 172.21.15.6:0/1003191466 shutdown_connections 2024-08-17T02:26:43.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.360+0000 7f4634200640 1 --2- 172.21.15.6:0/1003191466 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f460c065150 0x7f460c067600 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.360+0000 7f4634200640 1 --2- 172.21.15.6:0/1003191466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f462c155040 0x7f462c0afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.360+0000 7f4634200640 1 --2- 172.21.15.6:0/1003191466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c0af340 0x7f462c0af740 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.360+0000 7f4634200640 1 --2- 172.21.15.6:0/1003191466 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f462c06e060 0x7f462c0a8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.360+0000 7f4634200640 1 -- 172.21.15.6:0/1003191466 >> 172.21.15.6:0/1003191466 conn(0x7f462c066e60 msgr2=0x7f462c0caa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.360+0000 7f4634200640 1 -- 172.21.15.6:0/1003191466 shutdown_connections 2024-08-17T02:26:43.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.360+0000 7f4634200640 1 -- 172.21.15.6:0/1003191466 wait complete. 2024-08-17T02:26:43.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:43.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.528+0000 7fa42fe00640 1 Processor -- start 2024-08-17T02:26:43.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.528+0000 7fa42fe00640 1 -- start start 2024-08-17T02:26:43.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.530+0000 7fa42fe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa4300b1850 0x7fa4300b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.530+0000 7fa42fe00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4300ce770 con 0x7fa4301585a0 2024-08-17T02:26:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.530+0000 7fa42fe00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4300ce9b0 con 0x7fa4300d0650 2024-08-17T02:26:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.530+0000 7fa42fe00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4300cec90 con 0x7fa4300b1850 2024-08-17T02:26:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.530+0000 7fa42f400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa4301585a0 0x7fa4301589d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38442/0 (socket says 172.21.15.6:38442) 2024-08-17T02:26:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.530+0000 7fa42f400640 1 -- 172.21.15.6:0/3664626642 learned_addr learned my addr 172.21.15.6:0/3664626642 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.530+0000 7fa42ea00640 1 --2- 172.21.15.6:0/3664626642 >> v2:172.21.15.136:3300/0 conn(0x7fa4300b1850 0x7fa4300b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.530+0000 7fa42e000640 1 -- 172.21.15.6:0/3664626642 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938396658 0 0) 0x7fa428001490 con 0x7fa4301585a0 2024-08-17T02:26:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.530+0000 7fa42e000640 1 -- 172.21.15.6:0/3664626642 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4140034e0 con 0x7fa4301585a0 2024-08-17T02:26:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.531+0000 7fa42ea00640 1 -- 172.21.15.6:0/3664626642 >> v1:172.21.15.136:6789/0 conn(0x7fa4300d0650 legacy=0x7fa4300ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.531+0000 7fa42ea00640 1 -- 172.21.15.6:0/3664626642 >> v1:172.21.15.6:6789/0 conn(0x7fa4301585a0 legacy=0x7fa4301589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.531+0000 7fa42ea00640 1 -- 172.21.15.6:0/3664626642 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4300cef70 con 0x7fa4300b1850 2024-08-17T02:26:43.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.532+0000 7fa42ea00640 1 --2- 172.21.15.6:0/3664626642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4300b1850 0x7fa4300b1c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa420009850 tx=0x7fa4200090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdf21979eb082f01 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.532+0000 7fa42e000640 1 -- 172.21.15.6:0/3664626642 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42002ae20 con 0x7fa4300b1850 2024-08-17T02:26:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.532+0000 7fa42e000640 1 -- 172.21.15.6:0/3664626642 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa420032440 con 0x7fa4300b1850 2024-08-17T02:26:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.532+0000 7fa42e000640 1 -- 172.21.15.6:0/3664626642 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4200327c0 con 0x7fa4300b1850 2024-08-17T02:26:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.533+0000 7fa42fe00640 1 -- 172.21.15.6:0/3664626642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4300b1850 msgr2=0x7fa4300b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.533+0000 7fa42fe00640 1 --2- 172.21.15.6:0/3664626642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4300b1850 0x7fa4300b1c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa420009850 tx=0x7fa4200090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.533+0000 7fa42fe00640 1 -- 172.21.15.6:0/3664626642 shutdown_connections 2024-08-17T02:26:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.533+0000 7fa42fe00640 1 --2- 172.21.15.6:0/3664626642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4300b1850 0x7fa4300b1c20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.533+0000 7fa42fe00640 1 -- 172.21.15.6:0/3664626642 >> 172.21.15.6:0/3664626642 conn(0x7fa43006e590 msgr2=0x7fa43006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.533+0000 7fa42fe00640 1 -- 172.21.15.6:0/3664626642 shutdown_connections 2024-08-17T02:26:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.533+0000 7fa42fe00640 1 -- 172.21.15.6:0/3664626642 wait complete. 2024-08-17T02:26:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.534+0000 7fa42fe00640 1 Processor -- start 2024-08-17T02:26:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.534+0000 7fa42fe00640 1 -- start start 2024-08-17T02:26:43.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.535+0000 7fa42fe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4300b1850 0x7fa43016c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.535+0000 7fa42fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4300d0650 0x7fa43016cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.535+0000 7fa42fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4301585a0 0x7fa43016b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.535+0000 7fa42fe00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43016b080 con 0x7fa4301585a0 2024-08-17T02:26:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.535+0000 7fa42fe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43016a190 con 0x7fa4300d0650 2024-08-17T02:26:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.535+0000 7fa42fe00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43016a470 con 0x7fa4300b1850 2024-08-17T02:26:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.535+0000 7fa42f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4301585a0 0x7fa43016b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.536+0000 7fa42f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4301585a0 0x7fa43016b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57334/0 (socket says 172.21.15.6:57334) 2024-08-17T02:26:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.536+0000 7fa42f400640 1 -- 172.21.15.6:0/2713722326 learned_addr learned my addr 172.21.15.6:0/2713722326 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.536+0000 7fa427e00640 1 --2- 172.21.15.6:0/2713722326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4300d0650 0x7fa43016cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.536+0000 7fa42ea00640 1 --2- 172.21.15.6:0/2713722326 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4300b1850 0x7fa43016c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.536+0000 7fa42f400640 1 -- 172.21.15.6:0/2713722326 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4300b1850 msgr2=0x7fa43016c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.536+0000 7fa42f400640 1 --2- 172.21.15.6:0/2713722326 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4300b1850 0x7fa43016c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.536+0000 7fa42f400640 1 -- 172.21.15.6:0/2713722326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4300d0650 msgr2=0x7fa43016cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.536+0000 7fa42f400640 1 --2- 172.21.15.6:0/2713722326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4300d0650 0x7fa43016cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.536+0000 7fa42f400640 1 -- 172.21.15.6:0/2713722326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa420009390 con 0x7fa4301585a0 2024-08-17T02:26:43.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.536+0000 7fa42f400640 1 --2- 172.21.15.6:0/2713722326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4301585a0 0x7fa43016b510 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa42800cc40 tx=0x7fa428001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.536+0000 7fa426000640 1 -- 172.21.15.6:0/2713722326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42800ce00 con 0x7fa4301585a0 2024-08-17T02:26:43.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.537+0000 7fa426000640 1 -- 172.21.15.6:0/2713722326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42800a850 con 0x7fa4301585a0 2024-08-17T02:26:43.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.537+0000 7fa42fe00640 1 -- 172.21.15.6:0/2713722326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43016a750 con 0x7fa4301585a0 2024-08-17T02:26:43.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.537+0000 7fa426000640 1 -- 172.21.15.6:0/2713722326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42800ac10 con 0x7fa4301585a0 2024-08-17T02:26:43.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.537+0000 7fa42fe00640 1 -- 172.21.15.6:0/2713722326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43016ad10 con 0x7fa4301585a0 2024-08-17T02:26:43.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.538+0000 7fa42fe00640 1 -- 172.21.15.6:0/2713722326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43016b230 con 0x7fa4301585a0 2024-08-17T02:26:43.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.538+0000 7fa426000640 1 -- 172.21.15.6:0/2713722326 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa428007300 con 0x7fa4301585a0 2024-08-17T02:26:43.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.539+0000 7fa426000640 1 --2- 172.21.15.6:0/2713722326 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa40c065150 0x7fa40c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.539+0000 7fa426000640 1 -- 172.21.15.6:0/2713722326 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4280823f0 con 0x7fa4301585a0 2024-08-17T02:26:43.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.540+0000 7fa42ea00640 1 --2- 172.21.15.6:0/2713722326 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa40c065150 0x7fa40c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.540+0000 7fa42ea00640 1 --2- 172.21.15.6:0/2713722326 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa40c065150 0x7fa40c067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa420034000 tx=0x7fa420032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.543+0000 7fa426000640 1 -- 172.21.15.6:0/2713722326 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa428053f40 con 0x7fa4301585a0 2024-08-17T02:26:43.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.724+0000 7fa42fe00640 1 -- 172.21.15.6:0/2713722326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa4300ce770 con 0x7fa4301585a0 2024-08-17T02:26:43.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.725+0000 7fa426000640 1 -- 172.21.15.6:0/2713722326 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa4300ce770 con 0x7fa4301585a0 2024-08-17T02:26:43.726 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-08-17T02:26:43.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.727+0000 7fa42fe00640 1 -- 172.21.15.6:0/2713722326 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa40c065150 msgr2=0x7fa40c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.727+0000 7fa42fe00640 1 --2- 172.21.15.6:0/2713722326 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa40c065150 0x7fa40c067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa420034000 tx=0x7fa420032000 comp rx=0 tx=0).stop 2024-08-17T02:26:43.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.727+0000 7fa42fe00640 1 -- 172.21.15.6:0/2713722326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4301585a0 msgr2=0x7fa43016b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.727+0000 7fa42fe00640 1 --2- 172.21.15.6:0/2713722326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4301585a0 0x7fa43016b510 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa42800cc40 tx=0x7fa428001a30 comp rx=0 tx=0).stop 2024-08-17T02:26:43.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.727+0000 7fa42fe00640 1 -- 172.21.15.6:0/2713722326 shutdown_connections 2024-08-17T02:26:43.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.727+0000 7fa42fe00640 1 --2- 172.21.15.6:0/2713722326 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa40c065150 0x7fa40c067600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.727+0000 7fa42fe00640 1 --2- 172.21.15.6:0/2713722326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4301585a0 0x7fa43016b510 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.727+0000 7fa42fe00640 1 --2- 172.21.15.6:0/2713722326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4300d0650 0x7fa43016cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.727+0000 7fa42fe00640 1 --2- 172.21.15.6:0/2713722326 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4300b1850 0x7fa43016c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.727+0000 7fa42fe00640 1 -- 172.21.15.6:0/2713722326 >> 172.21.15.6:0/2713722326 conn(0x7fa43006e590 msgr2=0x7fa43014c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.727+0000 7fa42fe00640 1 -- 172.21.15.6:0/2713722326 shutdown_connections 2024-08-17T02:26:43.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.727+0000 7fa42fe00640 1 -- 172.21.15.6:0/2713722326 wait complete. 2024-08-17T02:26:43.742 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:43.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.892+0000 7f5e1f600640 1 Processor -- start 2024-08-17T02:26:43.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.892+0000 7f5e1f600640 1 -- start start 2024-08-17T02:26:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.893+0000 7f5e1f600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5e180afca0 0x7f5e180b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.893+0000 7f5e1f600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5e181590b0 0x7f5e18159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.893+0000 7f5e1f600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1815a4e0 con 0x7f5e180acf10 2024-08-17T02:26:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.893+0000 7f5e1f600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e180b0980 con 0x7f5e181590b0 2024-08-17T02:26:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.893+0000 7f5e1f600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e180c92b0 con 0x7f5e180afca0 2024-08-17T02:26:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.893+0000 7f5e1d600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5e181590b0 0x7f5e18159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.894+0000 7f5e1d600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5e181590b0 0x7f5e18159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57348/0 (socket says 172.21.15.6:57348) 2024-08-17T02:26:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.894+0000 7f5e1d600640 1 -- 172.21.15.6:0/268199504 learned_addr learned my addr 172.21.15.6:0/268199504 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.894+0000 7f5e1cc00640 1 --2- 172.21.15.6:0/268199504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5e180afca0 0x7f5e180b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.894+0000 7f5e1d600640 1 -- 172.21.15.6:0/268199504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5e180afca0 msgr2=0x7f5e180b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.894+0000 7f5e1d600640 1 --2- 172.21.15.6:0/268199504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5e180afca0 0x7f5e180b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.894+0000 7f5e1d600640 1 -- 172.21.15.6:0/268199504 >> v1:172.21.15.136:6789/0 conn(0x7f5e180acf10 legacy=0x7f5e181589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.894+0000 7f5e1d600640 1 -- 172.21.15.6:0/268199504 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e180ad480 con 0x7f5e181590b0 2024-08-17T02:26:43.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.894+0000 7f5e17400640 1 -- 172.21.15.6:0/268199504 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887583552 0 0) 0x7f5e04001110 con 0x7f5e180acf10 2024-08-17T02:26:43.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.895+0000 7f5e1d600640 1 --2- 172.21.15.6:0/268199504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e181590b0 0x7f5e18159fa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009f20 tx=0x7f5e10009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546f149b3fa8e4a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.895+0000 7f5e17400640 1 -- 172.21.15.6:0/268199504 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10031400 con 0x7f5e181590b0 2024-08-17T02:26:43.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.895+0000 7f5e17400640 1 -- 172.21.15.6:0/268199504 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1002d050 con 0x7f5e181590b0 2024-08-17T02:26:43.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.895+0000 7f5e17400640 1 -- 172.21.15.6:0/268199504 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10031790 con 0x7f5e181590b0 2024-08-17T02:26:43.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.896+0000 7f5e1f600640 1 -- 172.21.15.6:0/268199504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e181590b0 msgr2=0x7f5e18159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.896+0000 7f5e1f600640 1 --2- 172.21.15.6:0/268199504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e181590b0 0x7f5e18159fa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009f20 tx=0x7f5e10009840 comp rx=0 tx=0).stop 2024-08-17T02:26:43.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.896+0000 7f5e1f600640 1 -- 172.21.15.6:0/268199504 shutdown_connections 2024-08-17T02:26:43.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.896+0000 7f5e1f600640 1 --2- 172.21.15.6:0/268199504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e181590b0 0x7f5e18159fa0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.896+0000 7f5e1f600640 1 --2- 172.21.15.6:0/268199504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5e180afca0 0x7f5e180b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.896+0000 7f5e1f600640 1 -- 172.21.15.6:0/268199504 >> 172.21.15.6:0/268199504 conn(0x7f5e18066e60 msgr2=0x7f5e18067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.896+0000 7f5e1f600640 1 -- 172.21.15.6:0/268199504 shutdown_connections 2024-08-17T02:26:43.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.896+0000 7f5e1f600640 1 -- 172.21.15.6:0/268199504 wait complete. 2024-08-17T02:26:43.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.897+0000 7f5e1f600640 1 Processor -- start 2024-08-17T02:26:43.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.897+0000 7f5e1f600640 1 -- start start 2024-08-17T02:26:43.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.898+0000 7f5e1f600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5e180acf10 0x7f5e180c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.898+0000 7f5e1f600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e180afca0 0x7f5e1814abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.898+0000 7f5e1f600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e181590b0 0x7f5e180c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.898+0000 7f5e1f600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e180c79c0 con 0x7f5e181590b0 2024-08-17T02:26:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.898+0000 7f5e1f600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e180c6db0 con 0x7f5e180afca0 2024-08-17T02:26:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.898+0000 7f5e1f600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e180c7090 con 0x7f5e180acf10 2024-08-17T02:26:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.898+0000 7f5e1d600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e181590b0 0x7f5e180c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.899+0000 7f5e1d600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e181590b0 0x7f5e180c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57354/0 (socket says 172.21.15.6:57354) 2024-08-17T02:26:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.899+0000 7f5e1d600640 1 -- 172.21.15.6:0/2359732719 learned_addr learned my addr 172.21.15.6:0/2359732719 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.899+0000 7f5e1cc00640 1 --2- 172.21.15.6:0/2359732719 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5e180acf10 0x7f5e180c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.899+0000 7f5e17e00640 1 --2- 172.21.15.6:0/2359732719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e180afca0 0x7f5e1814abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.899+0000 7f5e1d600640 1 -- 172.21.15.6:0/2359732719 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5e180acf10 msgr2=0x7f5e180c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.899+0000 7f5e1d600640 1 --2- 172.21.15.6:0/2359732719 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5e180acf10 0x7f5e180c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.899+0000 7f5e1d600640 1 -- 172.21.15.6:0/2359732719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e180afca0 msgr2=0x7f5e1814abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.899+0000 7f5e1d600640 1 --2- 172.21.15.6:0/2359732719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e180afca0 0x7f5e1814abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.899+0000 7f5e1d600640 1 -- 172.21.15.6:0/2359732719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e10009ae0 con 0x7f5e181590b0 2024-08-17T02:26:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.899+0000 7f5e1d600640 1 --2- 172.21.15.6:0/2359732719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e181590b0 0x7f5e180c6430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009f20 tx=0x7f5e10036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.899+0000 7f5e0be00640 1 -- 172.21.15.6:0/2359732719 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10007760 con 0x7f5e181590b0 2024-08-17T02:26:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.900+0000 7f5e0be00640 1 -- 172.21.15.6:0/2359732719 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e100078c0 con 0x7f5e181590b0 2024-08-17T02:26:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.900+0000 7f5e0be00640 1 -- 172.21.15.6:0/2359732719 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10007c80 con 0x7f5e181590b0 2024-08-17T02:26:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.900+0000 7f5e1f600640 1 -- 172.21.15.6:0/2359732719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e180c7370 con 0x7f5e181590b0 2024-08-17T02:26:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.900+0000 7f5e1f600640 1 -- 172.21.15.6:0/2359732719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1814b110 con 0x7f5e181590b0 2024-08-17T02:26:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.901+0000 7f5e1f600640 1 -- 172.21.15.6:0/2359732719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e180c7b70 con 0x7f5e181590b0 2024-08-17T02:26:43.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.901+0000 7f5e0be00640 1 -- 172.21.15.6:0/2359732719 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5e1003c420 con 0x7f5e181590b0 2024-08-17T02:26:43.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.902+0000 7f5e0be00640 1 --2- 172.21.15.6:0/2359732719 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5df8065180 0x7f5df8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.902+0000 7f5e0be00640 1 -- 172.21.15.6:0/2359732719 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5e100a3210 con 0x7f5e181590b0 2024-08-17T02:26:43.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.902+0000 7f5e1cc00640 1 --2- 172.21.15.6:0/2359732719 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5df8065180 0x7f5df8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.903+0000 7f5e1cc00640 1 --2- 172.21.15.6:0/2359732719 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5df8065180 0x7f5df8067630 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009d20 tx=0x7f5e0c0090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:43.906+0000 7f5e0be00640 1 -- 172.21.15.6:0/2359732719 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5e180c7b70 con 0x7f5e181590b0 2024-08-17T02:26:44.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.126+0000 7f5e1f600640 1 -- 172.21.15.6:0/2359732719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e18063fb0 con 0x7f5e181590b0 2024-08-17T02:26:44.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.127+0000 7f5e0be00640 1 -- 172.21.15.6:0/2359732719 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4582 (secure 0 0 0) 0x7f5e100712e0 con 0x7f5e181590b0 2024-08-17T02:26:44.127 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:44.128 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/881817227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":881817227},{"type":"v1","addr":"172.21.15.6:6833","nonce":881817227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/546855411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":546855411},{"type":"v1","addr":"172.21.15.6:6835","nonce":546855411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/539185499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":539185499},{"type":"v1","addr":"172.21.15.136:6837","nonce":539185499}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:31.615645+0000","modified":"2024-08-17T02:26:35.207397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/2230598578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2230598578},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230598578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:44.128 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2024-08-17T02:26:44.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.129+0000 7f5e1f600640 1 -- 172.21.15.6:0/2359732719 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5df8065180 msgr2=0x7f5df8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.129+0000 7f5e1f600640 1 --2- 172.21.15.6:0/2359732719 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5df8065180 0x7f5df8067630 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009d20 tx=0x7f5e0c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.129+0000 7f5e1f600640 1 -- 172.21.15.6:0/2359732719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e181590b0 msgr2=0x7f5e180c6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.129+0000 7f5e1f600640 1 --2- 172.21.15.6:0/2359732719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e181590b0 0x7f5e180c6430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009f20 tx=0x7f5e10036000 comp rx=0 tx=0).stop 2024-08-17T02:26:44.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.129+0000 7f5e1f600640 1 -- 172.21.15.6:0/2359732719 shutdown_connections 2024-08-17T02:26:44.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.129+0000 7f5e1f600640 1 --2- 172.21.15.6:0/2359732719 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5df8065180 0x7f5df8067630 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.129+0000 7f5e1f600640 1 --2- 172.21.15.6:0/2359732719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e181590b0 0x7f5e180c6430 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.129+0000 7f5e1f600640 1 --2- 172.21.15.6:0/2359732719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e180afca0 0x7f5e1814abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.129+0000 7f5e1f600640 1 --2- 172.21.15.6:0/2359732719 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5e180acf10 0x7f5e180c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.129+0000 7f5e1f600640 1 -- 172.21.15.6:0/2359732719 >> 172.21.15.6:0/2359732719 conn(0x7f5e18066e60 msgr2=0x7f5e180ca5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.129+0000 7f5e1f600640 1 -- 172.21.15.6:0/2359732719 shutdown_connections 2024-08-17T02:26:44.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.129+0000 7f5e1f600640 1 -- 172.21.15.6:0/2359732719 wait complete. 2024-08-17T02:26:44.146 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:44.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.296+0000 7f9ffa200640 1 Processor -- start 2024-08-17T02:26:44.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.296+0000 7f9ffa200640 1 -- start start 2024-08-17T02:26:44.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.297+0000 7f9ffa200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9ff4158d50 0x7f9ff40ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.297+0000 7f9ffa200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ff40ac000 0x7f9ff40aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.297+0000 7f9ffa200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff40a96c0 con 0x7f9ff4159120 2024-08-17T02:26:44.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.297+0000 7f9ffa200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff40acf00 con 0x7f9ff40ac000 2024-08-17T02:26:44.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.297+0000 7f9ffa200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff40af7d0 con 0x7f9ff4158d50 2024-08-17T02:26:44.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.298+0000 7f9ff3e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ff40ac000 0x7f9ff40aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.298+0000 7f9ff3e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ff40ac000 0x7f9ff40aa3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57360/0 (socket says 172.21.15.6:57360) 2024-08-17T02:26:44.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.298+0000 7f9ff3e00640 1 -- 172.21.15.6:0/3558064306 learned_addr learned my addr 172.21.15.6:0/3558064306 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:44.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.298+0000 7f9febe00640 1 --1- 172.21.15.6:0/3558064306 >> v1:172.21.15.6:6789/0 conn(0x7f9ff4159120 0x7f9ff40ab8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38446/0 (socket says 172.21.15.6:38446) 2024-08-17T02:26:44.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.298+0000 7f9ff3400640 1 --2- 172.21.15.6:0/3558064306 >> v2:172.21.15.136:3300/0 conn(0x7f9ff4158d50 0x7f9ff40ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.298+0000 7f9ff3e00640 1 -- 172.21.15.6:0/3558064306 >> v2:172.21.15.136:3300/0 conn(0x7f9ff4158d50 msgr2=0x7f9ff40ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.298+0000 7f9ff3e00640 1 --2- 172.21.15.6:0/3558064306 >> v2:172.21.15.136:3300/0 conn(0x7f9ff4158d50 0x7f9ff40ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.298+0000 7f9ff3e00640 1 -- 172.21.15.6:0/3558064306 >> v1:172.21.15.6:6789/0 conn(0x7f9ff4159120 legacy=0x7f9ff40ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.298+0000 7f9ff2a00640 1 -- 172.21.15.6:0/3558064306 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250381150 0 0) 0x7f9ff40a96c0 con 0x7f9ff4159120 2024-08-17T02:26:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.298+0000 7f9ff3e00640 1 -- 172.21.15.6:0/3558064306 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff40a98f0 con 0x7f9ff40ac000 2024-08-17T02:26:44.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.299+0000 7f9ff3e00640 1 --2- 172.21.15.6:0/3558064306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff40ac000 0x7f9ff40aa3d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9ff406ecf0 tx=0x7f9fec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4df540270c5aaa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.299+0000 7f9ff2a00640 1 -- 172.21.15.6:0/3558064306 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec031400 con 0x7f9ff40ac000 2024-08-17T02:26:44.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.300+0000 7f9ff2a00640 1 -- 172.21.15.6:0/3558064306 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fec02d050 con 0x7f9ff40ac000 2024-08-17T02:26:44.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.300+0000 7f9ff2a00640 1 -- 172.21.15.6:0/3558064306 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec031790 con 0x7f9ff40ac000 2024-08-17T02:26:44.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.300+0000 7f9ffa200640 1 -- 172.21.15.6:0/3558064306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff40ac000 msgr2=0x7f9ff40aa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.300+0000 7f9ffa200640 1 --2- 172.21.15.6:0/3558064306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff40ac000 0x7f9ff40aa3d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9ff406ecf0 tx=0x7f9fec009840 comp rx=0 tx=0).stop 2024-08-17T02:26:44.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.300+0000 7f9ffa200640 1 -- 172.21.15.6:0/3558064306 shutdown_connections 2024-08-17T02:26:44.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.300+0000 7f9ffa200640 1 --2- 172.21.15.6:0/3558064306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff40ac000 0x7f9ff40aa3d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.300+0000 7f9ffa200640 1 --2- 172.21.15.6:0/3558064306 >> v2:172.21.15.136:3300/0 conn(0x7f9ff4158d50 0x7f9ff40ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.300+0000 7f9ffa200640 1 -- 172.21.15.6:0/3558064306 >> 172.21.15.6:0/3558064306 conn(0x7f9ff4095a70 msgr2=0x7f9ff4095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.300+0000 7f9ffa200640 1 -- 172.21.15.6:0/3558064306 shutdown_connections 2024-08-17T02:26:44.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.300+0000 7f9ffa200640 1 -- 172.21.15.6:0/3558064306 wait complete. 2024-08-17T02:26:44.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.302+0000 7f9ffa200640 1 Processor -- start 2024-08-17T02:26:44.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.302+0000 7f9ffa200640 1 -- start start 2024-08-17T02:26:44.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.303+0000 7f9ffa200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ff40ac000 0x7f9ff414d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.303+0000 7f9ffa200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff4158d50 0x7f9ff4155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.303+0000 7f9ffa200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ff4159120 0x7f9ff41529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.303+0000 7f9ffa200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff414e0c0 con 0x7f9ff4158d50 2024-08-17T02:26:44.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.303+0000 7f9ffa200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff414e3a0 con 0x7f9ff4159120 2024-08-17T02:26:44.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.303+0000 7f9ffa200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff414e680 con 0x7f9ff40ac000 2024-08-17T02:26:44.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.303+0000 7f9febe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff4158d50 0x7f9ff4155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.303+0000 7f9febe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff4158d50 0x7f9ff4155cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57366/0 (socket says 172.21.15.6:57366) 2024-08-17T02:26:44.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.303+0000 7f9febe00640 1 -- 172.21.15.6:0/2798935723 learned_addr learned my addr 172.21.15.6:0/2798935723 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:44.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.303+0000 7f9ff3e00640 1 --2- 172.21.15.6:0/2798935723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ff4159120 0x7f9ff41529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.303+0000 7f9ff3400640 1 --2- 172.21.15.6:0/2798935723 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ff40ac000 0x7f9ff414d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.304+0000 7f9febe00640 1 -- 172.21.15.6:0/2798935723 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ff40ac000 msgr2=0x7f9ff414d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.304+0000 7f9febe00640 1 --2- 172.21.15.6:0/2798935723 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ff40ac000 0x7f9ff414d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.304+0000 7f9febe00640 1 -- 172.21.15.6:0/2798935723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ff4159120 msgr2=0x7f9ff41529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.304+0000 7f9febe00640 1 --2- 172.21.15.6:0/2798935723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ff4159120 0x7f9ff41529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.304+0000 7f9febe00640 1 -- 172.21.15.6:0/2798935723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec009ae0 con 0x7f9ff4158d50 2024-08-17T02:26:44.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.304+0000 7f9febe00640 1 --2- 172.21.15.6:0/2798935723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff4158d50 0x7f9ff4155cb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00c5b0 tx=0x7f9fdc007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.304+0000 7f9feaa00640 1 -- 172.21.15.6:0/2798935723 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc007300 con 0x7f9ff4158d50 2024-08-17T02:26:44.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.304+0000 7f9feaa00640 1 -- 172.21.15.6:0/2798935723 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc0074a0 con 0x7f9ff4158d50 2024-08-17T02:26:44.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.304+0000 7f9feaa00640 1 -- 172.21.15.6:0/2798935723 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc0049f0 con 0x7f9ff4158d50 2024-08-17T02:26:44.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.304+0000 7f9ffa200640 1 -- 172.21.15.6:0/2798935723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff414e960 con 0x7f9ff4158d50 2024-08-17T02:26:44.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.304+0000 7f9ffa200640 1 -- 172.21.15.6:0/2798935723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff414d920 con 0x7f9ff4158d50 2024-08-17T02:26:44.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.305+0000 7f9ffa200640 1 -- 172.21.15.6:0/2798935723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff414ee60 con 0x7f9ff4158d50 2024-08-17T02:26:44.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.306+0000 7f9feaa00640 1 -- 172.21.15.6:0/2798935723 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9fdc01c3b0 con 0x7f9ff4158d50 2024-08-17T02:26:44.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.307+0000 7f9feaa00640 1 --2- 172.21.15.6:0/2798935723 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9fd0065150 0x7f9fd0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.307+0000 7f9feaa00640 1 -- 172.21.15.6:0/2798935723 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9fdc081820 con 0x7f9ff4158d50 2024-08-17T02:26:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.307+0000 7f9ff3400640 1 --2- 172.21.15.6:0/2798935723 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9fd0065150 0x7f9fd0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.308+0000 7f9ff3400640 1 --2- 172.21.15.6:0/2798935723 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9fd0065150 0x7f9fd0067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009d20 tx=0x7f9fe40090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.311+0000 7f9feaa00640 1 -- 172.21.15.6:0/2798935723 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9fdc04ce40 con 0x7f9ff4158d50 2024-08-17T02:26:44.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.495+0000 7f9ffa200640 1 -- 172.21.15.6:0/2798935723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ff4063fb0 con 0x7f9ff4158d50 2024-08-17T02:26:44.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.496+0000 7f9feaa00640 1 -- 172.21.15.6:0/2798935723 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f9fdc04f8f0 con 0x7f9ff4158d50 2024-08-17T02:26:44.497 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:44.497 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:33.190571+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:29.257601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:30.596556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:44.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.498+0000 7f9ffa200640 1 -- 172.21.15.6:0/2798935723 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9fd0065150 msgr2=0x7f9fd0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.498+0000 7f9ffa200640 1 --2- 172.21.15.6:0/2798935723 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9fd0065150 0x7f9fd0067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009d20 tx=0x7f9fe40090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.498+0000 7f9ffa200640 1 -- 172.21.15.6:0/2798935723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff4158d50 msgr2=0x7f9ff4155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.498+0000 7f9ffa200640 1 --2- 172.21.15.6:0/2798935723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff4158d50 0x7f9ff4155cb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00c5b0 tx=0x7f9fdc007f20 comp rx=0 tx=0).stop 2024-08-17T02:26:44.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.498+0000 7f9ffa200640 1 -- 172.21.15.6:0/2798935723 shutdown_connections 2024-08-17T02:26:44.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.498+0000 7f9ffa200640 1 --2- 172.21.15.6:0/2798935723 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9fd0065150 0x7f9fd0067600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.498+0000 7f9ffa200640 1 --2- 172.21.15.6:0/2798935723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ff4159120 0x7f9ff41529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.498+0000 7f9ffa200640 1 --2- 172.21.15.6:0/2798935723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff4158d50 0x7f9ff4155cb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.498+0000 7f9ffa200640 1 --2- 172.21.15.6:0/2798935723 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ff40ac000 0x7f9ff414d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.498+0000 7f9ffa200640 1 -- 172.21.15.6:0/2798935723 >> 172.21.15.6:0/2798935723 conn(0x7f9ff4095a70 msgr2=0x7f9ff40aafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.498+0000 7f9ffa200640 1 -- 172.21.15.6:0/2798935723 shutdown_connections 2024-08-17T02:26:44.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.498+0000 7f9ffa200640 1 -- 172.21.15.6:0/2798935723 wait complete. 2024-08-17T02:26:44.514 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:25.463503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:29.257601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:30.596556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:44.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:44.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.666+0000 7f129ba00640 1 Processor -- start 2024-08-17T02:26:44.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.667+0000 7f129ba00640 1 -- start start 2024-08-17T02:26:44.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.668+0000 7f129ba00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1294158e60 0x7f12940add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.668+0000 7f129ba00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f12940ae860 0x7f12940ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.668+0000 7f129ba00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12940ad8a0 con 0x7f12940b03b0 2024-08-17T02:26:44.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.668+0000 7f129ba00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129406edf0 con 0x7f1294158e60 2024-08-17T02:26:44.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.668+0000 7f129ba00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12940acc90 con 0x7f12940ae860 2024-08-17T02:26:44.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.668+0000 7f1299000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1294158e60 0x7f12940add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.668+0000 7f1299a00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f12940b03b0 0x7f1294159610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38450/0 (socket says 172.21.15.6:38450) 2024-08-17T02:26:44.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.668+0000 7f1299a00640 1 -- 172.21.15.6:0/1382656027 learned_addr learned my addr 172.21.15.6:0/1382656027 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:44.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.668+0000 7f1293e00640 1 --2- 172.21.15.6:0/1382656027 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f12940ae860 0x7f12940ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.668+0000 7f1299000640 1 -- 172.21.15.6:0/1382656027 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f12940ae860 msgr2=0x7f12940ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:44.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.668+0000 7f1299000640 1 --2- 172.21.15.6:0/1382656027 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f12940ae860 0x7f12940ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.668+0000 7f1299000640 1 -- 172.21.15.6:0/1382656027 >> v1:172.21.15.6:6789/0 conn(0x7f12940b03b0 legacy=0x7f1294159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.668+0000 7f1299000640 1 -- 172.21.15.6:0/1382656027 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12940acf70 con 0x7f1294158e60 2024-08-17T02:26:44.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.670+0000 7f1299000640 1 --2- 172.21.15.6:0/1382656027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1294158e60 0x7f12940add30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1288009850 tx=0x7f12880090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfe9f4ded21c599 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.670+0000 7f1293400640 1 -- 172.21.15.6:0/1382656027 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128802ad00 con 0x7f1294158e60 2024-08-17T02:26:44.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.670+0000 7f1293400640 1 -- 172.21.15.6:0/1382656027 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128802ae60 con 0x7f1294158e60 2024-08-17T02:26:44.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.670+0000 7f1293400640 1 -- 172.21.15.6:0/1382656027 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288032670 con 0x7f1294158e60 2024-08-17T02:26:44.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.670+0000 7f129ba00640 1 -- 172.21.15.6:0/1382656027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1294158e60 msgr2=0x7f12940add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.670+0000 7f129ba00640 1 --2- 172.21.15.6:0/1382656027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1294158e60 0x7f12940add30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1288009850 tx=0x7f12880090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.671+0000 7f129ba00640 1 -- 172.21.15.6:0/1382656027 shutdown_connections 2024-08-17T02:26:44.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.671+0000 7f129ba00640 1 --2- 172.21.15.6:0/1382656027 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f12940ae860 0x7f12940ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.671+0000 7f129ba00640 1 --2- 172.21.15.6:0/1382656027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1294158e60 0x7f12940add30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.671+0000 7f129ba00640 1 -- 172.21.15.6:0/1382656027 >> 172.21.15.6:0/1382656027 conn(0x7f12940cc390 msgr2=0x7f1294066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.671+0000 7f129ba00640 1 -- 172.21.15.6:0/1382656027 shutdown_connections 2024-08-17T02:26:44.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.671+0000 7f129ba00640 1 -- 172.21.15.6:0/1382656027 wait complete. 2024-08-17T02:26:44.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.672+0000 7f129ba00640 1 Processor -- start 2024-08-17T02:26:44.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.672+0000 7f129ba00640 1 -- start start 2024-08-17T02:26:44.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.673+0000 7f129ba00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12940ae860 0x7f1294143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.673+0000 7f129ba00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12940b03b0 0x7f1294069920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.673+0000 7f129ba00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1294158e60 0x7f1294069e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.673+0000 7f129ba00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1294155a40 con 0x7f12940b03b0 2024-08-17T02:26:44.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.673+0000 7f129ba00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1294147b70 con 0x7f12940ae860 2024-08-17T02:26:44.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.673+0000 7f129ba00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1294146c00 con 0x7f1294158e60 2024-08-17T02:26:44.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.673+0000 7f1293e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12940b03b0 0x7f1294069920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.673+0000 7f1293e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12940b03b0 0x7f1294069920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57382/0 (socket says 172.21.15.6:57382) 2024-08-17T02:26:44.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.673+0000 7f1293e00640 1 -- 172.21.15.6:0/1024354656 learned_addr learned my addr 172.21.15.6:0/1024354656 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:44.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.673+0000 7f1299000640 1 --2- 172.21.15.6:0/1024354656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12940ae860 0x7f1294143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.673+0000 7f1299a00640 1 --2- 172.21.15.6:0/1024354656 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1294158e60 0x7f1294069e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.674+0000 7f1293e00640 1 -- 172.21.15.6:0/1024354656 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1294158e60 msgr2=0x7f1294069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.674+0000 7f1293e00640 1 --2- 172.21.15.6:0/1024354656 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1294158e60 0x7f1294069e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.674+0000 7f1293e00640 1 -- 172.21.15.6:0/1024354656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12940ae860 msgr2=0x7f1294143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.674+0000 7f1293e00640 1 --2- 172.21.15.6:0/1024354656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12940ae860 0x7f1294143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.674+0000 7f1293e00640 1 -- 172.21.15.6:0/1024354656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1288009390 con 0x7f12940b03b0 2024-08-17T02:26:44.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.674+0000 7f1299000640 1 --2- 172.21.15.6:0/1024354656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12940ae860 0x7f1294143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:44.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.674+0000 7f1293e00640 1 --2- 172.21.15.6:0/1024354656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12940b03b0 0x7f1294069920 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f128000d890 tx=0x7f1280008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.674+0000 7f1287e00640 1 -- 172.21.15.6:0/1024354656 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128000de20 con 0x7f12940b03b0 2024-08-17T02:26:44.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.674+0000 7f1287e00640 1 -- 172.21.15.6:0/1024354656 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128000b8d0 con 0x7f12940b03b0 2024-08-17T02:26:44.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.674+0000 7f129ba00640 1 -- 172.21.15.6:0/1024354656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1294146ee0 con 0x7f12940b03b0 2024-08-17T02:26:44.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.674+0000 7f1287e00640 1 -- 172.21.15.6:0/1024354656 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128000bc70 con 0x7f12940b03b0 2024-08-17T02:26:44.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.674+0000 7f129ba00640 1 -- 172.21.15.6:0/1024354656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12941474a0 con 0x7f12940b03b0 2024-08-17T02:26:44.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.675+0000 7f129ba00640 1 -- 172.21.15.6:0/1024354656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1294063fb0 con 0x7f12940b03b0 2024-08-17T02:26:44.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.676+0000 7f1287e00640 1 -- 172.21.15.6:0/1024354656 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1280014640 con 0x7f12940b03b0 2024-08-17T02:26:44.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.677+0000 7f1287e00640 1 --2- 172.21.15.6:0/1024354656 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1274065150 0x7f1274067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.677+0000 7f1287e00640 1 -- 172.21.15.6:0/1024354656 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1280082b60 con 0x7f12940b03b0 2024-08-17T02:26:44.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.677+0000 7f1299000640 1 --2- 172.21.15.6:0/1024354656 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1274065150 0x7f1274067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.678+0000 7f1299000640 1 --2- 172.21.15.6:0/1024354656 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1274065150 0x7f1274067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1288034000 tx=0x7f1288032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.681+0000 7f1287e00640 1 -- 172.21.15.6:0/1024354656 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1280050c40 con 0x7f12940b03b0 2024-08-17T02:26:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.867+0000 7f129ba00640 1 -- 172.21.15.6:0/1024354656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12940b0b50 con 0x7f12940b03b0 2024-08-17T02:26:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.868+0000 7f1287e00640 1 -- 172.21.15.6:0/1024354656 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1280054260 con 0x7f12940b03b0 2024-08-17T02:26:44.869 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-08-17T02:26:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.870+0000 7f129ba00640 1 -- 172.21.15.6:0/1024354656 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1274065150 msgr2=0x7f1274067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.870+0000 7f129ba00640 1 --2- 172.21.15.6:0/1024354656 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1274065150 0x7f1274067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1288034000 tx=0x7f1288032000 comp rx=0 tx=0).stop 2024-08-17T02:26:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.870+0000 7f129ba00640 1 -- 172.21.15.6:0/1024354656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12940b03b0 msgr2=0x7f1294069920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.870+0000 7f129ba00640 1 --2- 172.21.15.6:0/1024354656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12940b03b0 0x7f1294069920 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f128000d890 tx=0x7f1280008040 comp rx=0 tx=0).stop 2024-08-17T02:26:44.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.870+0000 7f129ba00640 1 -- 172.21.15.6:0/1024354656 shutdown_connections 2024-08-17T02:26:44.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.870+0000 7f129ba00640 1 --2- 172.21.15.6:0/1024354656 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1274065150 0x7f1274067600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.870+0000 7f129ba00640 1 --2- 172.21.15.6:0/1024354656 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1294158e60 0x7f1294069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.870+0000 7f129ba00640 1 --2- 172.21.15.6:0/1024354656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12940b03b0 0x7f1294069920 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.870+0000 7f129ba00640 1 --2- 172.21.15.6:0/1024354656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12940ae860 0x7f1294143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.870+0000 7f129ba00640 1 -- 172.21.15.6:0/1024354656 >> 172.21.15.6:0/1024354656 conn(0x7f12940cc390 msgr2=0x7f12940cb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.870+0000 7f129ba00640 1 -- 172.21.15.6:0/1024354656 shutdown_connections 2024-08-17T02:26:44.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:44.870+0000 7f129ba00640 1 -- 172.21.15.6:0/1024354656 wait complete. 2024-08-17T02:26:44.886 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:45.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.039+0000 7ff264200640 1 Processor -- start 2024-08-17T02:26:45.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.039+0000 7ff264200640 1 -- start start 2024-08-17T02:26:45.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.040+0000 7ff264200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff25c0b4260 0x7ff25c0cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.040+0000 7ff264200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff25c0b2ae0 con 0x7ff25c158c60 2024-08-17T02:26:45.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.040+0000 7ff264200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff25c0b2dc0 con 0x7ff25c159030 2024-08-17T02:26:45.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.040+0000 7ff264200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0cca80 con 0x7ff25c0b4260 2024-08-17T02:26:45.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.040+0000 7ff261800640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff25c158c60 0x7ff25c0b1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45482/0 (socket says 172.21.15.6:45482) 2024-08-17T02:26:45.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff261800640 1 -- 172.21.15.6:0/868213385 learned_addr learned my addr 172.21.15.6:0/868213385 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:45.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff262200640 1 --2- 172.21.15.6:0/868213385 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff25c0b4260 0x7ff25c0cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff25be00640 1 -- 172.21.15.6:0/868213385 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753407931 0 0) 0x7ff25c0b2ae0 con 0x7ff25c158c60 2024-08-17T02:26:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff25be00640 1 -- 172.21.15.6:0/868213385 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2440034e0 con 0x7ff25c158c60 2024-08-17T02:26:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff25be00640 1 -- 172.21.15.6:0/868213385 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552633199 0 0) 0x7ff25c0b2dc0 con 0x7ff25c159030 2024-08-17T02:26:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff25be00640 1 -- 172.21.15.6:0/868213385 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff25c0b2ae0 con 0x7ff25c159030 2024-08-17T02:26:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff25be00640 1 -- 172.21.15.6:0/868213385 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2645604837 0 0) 0x7ff2440034e0 con 0x7ff25c158c60 2024-08-17T02:26:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff25be00640 1 -- 172.21.15.6:0/868213385 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff25c0b4260 msgr2=0x7ff25c0cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff25be00640 1 --2- 172.21.15.6:0/868213385 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff25c0b4260 0x7ff25c0cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff25be00640 1 -- 172.21.15.6:0/868213385 >> v1:172.21.15.136:6789/0 conn(0x7ff25c159030 legacy=0x7ff25c0cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff25be00640 1 -- 172.21.15.6:0/868213385 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c0ccd60 con 0x7ff25c158c60 2024-08-17T02:26:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff25be00640 1 -- 172.21.15.6:0/868213385 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7ff250001470 con 0x7ff25c158c60 2024-08-17T02:26:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff25be00640 1 -- 172.21.15.6:0/868213385 >> v1:172.21.15.6:6789/0 conn(0x7ff25c158c60 legacy=0x7ff25c0b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff25be00640 1 --2- 172.21.15.6:0/868213385 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff244003b90 0x7ff244003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff25be00640 1 --2- 172.21.15.6:0/868213385 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff25c0b4260 0x7ff244004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff25be00640 1 --2- 172.21.15.6:0/868213385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff244004cc0 0x7ff244005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff25be00640 1 -- 172.21.15.6:0/868213385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0cca80 con 0x7ff244004cc0 2024-08-17T02:26:45.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff25be00640 1 -- 172.21.15.6:0/868213385 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24400bae0 con 0x7ff244003b90 2024-08-17T02:26:45.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.041+0000 7ff25be00640 1 -- 172.21.15.6:0/868213385 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24400bca0 con 0x7ff25c0b4260 2024-08-17T02:26:45.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.042+0000 7ff262200640 1 --2- 172.21.15.6:0/868213385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff244004cc0 0x7ff244005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.042+0000 7ff261800640 1 --2- 172.21.15.6:0/868213385 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff244003b90 0x7ff244003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.042+0000 7ff260e00640 1 --2- 172.21.15.6:0/868213385 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff25c0b4260 0x7ff244004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.042+0000 7ff262200640 1 -- 172.21.15.6:0/868213385 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff25c0b4260 msgr2=0x7ff244004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:45.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.042+0000 7ff262200640 1 --2- 172.21.15.6:0/868213385 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff25c0b4260 0x7ff244004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.042+0000 7ff262200640 1 -- 172.21.15.6:0/868213385 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff244003b90 msgr2=0x7ff244003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:45.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.042+0000 7ff262200640 1 --2- 172.21.15.6:0/868213385 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff244003b90 0x7ff244003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.042+0000 7ff262200640 1 -- 172.21.15.6:0/868213385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2440034e0 con 0x7ff244004cc0 2024-08-17T02:26:45.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.043+0000 7ff262200640 1 --2- 172.21.15.6:0/868213385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff244004cc0 0x7ff244005130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff25400e210 tx=0x7ff25400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475b861cf616eb2d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.043+0000 7ff25be00640 1 -- 172.21.15.6:0/868213385 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25402c040 con 0x7ff244004cc0 2024-08-17T02:26:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.043+0000 7ff25be00640 1 -- 172.21.15.6:0/868213385 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25400f040 con 0x7ff244004cc0 2024-08-17T02:26:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.043+0000 7ff25be00640 1 -- 172.21.15.6:0/868213385 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff254030630 con 0x7ff244004cc0 2024-08-17T02:26:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.044+0000 7ff264200640 1 -- 172.21.15.6:0/868213385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff244004cc0 msgr2=0x7ff244005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.044+0000 7ff264200640 1 --2- 172.21.15.6:0/868213385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff244004cc0 0x7ff244005130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff25400e210 tx=0x7ff25400b040 comp rx=0 tx=0).stop 2024-08-17T02:26:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.044+0000 7ff262200640 1 -- 172.21.15.6:0/868213385 reap_dead start 2024-08-17T02:26:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.044+0000 7ff264200640 1 -- 172.21.15.6:0/868213385 shutdown_connections 2024-08-17T02:26:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.044+0000 7ff264200640 1 -- 172.21.15.6:0/868213385 >> 172.21.15.6:0/868213385 conn(0x7ff25c06e590 msgr2=0x7ff25c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.044+0000 7ff264200640 1 -- 172.21.15.6:0/868213385 shutdown_connections 2024-08-17T02:26:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.044+0000 7ff264200640 1 -- 172.21.15.6:0/868213385 wait complete. 2024-08-17T02:26:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.045+0000 7ff264200640 1 Processor -- start 2024-08-17T02:26:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.046+0000 7ff264200640 1 -- start start 2024-08-17T02:26:45.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.046+0000 7ff264200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff244004cc0 0x7ff25c141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.046+0000 7ff264200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff25c1531e0 0x7ff25c16c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.046+0000 7ff264200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff25c16c9b0 0x7ff25c0c3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.046+0000 7ff264200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c16cde0 con 0x7ff25c1531e0 2024-08-17T02:26:45.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.046+0000 7ff264200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0c41f0 con 0x7ff244004cc0 2024-08-17T02:26:45.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.046+0000 7ff264200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0c44d0 con 0x7ff25c16c9b0 2024-08-17T02:26:45.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.047+0000 7ff260e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff25c1531e0 0x7ff25c16c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.047+0000 7ff260e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff25c1531e0 0x7ff25c16c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49006/0 (socket says 172.21.15.6:49006) 2024-08-17T02:26:45.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.047+0000 7ff260e00640 1 -- 172.21.15.6:0/1517234853 learned_addr learned my addr 172.21.15.6:0/1517234853 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:45.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.047+0000 7ff261800640 1 --2- 172.21.15.6:0/1517234853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff244004cc0 0x7ff25c141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.047+0000 7ff262200640 1 --2- 172.21.15.6:0/1517234853 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff25c16c9b0 0x7ff25c0c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.047+0000 7ff260e00640 1 -- 172.21.15.6:0/1517234853 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff25c16c9b0 msgr2=0x7ff25c0c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.047+0000 7ff260e00640 1 --2- 172.21.15.6:0/1517234853 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff25c16c9b0 0x7ff25c0c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.047+0000 7ff260e00640 1 -- 172.21.15.6:0/1517234853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff244004cc0 msgr2=0x7ff25c141340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.047+0000 7ff260e00640 1 --2- 172.21.15.6:0/1517234853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff244004cc0 0x7ff25c141340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.047+0000 7ff260e00640 1 -- 172.21.15.6:0/1517234853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c0c47b0 con 0x7ff25c1531e0 2024-08-17T02:26:45.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.047+0000 7ff260e00640 1 --2- 172.21.15.6:0/1517234853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff25c1531e0 0x7ff25c16c470 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff248002af0 tx=0x7ff248007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.048+0000 7ff258c00640 1 -- 172.21.15.6:0/1517234853 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24800faf0 con 0x7ff25c1531e0 2024-08-17T02:26:45.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.048+0000 7ff258c00640 1 -- 172.21.15.6:0/1517234853 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24800fc50 con 0x7ff25c1531e0 2024-08-17T02:26:45.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.048+0000 7ff258c00640 1 -- 172.21.15.6:0/1517234853 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff248007050 con 0x7ff25c1531e0 2024-08-17T02:26:45.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.048+0000 7ff264200640 1 -- 172.21.15.6:0/1517234853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25c0c4a90 con 0x7ff25c1531e0 2024-08-17T02:26:45.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.048+0000 7ff264200640 1 -- 172.21.15.6:0/1517234853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25c153650 con 0x7ff25c1531e0 2024-08-17T02:26:45.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.049+0000 7ff264200640 1 -- 172.21.15.6:0/1517234853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25c063fb0 con 0x7ff25c1531e0 2024-08-17T02:26:45.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.050+0000 7ff258c00640 1 -- 172.21.15.6:0/1517234853 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff248007440 con 0x7ff25c1531e0 2024-08-17T02:26:45.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.050+0000 7ff258c00640 1 --2- 172.21.15.6:0/1517234853 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff23c065180 0x7ff23c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.050+0000 7ff258c00640 1 -- 172.21.15.6:0/1517234853 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff248082900 con 0x7ff25c1531e0 2024-08-17T02:26:45.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.051+0000 7ff261800640 1 --2- 172.21.15.6:0/1517234853 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff23c065180 0x7ff23c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.051+0000 7ff261800640 1 --2- 172.21.15.6:0/1517234853 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff23c065180 0x7ff23c067630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff250000e10 tx=0x7ff250009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.054+0000 7ff258c00640 1 -- 172.21.15.6:0/1517234853 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff248050920 con 0x7ff25c1531e0 2024-08-17T02:26:45.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.238+0000 7ff264200640 1 -- 172.21.15.6:0/1517234853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff25c0b5730 con 0x7ff25c1531e0 2024-08-17T02:26:45.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.238+0000 7ff258c00640 1 -- 172.21.15.6:0/1517234853 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff248053f40 con 0x7ff25c1531e0 2024-08-17T02:26:45.239 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-08-17T02:26:45.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.240+0000 7ff264200640 1 -- 172.21.15.6:0/1517234853 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff23c065180 msgr2=0x7ff23c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.240+0000 7ff264200640 1 --2- 172.21.15.6:0/1517234853 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff23c065180 0x7ff23c067630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff250000e10 tx=0x7ff250009040 comp rx=0 tx=0).stop 2024-08-17T02:26:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.240+0000 7ff264200640 1 -- 172.21.15.6:0/1517234853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff25c1531e0 msgr2=0x7ff25c16c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.240+0000 7ff264200640 1 --2- 172.21.15.6:0/1517234853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff25c1531e0 0x7ff25c16c470 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff248002af0 tx=0x7ff248007ca0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.240+0000 7ff264200640 1 -- 172.21.15.6:0/1517234853 shutdown_connections 2024-08-17T02:26:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.240+0000 7ff264200640 1 --2- 172.21.15.6:0/1517234853 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff23c065180 0x7ff23c067630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.240+0000 7ff264200640 1 --2- 172.21.15.6:0/1517234853 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff25c16c9b0 0x7ff25c0c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.240+0000 7ff264200640 1 --2- 172.21.15.6:0/1517234853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff25c1531e0 0x7ff25c16c470 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.240+0000 7ff264200640 1 --2- 172.21.15.6:0/1517234853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff244004cc0 0x7ff25c141340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.240+0000 7ff264200640 1 -- 172.21.15.6:0/1517234853 >> 172.21.15.6:0/1517234853 conn(0x7ff25c06e590 msgr2=0x7ff25c068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.241+0000 7ff264200640 1 -- 172.21.15.6:0/1517234853 shutdown_connections 2024-08-17T02:26:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.241+0000 7ff264200640 1 -- 172.21.15.6:0/1517234853 wait complete. 2024-08-17T02:26:45.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.411+0000 7f6d0c200640 1 Processor -- start 2024-08-17T02:26:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.411+0000 7f6d0c200640 1 -- start start 2024-08-17T02:26:45.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.412+0000 7f6d0c200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d040afca0 0x7f6d040b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.412+0000 7f6d0c200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6d040acf10 0x7f6d04159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.412+0000 7f6d0c200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d0415a4e0 con 0x7f6d041589a0 2024-08-17T02:26:45.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.412+0000 7f6d0c200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d040b0980 con 0x7f6d040acf10 2024-08-17T02:26:45.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.412+0000 7f6d0c200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040c92b0 con 0x7f6d040afca0 2024-08-17T02:26:45.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.413+0000 7f6d08e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6d040acf10 0x7f6d04159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.413+0000 7f6d09800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d040afca0 0x7f6d040b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.413+0000 7f6d08e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6d040acf10 0x7f6d04159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:37452/0 (socket says 172.21.15.6:37452) 2024-08-17T02:26:45.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.413+0000 7f6d09800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d040afca0 0x7f6d040b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:33474/0 (socket says 172.21.15.6:33474) 2024-08-17T02:26:45.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.413+0000 7f6d08e00640 1 -- 172.21.15.6:0/227718604 learned_addr learned my addr 172.21.15.6:0/227718604 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:45.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.413+0000 7f6d0a200640 1 --1- 172.21.15.6:0/227718604 >> v1:172.21.15.136:6789/0 conn(0x7f6d041589a0 0x7f6d0406d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:51646/0 (socket says 172.21.15.6:51646) 2024-08-17T02:26:45.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.413+0000 7f6d08e00640 1 -- 172.21.15.6:0/227718604 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d040afca0 msgr2=0x7f6d040b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:45.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.413+0000 7f6d08e00640 1 --2- 172.21.15.6:0/227718604 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d040afca0 0x7f6d040b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.413+0000 7f6d08e00640 1 -- 172.21.15.6:0/227718604 >> v1:172.21.15.136:6789/0 conn(0x7f6d041589a0 legacy=0x7f6d0406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.413+0000 7f6d08e00640 1 -- 172.21.15.6:0/227718604 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d040ad480 con 0x7f6d040acf10 2024-08-17T02:26:45.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.413+0000 7f6d09800640 1 --2- 172.21.15.6:0/227718604 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d040afca0 0x7f6d040b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.414+0000 7f6d08e00640 1 --2- 172.21.15.6:0/227718604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d040acf10 0x7f6d04159fa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009940 tx=0x7f6cf00091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=657920e250daa34 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.414+0000 7f6d03e00640 1 -- 172.21.15.6:0/227718604 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf002ae30 con 0x7f6d040acf10 2024-08-17T02:26:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.414+0000 7f6d03e00640 1 -- 172.21.15.6:0/227718604 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf0032440 con 0x7f6d040acf10 2024-08-17T02:26:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.414+0000 7f6d03e00640 1 -- 172.21.15.6:0/227718604 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0032820 con 0x7f6d040acf10 2024-08-17T02:26:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.415+0000 7f6d0c200640 1 -- 172.21.15.6:0/227718604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d040acf10 msgr2=0x7f6d04159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.415+0000 7f6d0c200640 1 --2- 172.21.15.6:0/227718604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d040acf10 0x7f6d04159fa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009940 tx=0x7f6cf00091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.415+0000 7f6d0c200640 1 -- 172.21.15.6:0/227718604 shutdown_connections 2024-08-17T02:26:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.415+0000 7f6d0c200640 1 --2- 172.21.15.6:0/227718604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d040acf10 0x7f6d04159fa0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.415+0000 7f6d0c200640 1 --2- 172.21.15.6:0/227718604 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d040afca0 0x7f6d040b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.415+0000 7f6d0c200640 1 -- 172.21.15.6:0/227718604 >> 172.21.15.6:0/227718604 conn(0x7f6d04066e60 msgr2=0x7f6d04067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.415+0000 7f6d0c200640 1 -- 172.21.15.6:0/227718604 shutdown_connections 2024-08-17T02:26:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.415+0000 7f6d0c200640 1 -- 172.21.15.6:0/227718604 wait complete. 2024-08-17T02:26:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.416+0000 7f6d0c200640 1 Processor -- start 2024-08-17T02:26:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.417+0000 7f6d0c200640 1 -- start start 2024-08-17T02:26:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.417+0000 7f6d0c200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d040acf10 0x7f6d04152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.417+0000 7f6d0c200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d040afca0 0x7f6d041570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.418+0000 7f6d0c200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d041589a0 0x7f6d04152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.418+0000 7f6d0c200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d04155d20 con 0x7f6d040acf10 2024-08-17T02:26:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.418+0000 7f6d0c200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d04157a10 con 0x7f6d040afca0 2024-08-17T02:26:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.418+0000 7f6d0c200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0416a1b0 con 0x7f6d041589a0 2024-08-17T02:26:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.418+0000 7f6d09800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d040acf10 0x7f6d04152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.418+0000 7f6d09800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d040acf10 0x7f6d04152430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49012/0 (socket says 172.21.15.6:49012) 2024-08-17T02:26:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.418+0000 7f6d09800640 1 -- 172.21.15.6:0/2365870762 learned_addr learned my addr 172.21.15.6:0/2365870762 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.418+0000 7f6d08e00640 1 --2- 172.21.15.6:0/2365870762 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d040afca0 0x7f6d041570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.418+0000 7f6d0a200640 1 --2- 172.21.15.6:0/2365870762 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d041589a0 0x7f6d04152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.418+0000 7f6d09800640 1 -- 172.21.15.6:0/2365870762 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d041589a0 msgr2=0x7f6d04152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.418+0000 7f6d09800640 1 --2- 172.21.15.6:0/2365870762 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d041589a0 0x7f6d04152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.418+0000 7f6d09800640 1 -- 172.21.15.6:0/2365870762 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d040afca0 msgr2=0x7f6d041570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.418+0000 7f6d09800640 1 --2- 172.21.15.6:0/2365870762 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d040afca0 0x7f6d041570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.418+0000 7f6d09800640 1 -- 172.21.15.6:0/2365870762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf8009390 con 0x7f6d040acf10 2024-08-17T02:26:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.418+0000 7f6d0a200640 1 --2- 172.21.15.6:0/2365870762 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d041589a0 0x7f6d04152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.418+0000 7f6d09800640 1 --2- 172.21.15.6:0/2365870762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d040acf10 0x7f6d04152430 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800ecb0 tx=0x7f6cf80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.419+0000 7f6d00c00640 1 -- 172.21.15.6:0/2365870762 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf800cb60 con 0x7f6d040acf10 2024-08-17T02:26:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.419+0000 7f6d00c00640 1 -- 172.21.15.6:0/2365870762 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf800ccc0 con 0x7f6d040acf10 2024-08-17T02:26:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.419+0000 7f6d00c00640 1 -- 172.21.15.6:0/2365870762 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8013470 con 0x7f6d040acf10 2024-08-17T02:26:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.419+0000 7f6d0c200640 1 -- 172.21.15.6:0/2365870762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf0009450 con 0x7f6d040acf10 2024-08-17T02:26:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.419+0000 7f6d0c200640 1 -- 172.21.15.6:0/2365870762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d041696d0 con 0x7f6d040acf10 2024-08-17T02:26:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.420+0000 7f6d0c200640 1 -- 172.21.15.6:0/2365870762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d04063fb0 con 0x7f6d040acf10 2024-08-17T02:26:45.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.420+0000 7f6d00c00640 1 -- 172.21.15.6:0/2365870762 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6cf80137e0 con 0x7f6d040acf10 2024-08-17T02:26:45.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.421+0000 7f6d00c00640 1 --2- 172.21.15.6:0/2365870762 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6ce4065150 0x7f6ce4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.421+0000 7f6d00c00640 1 -- 172.21.15.6:0/2365870762 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6cf8082770 con 0x7f6d040acf10 2024-08-17T02:26:45.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.422+0000 7f6d08e00640 1 --2- 172.21.15.6:0/2365870762 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6ce4065150 0x7f6ce4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.423+0000 7f6d08e00640 1 --2- 172.21.15.6:0/2365870762 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6ce4065150 0x7f6ce4067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0034000 tx=0x7f6cf0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.425+0000 7f6d00c00640 1 -- 172.21.15.6:0/2365870762 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6cf8050840 con 0x7f6d040acf10 2024-08-17T02:26:45.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.608+0000 7f6d0c200640 1 -- 172.21.15.6:0/2365870762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6d04169dd0 con 0x7f6d040acf10 2024-08-17T02:26:45.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.608+0000 7f6d00c00640 1 -- 172.21.15.6:0/2365870762 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6cf8021020 con 0x7f6d040acf10 2024-08-17T02:26:45.609 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-08-17T02:26:45.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.610+0000 7f6d0c200640 1 -- 172.21.15.6:0/2365870762 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6ce4065150 msgr2=0x7f6ce4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.610+0000 7f6d0c200640 1 --2- 172.21.15.6:0/2365870762 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6ce4065150 0x7f6ce4067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0034000 tx=0x7f6cf0032000 comp rx=0 tx=0).stop 2024-08-17T02:26:45.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.610+0000 7f6d0c200640 1 -- 172.21.15.6:0/2365870762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d040acf10 msgr2=0x7f6d04152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.610+0000 7f6d0c200640 1 --2- 172.21.15.6:0/2365870762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d040acf10 0x7f6d04152430 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800ecb0 tx=0x7f6cf80090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.610+0000 7f6d0c200640 1 -- 172.21.15.6:0/2365870762 shutdown_connections 2024-08-17T02:26:45.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.610+0000 7f6d0c200640 1 --2- 172.21.15.6:0/2365870762 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6ce4065150 0x7f6ce4067600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.610+0000 7f6d0c200640 1 --2- 172.21.15.6:0/2365870762 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d041589a0 0x7f6d04152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.610+0000 7f6d0c200640 1 --2- 172.21.15.6:0/2365870762 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d040afca0 0x7f6d041570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.610+0000 7f6d0c200640 1 --2- 172.21.15.6:0/2365870762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d040acf10 0x7f6d04152430 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.610+0000 7f6d0c200640 1 -- 172.21.15.6:0/2365870762 >> 172.21.15.6:0/2365870762 conn(0x7f6d04066e60 msgr2=0x7f6d0406ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:45.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.610+0000 7f6d0c200640 1 -- 172.21.15.6:0/2365870762 shutdown_connections 2024-08-17T02:26:45.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.610+0000 7f6d0c200640 1 -- 172.21.15.6:0/2365870762 wait complete. 2024-08-17T02:26:45.625 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:45.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.775+0000 7fc0b6400640 1 Processor -- start 2024-08-17T02:26:45.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.775+0000 7fc0b6400640 1 -- start start 2024-08-17T02:26:45.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.776+0000 7fc0b6400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0b00aea20 0x7fc0b00aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.776+0000 7fc0b6400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc0b00ca8e0 0x7fc0b00cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.776+0000 7fc0b6400640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b00af3a0 con 0x7fc0b0158b90 2024-08-17T02:26:45.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.776+0000 7fc0b6400640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b00afd20 con 0x7fc0b00aea20 2024-08-17T02:26:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.776+0000 7fc0b6400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b00affe0 con 0x7fc0b00ca8e0 2024-08-17T02:26:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.776+0000 7fc0af400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc0b0158b90 0x7fc0b00b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45490/0 (socket says 172.21.15.6:45490) 2024-08-17T02:26:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.776+0000 7fc0aea00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0b00aea20 0x7fc0b00aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.776+0000 7fc0af400640 1 -- 172.21.15.6:0/2345924092 learned_addr learned my addr 172.21.15.6:0/2345924092 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.776+0000 7fc0afe00640 1 --2- 172.21.15.6:0/2345924092 >> v2:172.21.15.136:3300/0 conn(0x7fc0b00ca8e0 0x7fc0b00cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.777+0000 7fc0aea00640 1 -- 172.21.15.6:0/2345924092 >> v2:172.21.15.136:3300/0 conn(0x7fc0b00ca8e0 msgr2=0x7fc0b00cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.777+0000 7fc0aea00640 1 --2- 172.21.15.6:0/2345924092 >> v2:172.21.15.136:3300/0 conn(0x7fc0b00ca8e0 0x7fc0b00cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.777+0000 7fc0aea00640 1 -- 172.21.15.6:0/2345924092 >> v1:172.21.15.6:6789/0 conn(0x7fc0b0158b90 legacy=0x7fc0b00b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.777+0000 7fc0aea00640 1 -- 172.21.15.6:0/2345924092 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b00b02c0 con 0x7fc0b00aea20 2024-08-17T02:26:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.777+0000 7fc0afe00640 1 --2- 172.21.15.6:0/2345924092 >> v2:172.21.15.136:3300/0 conn(0x7fc0b00ca8e0 0x7fc0b00cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.778+0000 7fc0aea00640 1 --2- 172.21.15.6:0/2345924092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0b00aea20 0x7fc0b00aee60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0066fc0 tx=0x7fc09c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5fc4e4b57077f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.778+0000 7fc0ae000640 1 -- 172.21.15.6:0/2345924092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c02adb0 con 0x7fc0b00aea20 2024-08-17T02:26:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.778+0000 7fc0ae000640 1 -- 172.21.15.6:0/2345924092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c032440 con 0x7fc0b00aea20 2024-08-17T02:26:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.778+0000 7fc0ae000640 1 -- 172.21.15.6:0/2345924092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c032820 con 0x7fc0b00aea20 2024-08-17T02:26:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.778+0000 7fc0b6400640 1 -- 172.21.15.6:0/2345924092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0b00aea20 msgr2=0x7fc0b00aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.778+0000 7fc0b6400640 1 --2- 172.21.15.6:0/2345924092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0b00aea20 0x7fc0b00aee60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0066fc0 tx=0x7fc09c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.779+0000 7fc0b6400640 1 -- 172.21.15.6:0/2345924092 shutdown_connections 2024-08-17T02:26:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.779+0000 7fc0b6400640 1 --2- 172.21.15.6:0/2345924092 >> v2:172.21.15.136:3300/0 conn(0x7fc0b00ca8e0 0x7fc0b00cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.779+0000 7fc0b6400640 1 --2- 172.21.15.6:0/2345924092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0b00aea20 0x7fc0b00aee60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.779+0000 7fc0b6400640 1 -- 172.21.15.6:0/2345924092 >> 172.21.15.6:0/2345924092 conn(0x7fc0b006e590 msgr2=0x7fc0b006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.779+0000 7fc0b6400640 1 -- 172.21.15.6:0/2345924092 shutdown_connections 2024-08-17T02:26:45.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.779+0000 7fc0b6400640 1 -- 172.21.15.6:0/2345924092 wait complete. 2024-08-17T02:26:45.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.780+0000 7fc0b6400640 1 Processor -- start 2024-08-17T02:26:45.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.780+0000 7fc0b6400640 1 -- start start 2024-08-17T02:26:45.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.781+0000 7fc0b6400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0b00aea20 0x7fc0b015b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.781+0000 7fc0b6400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0b00ca8e0 0x7fc0b00a6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.781+0000 7fc0b6400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0158b90 0x7fc0b00b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.781+0000 7fc0b6400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b015b4f0 con 0x7fc0b00aea20 2024-08-17T02:26:45.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.781+0000 7fc0b6400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b015a8e0 con 0x7fc0b00ca8e0 2024-08-17T02:26:45.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.781+0000 7fc0b6400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b015abc0 con 0x7fc0b0158b90 2024-08-17T02:26:45.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.781+0000 7fc0af400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0b00aea20 0x7fc0b015b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.781+0000 7fc0af400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0b00aea20 0x7fc0b015b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49040/0 (socket says 172.21.15.6:49040) 2024-08-17T02:26:45.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.781+0000 7fc0af400640 1 -- 172.21.15.6:0/3453061451 learned_addr learned my addr 172.21.15.6:0/3453061451 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:45.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.782+0000 7fc0af400640 1 -- 172.21.15.6:0/3453061451 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0158b90 msgr2=0x7fc0b00b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.782+0000 7fc0af400640 1 --2- 172.21.15.6:0/3453061451 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0158b90 0x7fc0b00b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.782+0000 7fc0af400640 1 -- 172.21.15.6:0/3453061451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0b00ca8e0 msgr2=0x7fc0b00a6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.782+0000 7fc0af400640 1 --2- 172.21.15.6:0/3453061451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0b00ca8e0 0x7fc0b00a6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.782+0000 7fc0af400640 1 -- 172.21.15.6:0/3453061451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c009390 con 0x7fc0b00aea20 2024-08-17T02:26:45.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.782+0000 7fc0af400640 1 --2- 172.21.15.6:0/3453061451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0b00aea20 0x7fc0b015b980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000c7c0 tx=0x7fc0a0007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.782+0000 7fc0a6a00640 1 -- 172.21.15.6:0/3453061451 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a000ce90 con 0x7fc0b00aea20 2024-08-17T02:26:45.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.782+0000 7fc0a6a00640 1 -- 172.21.15.6:0/3453061451 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a0005890 con 0x7fc0b00aea20 2024-08-17T02:26:45.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.782+0000 7fc0a6a00640 1 -- 172.21.15.6:0/3453061451 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0005c90 con 0x7fc0b00aea20 2024-08-17T02:26:45.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.782+0000 7fc0b6400640 1 -- 172.21.15.6:0/3453061451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b015aea0 con 0x7fc0b00aea20 2024-08-17T02:26:45.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.782+0000 7fc0b6400640 1 -- 172.21.15.6:0/3453061451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b00a71a0 con 0x7fc0b00aea20 2024-08-17T02:26:45.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.783+0000 7fc0b6400640 1 -- 172.21.15.6:0/3453061451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b0063fb0 con 0x7fc0b00aea20 2024-08-17T02:26:45.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.784+0000 7fc0a6a00640 1 -- 172.21.15.6:0/3453061451 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc0a0007300 con 0x7fc0b00aea20 2024-08-17T02:26:45.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.785+0000 7fc0a6a00640 1 --2- 172.21.15.6:0/3453061451 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc090065150 0x7fc090067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.785+0000 7fc0a6a00640 1 -- 172.21.15.6:0/3453061451 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc0a0081f60 con 0x7fc0b00aea20 2024-08-17T02:26:45.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.785+0000 7fc0aea00640 1 --2- 172.21.15.6:0/3453061451 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc090065150 0x7fc090067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.786+0000 7fc0aea00640 1 --2- 172.21.15.6:0/3453061451 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc090065150 0x7fc090067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc09c034000 tx=0x7fc09c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:45.788+0000 7fc0a6a00640 1 -- 172.21.15.6:0/3453061451 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc0a0050000 con 0x7fc0b00aea20 2024-08-17T02:26:46.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.007+0000 7fc0b6400640 1 -- 172.21.15.6:0/3453061451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0b00b3600 con 0x7fc0b00aea20 2024-08-17T02:26:46.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.008+0000 7fc0a6a00640 1 -- 172.21.15.6:0/3453061451 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4582 (secure 0 0 0) 0x7fc0a0053620 con 0x7fc0b00aea20 2024-08-17T02:26:46.009 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:46.009 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/881817227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":881817227},{"type":"v1","addr":"172.21.15.6:6833","nonce":881817227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/546855411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":546855411},{"type":"v1","addr":"172.21.15.6:6835","nonce":546855411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/539185499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":539185499},{"type":"v1","addr":"172.21.15.136:6837","nonce":539185499}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:31.615645+0000","modified":"2024-08-17T02:26:35.207397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/2230598578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2230598578},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230598578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:46.009 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2024-08-17T02:26:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.010+0000 7fc0b6400640 1 -- 172.21.15.6:0/3453061451 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc090065150 msgr2=0x7fc090067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.010+0000 7fc0b6400640 1 --2- 172.21.15.6:0/3453061451 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc090065150 0x7fc090067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc09c034000 tx=0x7fc09c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.010+0000 7fc0b6400640 1 -- 172.21.15.6:0/3453061451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0b00aea20 msgr2=0x7fc0b015b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.010+0000 7fc0b6400640 1 --2- 172.21.15.6:0/3453061451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0b00aea20 0x7fc0b015b980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000c7c0 tx=0x7fc0a0007ed0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.010+0000 7fc0b6400640 1 -- 172.21.15.6:0/3453061451 shutdown_connections 2024-08-17T02:26:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.010+0000 7fc0b6400640 1 --2- 172.21.15.6:0/3453061451 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc090065150 0x7fc090067600 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.010+0000 7fc0b6400640 1 --2- 172.21.15.6:0/3453061451 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0158b90 0x7fc0b00b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.010+0000 7fc0b6400640 1 --2- 172.21.15.6:0/3453061451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0b00ca8e0 0x7fc0b00a6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.010+0000 7fc0b6400640 1 --2- 172.21.15.6:0/3453061451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0b00aea20 0x7fc0b015b980 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.010+0000 7fc0b6400640 1 -- 172.21.15.6:0/3453061451 >> 172.21.15.6:0/3453061451 conn(0x7fc0b006e590 msgr2=0x7fc0b00b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.011+0000 7fc0b6400640 1 -- 172.21.15.6:0/3453061451 shutdown_connections 2024-08-17T02:26:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.011+0000 7fc0b6400640 1 -- 172.21.15.6:0/3453061451 wait complete. 2024-08-17T02:26:46.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:46.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.177+0000 7fbe0de00640 1 Processor -- start 2024-08-17T02:26:46.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.177+0000 7fbe0de00640 1 -- start start 2024-08-17T02:26:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.178+0000 7fbe0de00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbe080aea20 0x7fbe080aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.178+0000 7fbe0de00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe080ca8e0 0x7fbe080cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.178+0000 7fbe0de00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe080af3a0 con 0x7fbe08158b90 2024-08-17T02:26:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.178+0000 7fbe0de00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe080afd20 con 0x7fbe080ca8e0 2024-08-17T02:26:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.178+0000 7fbe0de00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe080affe0 con 0x7fbe080aea20 2024-08-17T02:26:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.179+0000 7fbe06a00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbe08158b90 0x7fbe080b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45502/0 (socket says 172.21.15.6:45502) 2024-08-17T02:26:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.179+0000 7fbe06a00640 1 -- 172.21.15.6:0/1473500402 learned_addr learned my addr 172.21.15.6:0/1473500402 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.179+0000 7fbe07400640 1 --2- 172.21.15.6:0/1473500402 >> v2:172.21.15.6:3300/0 conn(0x7fbe080ca8e0 0x7fbe080cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.179+0000 7fbe06000640 1 --2- 172.21.15.6:0/1473500402 >> v2:172.21.15.136:3300/0 conn(0x7fbe080aea20 0x7fbe080aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.179+0000 7fbe07400640 1 -- 172.21.15.6:0/1473500402 >> v2:172.21.15.136:3300/0 conn(0x7fbe080aea20 msgr2=0x7fbe080aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:46.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.179+0000 7fbe07400640 1 --2- 172.21.15.6:0/1473500402 >> v2:172.21.15.136:3300/0 conn(0x7fbe080aea20 0x7fbe080aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.179+0000 7fbe07400640 1 -- 172.21.15.6:0/1473500402 >> v1:172.21.15.6:6789/0 conn(0x7fbe08158b90 legacy=0x7fbe080b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.179+0000 7fbe05600640 1 -- 172.21.15.6:0/1473500402 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706488601 0 0) 0x7fbe080af3a0 con 0x7fbe08158b90 2024-08-17T02:26:46.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.179+0000 7fbe07400640 1 -- 172.21.15.6:0/1473500402 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe080b02c0 con 0x7fbe080ca8e0 2024-08-17T02:26:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.180+0000 7fbe07400640 1 --2- 172.21.15.6:0/1473500402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080ca8e0 0x7fbe080cacb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbe080b56c0 tx=0x7fbe00009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e781097bf32f4d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.180+0000 7fbe05600640 1 -- 172.21.15.6:0/1473500402 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00007550 con 0x7fbe080ca8e0 2024-08-17T02:26:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.180+0000 7fbe05600640 1 -- 172.21.15.6:0/1473500402 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0002d050 con 0x7fbe080ca8e0 2024-08-17T02:26:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.180+0000 7fbe05600640 1 -- 172.21.15.6:0/1473500402 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe000078e0 con 0x7fbe080ca8e0 2024-08-17T02:26:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.181+0000 7fbe0de00640 1 -- 172.21.15.6:0/1473500402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080ca8e0 msgr2=0x7fbe080cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.181+0000 7fbe0de00640 1 --2- 172.21.15.6:0/1473500402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080ca8e0 0x7fbe080cacb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbe080b56c0 tx=0x7fbe00009780 comp rx=0 tx=0).stop 2024-08-17T02:26:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.181+0000 7fbe0de00640 1 -- 172.21.15.6:0/1473500402 shutdown_connections 2024-08-17T02:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.181+0000 7fbe0de00640 1 --2- 172.21.15.6:0/1473500402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080ca8e0 0x7fbe080cacb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.181+0000 7fbe0de00640 1 --2- 172.21.15.6:0/1473500402 >> v2:172.21.15.136:3300/0 conn(0x7fbe080aea20 0x7fbe080aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.181+0000 7fbe0de00640 1 -- 172.21.15.6:0/1473500402 >> 172.21.15.6:0/1473500402 conn(0x7fbe0806e590 msgr2=0x7fbe0806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.181+0000 7fbe0de00640 1 -- 172.21.15.6:0/1473500402 shutdown_connections 2024-08-17T02:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.181+0000 7fbe0de00640 1 -- 172.21.15.6:0/1473500402 wait complete. 2024-08-17T02:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.182+0000 7fbe0de00640 1 Processor -- start 2024-08-17T02:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.183+0000 7fbe0de00640 1 -- start start 2024-08-17T02:26:46.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.183+0000 7fbe0de00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbe080aea20 0x7fbe08158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.183+0000 7fbe0de00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080ca8e0 0x7fbe080c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.183+0000 7fbe0de00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe08158b90 0x7fbe080cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.183+0000 7fbe0de00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08168c60 con 0x7fbe080ca8e0 2024-08-17T02:26:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.183+0000 7fbe0de00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08168e70 con 0x7fbe08158b90 2024-08-17T02:26:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.183+0000 7fbe0de00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080c9950 con 0x7fbe080aea20 2024-08-17T02:26:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.184+0000 7fbe06000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080ca8e0 0x7fbe080c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.184+0000 7fbe06000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080ca8e0 0x7fbe080c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49064/0 (socket says 172.21.15.6:49064) 2024-08-17T02:26:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.184+0000 7fbe06000640 1 -- 172.21.15.6:0/1653326467 learned_addr learned my addr 172.21.15.6:0/1653326467 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.184+0000 7fbe07400640 1 --2- 172.21.15.6:0/1653326467 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe08158b90 0x7fbe080cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.184+0000 7fbe06a00640 1 --2- 172.21.15.6:0/1653326467 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbe080aea20 0x7fbe08158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.184+0000 7fbe06000640 1 -- 172.21.15.6:0/1653326467 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbe080aea20 msgr2=0x7fbe08158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.184+0000 7fbe06000640 1 --2- 172.21.15.6:0/1653326467 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbe080aea20 0x7fbe08158150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.184+0000 7fbe06000640 1 -- 172.21.15.6:0/1653326467 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe08158b90 msgr2=0x7fbe080cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.184+0000 7fbe06000640 1 --2- 172.21.15.6:0/1653326467 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe08158b90 0x7fbe080cfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.184+0000 7fbe06000640 1 -- 172.21.15.6:0/1653326467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe00009a20 con 0x7fbe080ca8e0 2024-08-17T02:26:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.184+0000 7fbe07400640 1 --2- 172.21.15.6:0/1653326467 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe08158b90 0x7fbe080cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.184+0000 7fbe06000640 1 --2- 172.21.15.6:0/1653326467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080ca8e0 0x7fbe080c89b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400e900 tx=0x7fbdf40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.184+0000 7fbdfe000640 1 -- 172.21.15.6:0/1653326467 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400c8e0 con 0x7fbe080ca8e0 2024-08-17T02:26:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.185+0000 7fbdfe000640 1 -- 172.21.15.6:0/1653326467 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf400ca40 con 0x7fbe080ca8e0 2024-08-17T02:26:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.185+0000 7fbe0de00640 1 -- 172.21.15.6:0/1653326467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe080c9390 con 0x7fbe080ca8e0 2024-08-17T02:26:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.185+0000 7fbdfe000640 1 -- 172.21.15.6:0/1653326467 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400cde0 con 0x7fbe080ca8e0 2024-08-17T02:26:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.185+0000 7fbe0de00640 1 -- 172.21.15.6:0/1653326467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe080c9720 con 0x7fbe080ca8e0 2024-08-17T02:26:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.186+0000 7fbe0de00640 1 -- 172.21.15.6:0/1653326467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe081587e0 con 0x7fbe080ca8e0 2024-08-17T02:26:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.187+0000 7fbdfe000640 1 -- 172.21.15.6:0/1653326467 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbdf4013680 con 0x7fbe080ca8e0 2024-08-17T02:26:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.188+0000 7fbdfe000640 1 --2- 172.21.15.6:0/1653326467 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbde8065150 0x7fbde8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.188+0000 7fbdfe000640 1 -- 172.21.15.6:0/1653326467 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbdf4082670 con 0x7fbe080ca8e0 2024-08-17T02:26:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.188+0000 7fbe06a00640 1 --2- 172.21.15.6:0/1653326467 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbde8065150 0x7fbde8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.189+0000 7fbe06a00640 1 --2- 172.21.15.6:0/1653326467 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbde8065150 0x7fbde8067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbe080af6b0 tx=0x7fbdf8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.191+0000 7fbdfe000640 1 -- 172.21.15.6:0/1653326467 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbdf4050730 con 0x7fbe080ca8e0 2024-08-17T02:26:46.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.376+0000 7fbe0de00640 1 -- 172.21.15.6:0/1653326467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe08063fb0 con 0x7fbe080ca8e0 2024-08-17T02:26:46.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.377+0000 7fbdfe000640 1 -- 172.21.15.6:0/1653326467 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fbdf4053d50 con 0x7fbe080ca8e0 2024-08-17T02:26:46.378 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:46.378 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:33.190571+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:29.257601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:30.596556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:46.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.379+0000 7fbe0de00640 1 -- 172.21.15.6:0/1653326467 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbde8065150 msgr2=0x7fbde8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.379+0000 7fbe0de00640 1 --2- 172.21.15.6:0/1653326467 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbde8065150 0x7fbde8067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbe080af6b0 tx=0x7fbdf8009040 comp rx=0 tx=0).stop 2024-08-17T02:26:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.379+0000 7fbe0de00640 1 -- 172.21.15.6:0/1653326467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080ca8e0 msgr2=0x7fbe080c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.379+0000 7fbe0de00640 1 --2- 172.21.15.6:0/1653326467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080ca8e0 0x7fbe080c89b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400e900 tx=0x7fbdf40090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.379+0000 7fbe0de00640 1 -- 172.21.15.6:0/1653326467 shutdown_connections 2024-08-17T02:26:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.379+0000 7fbe0de00640 1 --2- 172.21.15.6:0/1653326467 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbde8065150 0x7fbde8067600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.379+0000 7fbe0de00640 1 --2- 172.21.15.6:0/1653326467 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe08158b90 0x7fbe080cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.379+0000 7fbe0de00640 1 --2- 172.21.15.6:0/1653326467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080ca8e0 0x7fbe080c89b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.379+0000 7fbe0de00640 1 --2- 172.21.15.6:0/1653326467 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbe080aea20 0x7fbe08158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.379+0000 7fbe0de00640 1 -- 172.21.15.6:0/1653326467 >> 172.21.15.6:0/1653326467 conn(0x7fbe0806e590 msgr2=0x7fbe080cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.380+0000 7fbe0de00640 1 -- 172.21.15.6:0/1653326467 shutdown_connections 2024-08-17T02:26:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.380+0000 7fbe0de00640 1 -- 172.21.15.6:0/1653326467 wait complete. 2024-08-17T02:26:46.397 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:46.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.547+0000 7f50dd000640 1 Processor -- start 2024-08-17T02:26:46.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.547+0000 7f50dd000640 1 -- start start 2024-08-17T02:26:46.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.548+0000 7f50dd000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50d81590b0 0x7f50d80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.548+0000 7f50dd000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50d80acf10 0x7f50d8159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.548+0000 7f50dd000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d815a4e0 con 0x7f50d80afca0 2024-08-17T02:26:46.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.548+0000 7f50dd000640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d80b0980 con 0x7f50d80acf10 2024-08-17T02:26:46.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.548+0000 7f50dd000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d80c92b0 con 0x7f50d81590b0 2024-08-17T02:26:46.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.548+0000 7f50d6800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50d80acf10 0x7f50d8159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.548+0000 7f50d6800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50d80acf10 0x7f50d8159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49066/0 (socket says 172.21.15.6:49066) 2024-08-17T02:26:46.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.548+0000 7f50d6800640 1 -- 172.21.15.6:0/2288904705 learned_addr learned my addr 172.21.15.6:0/2288904705 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:46.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.549+0000 7f50cfe00640 1 --2- 172.21.15.6:0/2288904705 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50d81590b0 0x7f50d80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.549+0000 7f50d6800640 1 -- 172.21.15.6:0/2288904705 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50d81590b0 msgr2=0x7f50d80b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:46.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.549+0000 7f50d6800640 1 --2- 172.21.15.6:0/2288904705 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50d81590b0 0x7f50d80b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.549+0000 7f50d6800640 1 -- 172.21.15.6:0/2288904705 >> v1:172.21.15.136:6789/0 conn(0x7f50d80afca0 legacy=0x7f50d81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.549+0000 7f50d6800640 1 -- 172.21.15.6:0/2288904705 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d80ad480 con 0x7f50d80acf10 2024-08-17T02:26:46.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.550+0000 7f50d6800640 1 --2- 172.21.15.6:0/2288904705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d80acf10 0x7f50d8159fa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009f20 tx=0x7f50d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f212ab658731405 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.550+0000 7f50d5400640 1 -- 172.21.15.6:0/2288904705 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0031400 con 0x7f50d80acf10 2024-08-17T02:26:46.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.550+0000 7f50d5400640 1 -- 172.21.15.6:0/2288904705 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d002d050 con 0x7f50d80acf10 2024-08-17T02:26:46.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.550+0000 7f50d5400640 1 -- 172.21.15.6:0/2288904705 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d00317d0 con 0x7f50d80acf10 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.550+0000 7f50dd000640 1 -- 172.21.15.6:0/2288904705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d80acf10 msgr2=0x7f50d8159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.550+0000 7f50dd000640 1 --2- 172.21.15.6:0/2288904705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d80acf10 0x7f50d8159fa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009f20 tx=0x7f50d0009840 comp rx=0 tx=0).stop 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.551+0000 7f50dd000640 1 -- 172.21.15.6:0/2288904705 shutdown_connections 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.551+0000 7f50dd000640 1 --2- 172.21.15.6:0/2288904705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d80acf10 0x7f50d8159fa0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.551+0000 7f50dd000640 1 --2- 172.21.15.6:0/2288904705 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50d81590b0 0x7f50d80b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.551+0000 7f50dd000640 1 -- 172.21.15.6:0/2288904705 >> 172.21.15.6:0/2288904705 conn(0x7f50d8066e60 msgr2=0x7f50d8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.551+0000 7f50dd000640 1 -- 172.21.15.6:0/2288904705 shutdown_connections 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.551+0000 7f50dd000640 1 -- 172.21.15.6:0/2288904705 wait complete. 2024-08-17T02:26:46.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.552+0000 7f50dd000640 1 Processor -- start 2024-08-17T02:26:46.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.552+0000 7f50dd000640 1 -- start start 2024-08-17T02:26:46.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.553+0000 7f50dd000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50d80acf10 0x7f50d816c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.553+0000 7f50dd000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50d80afca0 0x7f50d806a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.553+0000 7f50dd000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d81590b0 0x7f50d806a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.553+0000 7f50dd000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d8151340 con 0x7f50d81590b0 2024-08-17T02:26:46.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.553+0000 7f50dd000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d816c9b0 con 0x7f50d80afca0 2024-08-17T02:26:46.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.553+0000 7f50dd000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d816cc90 con 0x7f50d80acf10 2024-08-17T02:26:46.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.553+0000 7f50d6800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d81590b0 0x7f50d806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.553+0000 7f50cfe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50d80afca0 0x7f50d806a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.553+0000 7f50d5e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50d80acf10 0x7f50d816c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.553+0000 7f50d6800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d81590b0 0x7f50d806a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49074/0 (socket says 172.21.15.6:49074) 2024-08-17T02:26:46.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.554+0000 7f50d6800640 1 -- 172.21.15.6:0/1634605817 learned_addr learned my addr 172.21.15.6:0/1634605817 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:46.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.554+0000 7f50d6800640 1 -- 172.21.15.6:0/1634605817 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50d80acf10 msgr2=0x7f50d816c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.554+0000 7f50d6800640 1 --2- 172.21.15.6:0/1634605817 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50d80acf10 0x7f50d816c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.554+0000 7f50d6800640 1 -- 172.21.15.6:0/1634605817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50d80afca0 msgr2=0x7f50d806a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.554+0000 7f50d6800640 1 --2- 172.21.15.6:0/1634605817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50d80afca0 0x7f50d806a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.554+0000 7f50d6800640 1 -- 172.21.15.6:0/1634605817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d0009ae0 con 0x7f50d81590b0 2024-08-17T02:26:46.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.554+0000 7f50d6800640 1 --2- 172.21.15.6:0/1634605817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d81590b0 0x7f50d806a610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009f20 tx=0x7f50d0036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.554+0000 7f50cd600640 1 -- 172.21.15.6:0/1634605817 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0008e50 con 0x7f50d81590b0 2024-08-17T02:26:46.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.555+0000 7f50cd600640 1 -- 172.21.15.6:0/1634605817 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d003b410 con 0x7f50d81590b0 2024-08-17T02:26:46.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.555+0000 7f50cd600640 1 -- 172.21.15.6:0/1634605817 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d003b7d0 con 0x7f50d81590b0 2024-08-17T02:26:46.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.555+0000 7f50dd000640 1 -- 172.21.15.6:0/1634605817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d8150fd0 con 0x7f50d81590b0 2024-08-17T02:26:46.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.555+0000 7f50dd000640 1 -- 172.21.15.6:0/1634605817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d80c4bf0 con 0x7f50d81590b0 2024-08-17T02:26:46.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.556+0000 7f50dd000640 1 -- 172.21.15.6:0/1634605817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d81514f0 con 0x7f50d81590b0 2024-08-17T02:26:46.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.556+0000 7f50cd600640 1 -- 172.21.15.6:0/1634605817 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f50d0038050 con 0x7f50d81590b0 2024-08-17T02:26:46.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.557+0000 7f50cd600640 1 --2- 172.21.15.6:0/1634605817 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f50b4065150 0x7f50b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.557+0000 7f50cd600640 1 -- 172.21.15.6:0/1634605817 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50d00a3550 con 0x7f50d81590b0 2024-08-17T02:26:46.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.557+0000 7f50d5e00640 1 --2- 172.21.15.6:0/1634605817 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f50b4065150 0x7f50b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.558+0000 7f50d5e00640 1 --2- 172.21.15.6:0/1634605817 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f50b4065150 0x7f50b4067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f50d814ffd0 tx=0x7f50c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.561+0000 7f50cd600640 1 -- 172.21.15.6:0/1634605817 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f50d81514f0 con 0x7f50d81590b0 2024-08-17T02:26:46.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.783+0000 7f50dd000640 1 -- 172.21.15.6:0/1634605817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50d8063fb0 con 0x7f50d81590b0 2024-08-17T02:26:46.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.783+0000 7f50cd600640 1 -- 172.21.15.6:0/1634605817 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4582 (secure 0 0 0) 0x7f50d0071620 con 0x7f50d81590b0 2024-08-17T02:26:46.784 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:46.784 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/881817227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":881817227},{"type":"v1","addr":"172.21.15.6:6833","nonce":881817227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/546855411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":546855411},{"type":"v1","addr":"172.21.15.6:6835","nonce":546855411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/539185499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":539185499},{"type":"v1","addr":"172.21.15.136:6837","nonce":539185499}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:31.615645+0000","modified":"2024-08-17T02:26:35.207397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/2230598578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2230598578},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230598578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:46.784 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2024-08-17T02:26:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.785+0000 7f50dd000640 1 -- 172.21.15.6:0/1634605817 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f50b4065150 msgr2=0x7f50b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.785+0000 7f50dd000640 1 --2- 172.21.15.6:0/1634605817 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f50b4065150 0x7f50b4067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f50d814ffd0 tx=0x7f50c8009040 comp rx=0 tx=0).stop 2024-08-17T02:26:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.786+0000 7f50dd000640 1 -- 172.21.15.6:0/1634605817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d81590b0 msgr2=0x7f50d806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.786+0000 7f50dd000640 1 --2- 172.21.15.6:0/1634605817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d81590b0 0x7f50d806a610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009f20 tx=0x7f50d0036000 comp rx=0 tx=0).stop 2024-08-17T02:26:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.786+0000 7f50dd000640 1 -- 172.21.15.6:0/1634605817 shutdown_connections 2024-08-17T02:26:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.786+0000 7f50dd000640 1 --2- 172.21.15.6:0/1634605817 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f50b4065150 0x7f50b4067600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.786+0000 7f50dd000640 1 --2- 172.21.15.6:0/1634605817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d81590b0 0x7f50d806a610 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.786+0000 7f50dd000640 1 --2- 172.21.15.6:0/1634605817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50d80afca0 0x7f50d806a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.786+0000 7f50dd000640 1 --2- 172.21.15.6:0/1634605817 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50d80acf10 0x7f50d816c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.786+0000 7f50dd000640 1 -- 172.21.15.6:0/1634605817 >> 172.21.15.6:0/1634605817 conn(0x7f50d8066e60 msgr2=0x7f50d806b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.786+0000 7f50dd000640 1 -- 172.21.15.6:0/1634605817 shutdown_connections 2024-08-17T02:26:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:46.786+0000 7f50dd000640 1 -- 172.21.15.6:0/1634605817 wait complete. 2024-08-17T02:26:47.203 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:26:31.615645+0000', 'modified': '2024-08-17T02:26:35.207397+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.136:6835/2230598578', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6834', 'nonce': 2230598578}, {'type': 'v1', 'addr': '172.21.15.136:6835', 'nonce': 2230598578}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:26:47.203 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:26:47.204 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-08-17T02:26:47.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.356+0000 7f3c6fe00640 1 Processor -- start 2024-08-17T02:26:47.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.356+0000 7f3c6fe00640 1 -- start start 2024-08-17T02:26:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.358+0000 7f3c6fe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3c700abdf0 0x7f3c70159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.358+0000 7f3c6fe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c701599b0 0x7f3c700acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.358+0000 7f3c6fe00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c700c92b0 con 0x7f3c700ad1a0 2024-08-17T02:26:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.358+0000 7f3c6fe00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c700ad620 con 0x7f3c701599b0 2024-08-17T02:26:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.358+0000 7f3c6fe00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c700c8ca0 con 0x7f3c700abdf0 2024-08-17T02:26:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.358+0000 7f3c6e000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c701599b0 0x7f3c700acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.358+0000 7f3c6e000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c701599b0 0x7f3c700acc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49076/0 (socket says 172.21.15.6:49076) 2024-08-17T02:26:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.358+0000 7f3c6f400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3c700ad1a0 0x7f3c7006d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45514/0 (socket says 172.21.15.6:45514) 2024-08-17T02:26:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.358+0000 7f3c6e000640 1 -- 172.21.15.6:0/142401289 learned_addr learned my addr 172.21.15.6:0/142401289 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.358+0000 7f3c6ea00640 1 --2- 172.21.15.6:0/142401289 >> v2:172.21.15.136:3300/0 conn(0x7f3c700abdf0 0x7f3c70159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.358+0000 7f3c6e000640 1 -- 172.21.15.6:0/142401289 >> v2:172.21.15.136:3300/0 conn(0x7f3c700abdf0 msgr2=0x7f3c70159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.358+0000 7f3c6e000640 1 --2- 172.21.15.6:0/142401289 >> v2:172.21.15.136:3300/0 conn(0x7f3c700abdf0 0x7f3c70159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.358+0000 7f3c6e000640 1 -- 172.21.15.6:0/142401289 >> v1:172.21.15.6:6789/0 conn(0x7f3c700ad1a0 legacy=0x7f3c7006d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.358+0000 7f3c6e000640 1 -- 172.21.15.6:0/142401289 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c70159ec0 con 0x7f3c701599b0 2024-08-17T02:26:47.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.359+0000 7f3c6e000640 1 --2- 172.21.15.6:0/142401289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c701599b0 0x7f3c700acc60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3c700688c0 tx=0x7f3c5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b270fb0f652cbba server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.360+0000 7f3c6d600640 1 -- 172.21.15.6:0/142401289 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c02ae80 con 0x7f3c701599b0 2024-08-17T02:26:47.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.360+0000 7f3c6d600640 1 -- 172.21.15.6:0/142401289 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c032440 con 0x7f3c701599b0 2024-08-17T02:26:47.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.360+0000 7f3c6d600640 1 -- 172.21.15.6:0/142401289 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c032800 con 0x7f3c701599b0 2024-08-17T02:26:47.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.360+0000 7f3c6fe00640 1 -- 172.21.15.6:0/142401289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c701599b0 msgr2=0x7f3c700acc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.360+0000 7f3c6fe00640 1 --2- 172.21.15.6:0/142401289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c701599b0 0x7f3c700acc60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3c700688c0 tx=0x7f3c5c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.360+0000 7f3c6fe00640 1 -- 172.21.15.6:0/142401289 shutdown_connections 2024-08-17T02:26:47.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.360+0000 7f3c6fe00640 1 --2- 172.21.15.6:0/142401289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c701599b0 0x7f3c700acc60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.360+0000 7f3c6fe00640 1 --2- 172.21.15.6:0/142401289 >> v2:172.21.15.136:3300/0 conn(0x7f3c700abdf0 0x7f3c70159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.360+0000 7f3c6fe00640 1 -- 172.21.15.6:0/142401289 >> 172.21.15.6:0/142401289 conn(0x7f3c70066e60 msgr2=0x7f3c70067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.360+0000 7f3c6fe00640 1 -- 172.21.15.6:0/142401289 shutdown_connections 2024-08-17T02:26:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.360+0000 7f3c6fe00640 1 -- 172.21.15.6:0/142401289 wait complete. 2024-08-17T02:26:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.362+0000 7f3c6fe00640 1 Processor -- start 2024-08-17T02:26:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.362+0000 7f3c6fe00640 1 -- start start 2024-08-17T02:26:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.363+0000 7f3c6fe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3c700abdf0 0x7f3c700a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.363+0000 7f3c6fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c700ad1a0 0x7f3c70147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.363+0000 7f3c6fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c701599b0 0x7f3c700af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.363+0000 7f3c6fe00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7016a1c0 con 0x7f3c700ad1a0 2024-08-17T02:26:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.363+0000 7f3c6fe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7016a3a0 con 0x7f3c701599b0 2024-08-17T02:26:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.363+0000 7f3c6fe00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7016a680 con 0x7f3c700abdf0 2024-08-17T02:26:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.363+0000 7f3c6e000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c700ad1a0 0x7f3c70147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.363+0000 7f3c6e000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c700ad1a0 0x7f3c70147360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49078/0 (socket says 172.21.15.6:49078) 2024-08-17T02:26:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.363+0000 7f3c6e000640 1 -- 172.21.15.6:0/2266422342 learned_addr learned my addr 172.21.15.6:0/2266422342 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.363+0000 7f3c6e000640 1 -- 172.21.15.6:0/2266422342 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3c700abdf0 msgr2=0x7f3c700a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.363+0000 7f3c6e000640 1 --2- 172.21.15.6:0/2266422342 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3c700abdf0 0x7f3c700a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.363+0000 7f3c6e000640 1 -- 172.21.15.6:0/2266422342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c701599b0 msgr2=0x7f3c700af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.363+0000 7f3c6e000640 1 --2- 172.21.15.6:0/2266422342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c701599b0 0x7f3c700af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.363+0000 7f3c6e000640 1 -- 172.21.15.6:0/2266422342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c009450 con 0x7f3c700ad1a0 2024-08-17T02:26:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.364+0000 7f3c6e000640 1 --2- 172.21.15.6:0/2266422342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c700ad1a0 0x7f3c70147360 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009210 tx=0x7f3c5c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.364+0000 7f3c66000640 1 -- 172.21.15.6:0/2266422342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c031de0 con 0x7f3c700ad1a0 2024-08-17T02:26:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.364+0000 7f3c66000640 1 -- 172.21.15.6:0/2266422342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c000c40 con 0x7f3c700ad1a0 2024-08-17T02:26:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.364+0000 7f3c66000640 1 -- 172.21.15.6:0/2266422342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c03d670 con 0x7f3c700ad1a0 2024-08-17T02:26:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.364+0000 7f3c6fe00640 1 -- 172.21.15.6:0/2266422342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7016a960 con 0x7f3c700ad1a0 2024-08-17T02:26:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.364+0000 7f3c6fe00640 1 -- 172.21.15.6:0/2266422342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c700a4c10 con 0x7f3c700ad1a0 2024-08-17T02:26:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.366+0000 7f3c66000640 1 -- 172.21.15.6:0/2266422342 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3c5c039040 con 0x7f3c700ad1a0 2024-08-17T02:26:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.367+0000 7f3c66000640 1 --2- 172.21.15.6:0/2266422342 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3c50065220 0x7f3c500676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.367+0000 7f3c66000640 1 -- 172.21.15.6:0/2266422342 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c5c0a2830 con 0x7f3c700ad1a0 2024-08-17T02:26:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.367+0000 7f3c6ea00640 1 --2- 172.21.15.6:0/2266422342 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3c50065220 0x7f3c500676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.367+0000 7f3c783e8740 1 Processor -- start 2024-08-17T02:26:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.368+0000 7f3c783e8740 1 -- start start 2024-08-17T02:26:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.368+0000 7f3c6ea00640 1 --2- 172.21.15.6:0/2266422342 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3c50065220 0x7f3c500676d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3c700cb6f0 tx=0x7f3c60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.368+0000 7f3c783e8740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd743bc0 0x5596bd743f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.368+0000 7f3c783e8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd71f230 0x5596bd761760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.368+0000 7f3c783e8740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd761ca0 0x5596bd718a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.368+0000 7f3c783e8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596bd6d9380 con 0x5596bd71f230 2024-08-17T02:26:47.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.368+0000 7f3c783e8740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596bd6829e0 con 0x5596bd761ca0 2024-08-17T02:26:47.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.368+0000 7f3c783e8740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596bd680170 con 0x5596bd743bc0 2024-08-17T02:26:47.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.369+0000 7f3c6e000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd71f230 0x5596bd761760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.369+0000 7f3c6e000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd71f230 0x5596bd761760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49084/0 (socket says 172.21.15.6:49084) 2024-08-17T02:26:47.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.369+0000 7f3c6e000640 1 -- 172.21.15.6:0/1231583373 learned_addr learned my addr 172.21.15.6:0/1231583373 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:47.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.369+0000 7f3c6f400640 1 --2- 172.21.15.6:0/1231583373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd761ca0 0x5596bd718a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.369+0000 7f3c6ea00640 1 --2- 172.21.15.6:0/1231583373 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd743bc0 0x5596bd743f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.369+0000 7f3c6e000640 1 -- 172.21.15.6:0/1231583373 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd743bc0 msgr2=0x5596bd743f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.369+0000 7f3c6e000640 1 --2- 172.21.15.6:0/1231583373 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd743bc0 0x5596bd743f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.369+0000 7f3c6e000640 1 -- 172.21.15.6:0/1231583373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd761ca0 msgr2=0x5596bd718a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.369+0000 7f3c6e000640 1 --2- 172.21.15.6:0/1231583373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd761ca0 0x5596bd718a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.369+0000 7f3c6e000640 1 -- 172.21.15.6:0/1231583373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596bd62f820 con 0x5596bd71f230 2024-08-17T02:26:47.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.369+0000 7f3c6f400640 1 --2- 172.21.15.6:0/1231583373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd761ca0 0x5596bd718a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:47.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.369+0000 7f3c6e000640 1 --2- 172.21.15.6:0/1231583373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd71f230 0x5596bd761760 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c074520 tx=0x7f3c5c0a0c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b93d9ef219958 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.369+0000 7f3c5aa00640 1 -- 172.21.15.6:0/1231583373 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c074650 con 0x5596bd71f230 2024-08-17T02:26:47.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.369+0000 7f3c5aa00640 1 -- 172.21.15.6:0/1231583373 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c0778a0 con 0x5596bd71f230 2024-08-17T02:26:47.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.370+0000 7f3c5aa00640 1 -- 172.21.15.6:0/1231583373 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c07b5f0 con 0x5596bd71f230 2024-08-17T02:26:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.370+0000 7f3c783e8740 1 -- 172.21.15.6:0/1231583373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd71f230 msgr2=0x5596bd761760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.370+0000 7f3c783e8740 1 --2- 172.21.15.6:0/1231583373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd71f230 0x5596bd761760 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c074520 tx=0x7f3c5c0a0c10 comp rx=0 tx=0).stop 2024-08-17T02:26:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.370+0000 7f3c783e8740 1 -- 172.21.15.6:0/1231583373 shutdown_connections 2024-08-17T02:26:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.370+0000 7f3c783e8740 1 --2- 172.21.15.6:0/1231583373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd761ca0 0x5596bd718a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.370+0000 7f3c783e8740 1 --2- 172.21.15.6:0/1231583373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd71f230 0x5596bd761760 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.370+0000 7f3c783e8740 1 --2- 172.21.15.6:0/1231583373 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd743bc0 0x5596bd743f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.370+0000 7f3c783e8740 1 -- 172.21.15.6:0/1231583373 >> 172.21.15.6:0/1231583373 conn(0x5596bd6b7030 msgr2=0x5596bd765e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.370+0000 7f3c783e8740 1 -- 172.21.15.6:0/1231583373 shutdown_connections 2024-08-17T02:26:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.370+0000 7f3c783e8740 1 -- 172.21.15.6:0/1231583373 wait complete. 2024-08-17T02:26:47.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.371+0000 7f3c783e8740 1 -- start start 2024-08-17T02:26:47.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.371+0000 7f3c783e8740 1 Processor -- start 2024-08-17T02:26:47.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.372+0000 7f3c783e8740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd71f230 0x5596bd7185d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.372+0000 7f3c783e8740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd743bc0 0x5596bd746600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.372+0000 7f3c783e8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd761ca0 0x5596bd745320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.372+0000 7f3c783e8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596bd67bf60 con 0x5596bd761ca0 2024-08-17T02:26:47.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.372+0000 7f3c783e8740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596bd624690 con 0x5596bd743bc0 2024-08-17T02:26:47.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.372+0000 7f3c783e8740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596bd624330 con 0x5596bd71f230 2024-08-17T02:26:47.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.372+0000 7f3c783e8740 10 client.0 _ll_register_callbacks cb 0x5596bd61e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:26:47.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.372+0000 7f3c6f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd761ca0 0x5596bd745320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.372+0000 7f3c6f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd761ca0 0x5596bd745320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49094/0 (socket says 172.21.15.6:49094) 2024-08-17T02:26:47.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.372+0000 7f3c6f400640 1 -- 172.21.15.6:0/164225666 learned_addr learned my addr 172.21.15.6:0/164225666 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:47.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.372+0000 7f3c6ea00640 1 --2- 172.21.15.6:0/164225666 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd71f230 0x5596bd7185d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.372+0000 7f3c6e000640 1 --2- 172.21.15.6:0/164225666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd743bc0 0x5596bd746600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.373+0000 7f3c6f400640 1 -- 172.21.15.6:0/164225666 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd71f230 msgr2=0x5596bd7185d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.373+0000 7f3c6f400640 1 --2- 172.21.15.6:0/164225666 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd71f230 0x5596bd7185d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.373+0000 7f3c6f400640 1 -- 172.21.15.6:0/164225666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd743bc0 msgr2=0x5596bd746600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.373+0000 7f3c6f400640 1 --2- 172.21.15.6:0/164225666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd743bc0 0x5596bd746600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.373+0000 7f3c6f400640 1 -- 172.21.15.6:0/164225666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c700a4c10 con 0x5596bd761ca0 2024-08-17T02:26:47.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.373+0000 7f3c6ea00640 1 --2- 172.21.15.6:0/164225666 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd71f230 0x5596bd7185d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:47.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.373+0000 7f3c6f400640 1 --2- 172.21.15.6:0/164225666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd761ca0 0x5596bd745320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800e560 tx=0x7f3c68009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47afc71babb538e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.373+0000 7f3c4f400640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-08-17T02:26:47.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.373+0000 7f3c4f400640 1 -- 172.21.15.6:0/164225666 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c68005d60 con 0x5596bd761ca0 2024-08-17T02:26:47.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.373+0000 7f3c783e8740 1 -- 172.21.15.6:0/164225666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5596bd6afd20 con 0x5596bd761ca0 2024-08-17T02:26:47.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.373+0000 7f3c4f400640 1 -- 172.21.15.6:0/164225666 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c680070d0 con 0x5596bd761ca0 2024-08-17T02:26:47.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.373+0000 7f3c4f400640 1 -- 172.21.15.6:0/164225666 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c680018f0 con 0x5596bd761ca0 2024-08-17T02:26:47.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.373+0000 7f3c783e8740 10 client.4650 fetch_fsmap learned FSMap version 7 2024-08-17T02:26:47.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.373+0000 7f3c783e8740 1 -- 172.21.15.6:0/164225666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5596bd645ab0 con 0x5596bd761ca0 2024-08-17T02:26:47.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.374+0000 7f3c4f400640 1 -- 172.21.15.6:0/164225666 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5596bd6afd20 con 0x5596bd761ca0 2024-08-17T02:26:47.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.374+0000 7f3c4f400640 1 -- 172.21.15.6:0/164225666 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3c680074a0 con 0x5596bd761ca0 2024-08-17T02:26:47.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.374+0000 7f3c783e8740 10 client.4650 fetch_fsmap finished waiting for FSMap version 7 2024-08-17T02:26:47.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.374+0000 7f3c783e8740 10 client.4650 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:26:47.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.374+0000 7f3c783e8740 20 client.4650 populate_metadata read hostname 'smithi006' 2024-08-17T02:26:47.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.374+0000 7f3c783e8740 1 --2- 172.21.15.6:0/164225666 >> [v2:172.21.15.136:6834/2230598578,v1:172.21.15.136:6835/2230598578] conn(0x5596bd775990 0x5596bd775d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.374+0000 7f3c783e8740 4 client.4650 mds_command: new command op to 4275 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:26:47.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.374+0000 7f3c783e8740 1 -- 172.21.15.6:0/164225666 --> [v2:172.21.15.136:6834/2230598578,v1:172.21.15.136:6835/2230598578] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5596bd3833c0 con 0x5596bd775990 2024-08-17T02:26:47.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.374+0000 7f3c6ea00640 1 --2- 172.21.15.6:0/164225666 >> [v2:172.21.15.136:6834/2230598578,v1:172.21.15.136:6835/2230598578] conn(0x5596bd775990 0x5596bd775d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.375+0000 7f3c6ea00640 1 --2- 172.21.15.6:0/164225666 >> [v2:172.21.15.136:6834/2230598578,v1:172.21.15.136:6835/2230598578] conn(0x5596bd775990 0x5596bd775d60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f464d94840797c server_cookie=98f50f231d97f334 in_seq=0 out_seq=0 2024-08-17T02:26:47.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.375+0000 7f3c4f400640 10 client.4650 ms_handle_connect on v2:172.21.15.136:6834/2230598578 2024-08-17T02:26:47.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.376+0000 7f3c4f400640 1 -- 172.21.15.6:0/164225666 <== mds.0 v2:172.21.15.136:6834/2230598578 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x5596bd3833c0 con 0x5596bd775990 2024-08-17T02:26:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.376+0000 7f3c4f400640 10 client.4650 handle_command_reply: tid=0 2024-08-17T02:26:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.376+0000 7f3c783e8740 1 client.4650 shutdown 2024-08-17T02:26:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.376+0000 7f3c783e8740 1 -- 172.21.15.6:0/164225666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd761ca0 msgr2=0x5596bd745320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.376+0000 7f3c783e8740 1 --2- 172.21.15.6:0/164225666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd761ca0 0x5596bd745320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800e560 tx=0x7f3c68009040 comp rx=0 tx=0).stop 2024-08-17T02:26:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.376+0000 7f3c783e8740 1 -- 172.21.15.6:0/164225666 shutdown_connections 2024-08-17T02:26:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.376+0000 7f3c783e8740 1 --2- 172.21.15.6:0/164225666 >> [v2:172.21.15.136:6834/2230598578,v1:172.21.15.136:6835/2230598578] conn(0x5596bd775990 0x5596bd775d60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.376+0000 7f3c783e8740 1 --2- 172.21.15.6:0/164225666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd761ca0 0x5596bd745320 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.376+0000 7f3c783e8740 1 --2- 172.21.15.6:0/164225666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd743bc0 0x5596bd746600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.376+0000 7f3c783e8740 1 --2- 172.21.15.6:0/164225666 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd71f230 0x5596bd7185d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.376+0000 7f3c4f400640 0 client.4650 ms_handle_reset on v2:172.21.15.136:6834/2230598578 2024-08-17T02:26:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.376+0000 7f3c783e8740 1 -- 172.21.15.6:0/164225666 >> 172.21.15.6:0/164225666 conn(0x5596bd6b7030 msgr2=0x5596bd75f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.376+0000 7f3c783e8740 1 -- 172.21.15.6:0/164225666 shutdown_connections 2024-08-17T02:26:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.376+0000 7f3c783e8740 1 -- 172.21.15.6:0/164225666 wait complete. 2024-08-17T02:26:47.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.377+0000 7f3c783e8740 20 client.4650 trim_cache size 0 max 16384 2024-08-17T02:26:47.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.392+0000 7f3c783e8740 1 Processor -- start 2024-08-17T02:26:47.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.392+0000 7f3c783e8740 1 -- start start 2024-08-17T02:26:47.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.393+0000 7f3c783e8740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd71f230 0x5596bd774f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.393+0000 7f3c783e8740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd743bc0 0x5596bd765d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.393+0000 7f3c783e8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd761ca0 0x5596bd77bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.393+0000 7f3c783e8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596bd73fba0 con 0x5596bd761ca0 2024-08-17T02:26:47.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.393+0000 7f3c783e8740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596bd3f6f20 con 0x5596bd743bc0 2024-08-17T02:26:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.393+0000 7f3c783e8740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596bd74ba50 con 0x5596bd71f230 2024-08-17T02:26:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.394+0000 7f3c6e000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd743bc0 0x5596bd765d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.394+0000 7f3c6e000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd743bc0 0x5596bd765d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:37570/0 (socket says 172.21.15.6:37570) 2024-08-17T02:26:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.394+0000 7f3c6e000640 1 -- 172.21.15.6:0/3682012528 learned_addr learned my addr 172.21.15.6:0/3682012528 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.394+0000 7f3c6ea00640 1 --2- 172.21.15.6:0/3682012528 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd71f230 0x5596bd774f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.394+0000 7f3c6f400640 1 --2- 172.21.15.6:0/3682012528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd761ca0 0x5596bd77bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.394+0000 7f3c6e000640 1 -- 172.21.15.6:0/3682012528 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd71f230 msgr2=0x5596bd774f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.394+0000 7f3c6e000640 1 --2- 172.21.15.6:0/3682012528 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd71f230 0x5596bd774f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.394+0000 7f3c6e000640 1 -- 172.21.15.6:0/3682012528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd761ca0 msgr2=0x5596bd77bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.394+0000 7f3c6e000640 1 --2- 172.21.15.6:0/3682012528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd761ca0 0x5596bd77bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.394+0000 7f3c6e000640 1 -- 172.21.15.6:0/3682012528 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596bd748740 con 0x5596bd743bc0 2024-08-17T02:26:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.394+0000 7f3c6e000640 1 --2- 172.21.15.6:0/3682012528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd743bc0 0x5596bd765d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c074350 tx=0x7f3c5c049000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3e9516aa61e7224 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.395+0000 7f3c5b400640 1 -- 172.21.15.6:0/3682012528 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c074d50 con 0x5596bd743bc0 2024-08-17T02:26:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.395+0000 7f3c5b400640 1 -- 172.21.15.6:0/3682012528 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c074650 con 0x5596bd743bc0 2024-08-17T02:26:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.395+0000 7f3c5b400640 1 -- 172.21.15.6:0/3682012528 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c07b5f0 con 0x5596bd743bc0 2024-08-17T02:26:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.395+0000 7f3c783e8740 1 -- 172.21.15.6:0/3682012528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd743bc0 msgr2=0x5596bd765d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.395+0000 7f3c783e8740 1 --2- 172.21.15.6:0/3682012528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd743bc0 0x5596bd765d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c074350 tx=0x7f3c5c049000 comp rx=0 tx=0).stop 2024-08-17T02:26:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.395+0000 7f3c783e8740 1 -- 172.21.15.6:0/3682012528 shutdown_connections 2024-08-17T02:26:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.395+0000 7f3c783e8740 1 --2- 172.21.15.6:0/3682012528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd761ca0 0x5596bd77bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.395+0000 7f3c783e8740 1 --2- 172.21.15.6:0/3682012528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd743bc0 0x5596bd765d30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.395+0000 7f3c783e8740 1 --2- 172.21.15.6:0/3682012528 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd71f230 0x5596bd774f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.395+0000 7f3c783e8740 1 -- 172.21.15.6:0/3682012528 >> 172.21.15.6:0/3682012528 conn(0x5596bd6b7030 msgr2=0x5596bd71dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.395+0000 7f3c783e8740 1 -- 172.21.15.6:0/3682012528 shutdown_connections 2024-08-17T02:26:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.395+0000 7f3c783e8740 1 -- 172.21.15.6:0/3682012528 wait complete. 2024-08-17T02:26:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.396+0000 7f3c783e8740 1 -- start start 2024-08-17T02:26:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.396+0000 7f3c783e8740 1 Processor -- start 2024-08-17T02:26:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.397+0000 7f3c783e8740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd71f230 0x5596bd77bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.397+0000 7f3c783e8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd743bc0 0x5596bd77c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.397+0000 7f3c783e8740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd761ca0 0x5596bd717570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.397+0000 7f3c783e8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596bd71a1d0 con 0x5596bd743bc0 2024-08-17T02:26:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.397+0000 7f3c783e8740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596bd773da0 con 0x5596bd71f230 2024-08-17T02:26:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.397+0000 7f3c783e8740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596bd742f40 con 0x5596bd761ca0 2024-08-17T02:26:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.397+0000 7f3c783e8740 10 client.0 _ll_register_callbacks cb 0x7f3c68001690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:26:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.397+0000 7f3c6e000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd743bc0 0x5596bd77c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.397+0000 7f3c6e000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd743bc0 0x5596bd77c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49126/0 (socket says 172.21.15.6:49126) 2024-08-17T02:26:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.397+0000 7f3c6e000640 1 -- 172.21.15.6:0/2173160834 learned_addr learned my addr 172.21.15.6:0/2173160834 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.397+0000 7f3c6ea00640 1 --2- 172.21.15.6:0/2173160834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd71f230 0x5596bd77bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.397+0000 7f3c6f400640 1 --2- 172.21.15.6:0/2173160834 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd761ca0 0x5596bd717570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.397+0000 7f3c6e000640 1 -- 172.21.15.6:0/2173160834 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd761ca0 msgr2=0x5596bd717570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.398+0000 7f3c6e000640 1 --2- 172.21.15.6:0/2173160834 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd761ca0 0x5596bd717570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.398+0000 7f3c6e000640 1 -- 172.21.15.6:0/2173160834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd71f230 msgr2=0x5596bd77bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.398+0000 7f3c6e000640 1 --2- 172.21.15.6:0/2173160834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd71f230 0x5596bd77bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.398+0000 7f3c6e000640 1 -- 172.21.15.6:0/2173160834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5596bd62f820 con 0x5596bd743bc0 2024-08-17T02:26:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.398+0000 7f3c6e000640 1 --2- 172.21.15.6:0/2173160834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd743bc0 0x5596bd77c2d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009420 tx=0x7f3c5c00b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3f510d1cc90bb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.398+0000 7f3c4f400640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-08-17T02:26:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.398+0000 7f3c4f400640 1 -- 172.21.15.6:0/2173160834 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c074d50 con 0x5596bd743bc0 2024-08-17T02:26:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.398+0000 7f3c4f400640 1 -- 172.21.15.6:0/2173160834 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c5c07b5f0 con 0x5596bd743bc0 2024-08-17T02:26:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.398+0000 7f3c783e8740 1 -- 172.21.15.6:0/2173160834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3c5c0778a0 con 0x5596bd743bc0 2024-08-17T02:26:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.398+0000 7f3c4f400640 1 -- 172.21.15.6:0/2173160834 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c5c073d50 con 0x5596bd743bc0 2024-08-17T02:26:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.398+0000 7f3c783e8740 10 client.4656 fetch_fsmap learned FSMap version 7 2024-08-17T02:26:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.398+0000 7f3c783e8740 1 -- 172.21.15.6:0/2173160834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5596bd649490 con 0x5596bd743bc0 2024-08-17T02:26:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.398+0000 7f3c4f400640 1 -- 172.21.15.6:0/2173160834 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c0778a0 con 0x5596bd743bc0 2024-08-17T02:26:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.398+0000 7f3c4f400640 1 -- 172.21.15.6:0/2173160834 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3c5c07b160 con 0x5596bd743bc0 2024-08-17T02:26:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.399+0000 7f3c783e8740 10 client.4656 fetch_fsmap finished waiting for FSMap version 7 2024-08-17T02:26:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.399+0000 7f3c783e8740 10 client.4656 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:26:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.399+0000 7f3c783e8740 20 client.4656 populate_metadata read hostname 'smithi006' 2024-08-17T02:26:47.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.399+0000 7f3c783e8740 1 --2- 172.21.15.6:0/2173160834 >> [v2:172.21.15.136:6834/2230598578,v1:172.21.15.136:6835/2230598578] conn(0x5596bd746a20 0x5596bd717ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.399+0000 7f3c783e8740 4 client.4656 mds_command: new command op to 4275 tid=0[{"prefix": "status"}] 2024-08-17T02:26:47.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.399+0000 7f3c783e8740 1 -- 172.21.15.6:0/2173160834 --> [v2:172.21.15.136:6834/2230598578,v1:172.21.15.136:6835/2230598578] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5596bd3946c0 con 0x5596bd746a20 2024-08-17T02:26:47.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.399+0000 7f3c6ea00640 1 --2- 172.21.15.6:0/2173160834 >> [v2:172.21.15.136:6834/2230598578,v1:172.21.15.136:6835/2230598578] conn(0x5596bd746a20 0x5596bd717ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.400+0000 7f3c6ea00640 1 --2- 172.21.15.6:0/2173160834 >> [v2:172.21.15.136:6834/2230598578,v1:172.21.15.136:6835/2230598578] conn(0x5596bd746a20 0x5596bd717ab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cfa57573b0fc7a4 server_cookie=f65c544df5d81763 in_seq=0 out_seq=0 2024-08-17T02:26:47.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.400+0000 7f3c4f400640 10 client.4656 ms_handle_connect on v2:172.21.15.136:6834/2230598578 2024-08-17T02:26:47.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.400+0000 7f3c4f400640 1 -- 172.21.15.6:0/2173160834 <== mds.0 v2:172.21.15.136:6834/2230598578 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5596bd3946c0 con 0x5596bd746a20 2024-08-17T02:26:47.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.400+0000 7f3c4f400640 10 client.4656 handle_command_reply: tid=0 2024-08-17T02:26:47.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.400+0000 7f3c783e8740 1 client.4656 shutdown 2024-08-17T02:26:47.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.400+0000 7f3c783e8740 1 -- 172.21.15.6:0/2173160834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd743bc0 msgr2=0x5596bd77c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.400+0000 7f3c783e8740 1 --2- 172.21.15.6:0/2173160834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd743bc0 0x5596bd77c2d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009420 tx=0x7f3c5c00b050 comp rx=0 tx=0).stop 2024-08-17T02:26:47.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.400+0000 7f3c783e8740 1 -- 172.21.15.6:0/2173160834 shutdown_connections 2024-08-17T02:26:47.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.400+0000 7f3c783e8740 1 --2- 172.21.15.6:0/2173160834 >> [v2:172.21.15.136:6834/2230598578,v1:172.21.15.136:6835/2230598578] conn(0x5596bd746a20 0x5596bd717ab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.400+0000 7f3c783e8740 1 --2- 172.21.15.6:0/2173160834 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5596bd761ca0 0x5596bd717570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.400+0000 7f3c783e8740 1 --2- 172.21.15.6:0/2173160834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5596bd743bc0 0x5596bd77c2d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.400+0000 7f3c783e8740 1 --2- 172.21.15.6:0/2173160834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596bd71f230 0x5596bd77bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.400+0000 7f3c4f400640 0 client.4656 ms_handle_reset on v2:172.21.15.136:6834/2230598578 2024-08-17T02:26:47.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.400+0000 7f3c783e8740 1 -- 172.21.15.6:0/2173160834 >> 172.21.15.6:0/2173160834 conn(0x5596bd6b7030 msgr2=0x5596bd7185d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.400+0000 7f3c783e8740 1 -- 172.21.15.6:0/2173160834 shutdown_connections 2024-08-17T02:26:47.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.400+0000 7f3c783e8740 1 -- 172.21.15.6:0/2173160834 wait complete. 2024-08-17T02:26:47.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.401+0000 7f3c783e8740 20 client.4656 trim_cache size 0 max 16384 2024-08-17T02:26:47.410 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-08-17T02:26:47.410 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "61589148-c13d-47c7-8fbb-d1646bb8e5e2", 2024-08-17T02:26:47.410 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-08-17T02:26:47.410 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4275, 2024-08-17T02:26:47.410 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-08-17T02:26:47.410 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-08-17T02:26:47.410 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-08-17T02:26:47.411 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 15.209470329, 2024-08-17T02:26:47.411 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 7, 2024-08-17T02:26:47.411 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 21, 2024-08-17T02:26:47.411 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 21, 2024-08-17T02:26:47.411 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 22.885237567000001 2024-08-17T02:26:47.411 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-08-17T02:26:47.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.401+0000 7f3c6fe00640 1 -- 172.21.15.6:0/2266422342 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3c50065220 msgr2=0x7f3c500676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.401+0000 7f3c6fe00640 1 --2- 172.21.15.6:0/2266422342 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3c50065220 0x7f3c500676d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3c700cb6f0 tx=0x7f3c60008040 comp rx=0 tx=0).stop 2024-08-17T02:26:47.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.401+0000 7f3c6fe00640 1 -- 172.21.15.6:0/2266422342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c700ad1a0 msgr2=0x7f3c70147360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.401+0000 7f3c6fe00640 1 --2- 172.21.15.6:0/2266422342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c700ad1a0 0x7f3c70147360 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009210 tx=0x7f3c5c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:47.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.401+0000 7f3c6fe00640 1 -- 172.21.15.6:0/2266422342 shutdown_connections 2024-08-17T02:26:47.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.401+0000 7f3c6fe00640 1 --2- 172.21.15.6:0/2266422342 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3c50065220 0x7f3c500676d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.401+0000 7f3c6fe00640 1 --2- 172.21.15.6:0/2266422342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c701599b0 0x7f3c700af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.401+0000 7f3c6fe00640 1 --2- 172.21.15.6:0/2266422342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c700ad1a0 0x7f3c70147360 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.401+0000 7f3c6fe00640 1 --2- 172.21.15.6:0/2266422342 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3c700abdf0 0x7f3c700a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.401+0000 7f3c6fe00640 1 -- 172.21.15.6:0/2266422342 >> 172.21.15.6:0/2266422342 conn(0x7f3c70066e60 msgr2=0x7f3c700c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.401+0000 7f3c6fe00640 1 -- 172.21.15.6:0/2266422342 shutdown_connections 2024-08-17T02:26:47.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:47.401+0000 7f3c6fe00640 1 -- 172.21.15.6:0/2266422342 wait complete. 2024-08-17T02:26:47.417 INFO:teuthology.run_tasks:Running task kclient... 2024-08-17T02:26:47.447 INFO:tasks.kclient:Mounting kernel clients... 2024-08-17T02:26:47.447 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:26:47.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:47.447 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-08-17T02:26:47.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:47.483 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-08-17T02:26:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2024-08-17T02:26:47.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:47.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:47.585 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-08-17T02:26:47.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:47.620 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-08-17T02:26:47.718 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2024-08-17T02:26:47.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:47.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:47.721 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-08-17T02:26:47.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:47.761 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-08-17T02:26:47.862 INFO:teuthology.orchestra.run.smithi136.stderr:Cannot find device "ceph-brx" 2024-08-17T02:26:47.865 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:47.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:47.866 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-08-17T02:26:47.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:47.902 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-08-17T02:26:48.000 INFO:teuthology.orchestra.run.smithi136.stderr:Cannot find device "ceph-brx" 2024-08-17T02:26:48.002 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:48.003 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-08-17T02:26:48.003 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:48.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.154+0000 7f0326400640 1 Processor -- start 2024-08-17T02:26:48.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.154+0000 7f0326400640 1 -- start start 2024-08-17T02:26:48.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.155+0000 7f0326400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f03200afca0 0x7f03200b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.155+0000 7f0326400640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03200c92b0 con 0x7f03201590b0 2024-08-17T02:26:48.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.155+0000 7f0326400640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03200ad480 con 0x7f03200acf10 2024-08-17T02:26:48.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.155+0000 7f0326400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03200b0980 con 0x7f03200afca0 2024-08-17T02:26:48.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.156+0000 7f031fe00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f03201590b0 0x7f03200c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45520/0 (socket says 172.21.15.6:45520) 2024-08-17T02:26:48.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.156+0000 7f031fe00640 1 -- 172.21.15.6:0/3237190203 learned_addr learned my addr 172.21.15.6:0/3237190203 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:48.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.156+0000 7f031f400640 1 --2- 172.21.15.6:0/3237190203 >> v2:172.21.15.136:3300/0 conn(0x7f03200afca0 0x7f03200b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.156+0000 7f031e000640 1 -- 172.21.15.6:0/3237190203 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236020980 0 0) 0x7f03200c92b0 con 0x7f03201590b0 2024-08-17T02:26:48.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.156+0000 7f031e000640 1 -- 172.21.15.6:0/3237190203 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03040034e0 con 0x7f03201590b0 2024-08-17T02:26:48.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.156+0000 7f031f400640 1 -- 172.21.15.6:0/3237190203 >> v1:172.21.15.136:6789/0 conn(0x7f03200acf10 legacy=0x7f03201589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.156+0000 7f031f400640 1 -- 172.21.15.6:0/3237190203 >> v1:172.21.15.6:6789/0 conn(0x7f03201590b0 legacy=0x7f03200c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.156+0000 7f031f400640 1 -- 172.21.15.6:0/3237190203 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03200ad760 con 0x7f03200afca0 2024-08-17T02:26:48.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.157+0000 7f031f400640 1 --2- 172.21.15.6:0/3237190203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03200afca0 0x7f03200b0070 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0310009850 tx=0x7f03100090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa954c56b53b10ab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.157+0000 7f031e000640 1 -- 172.21.15.6:0/3237190203 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031002ae20 con 0x7f03200afca0 2024-08-17T02:26:48.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.157+0000 7f031e000640 1 -- 172.21.15.6:0/3237190203 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0310032440 con 0x7f03200afca0 2024-08-17T02:26:48.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.158+0000 7f031e000640 1 -- 172.21.15.6:0/3237190203 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03100327e0 con 0x7f03200afca0 2024-08-17T02:26:48.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.158+0000 7f0326400640 1 -- 172.21.15.6:0/3237190203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03200afca0 msgr2=0x7f03200b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.158+0000 7f0326400640 1 --2- 172.21.15.6:0/3237190203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03200afca0 0x7f03200b0070 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0310009850 tx=0x7f03100090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.158+0000 7f0326400640 1 -- 172.21.15.6:0/3237190203 shutdown_connections 2024-08-17T02:26:48.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.158+0000 7f0326400640 1 --2- 172.21.15.6:0/3237190203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03200afca0 0x7f03200b0070 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.158+0000 7f0326400640 1 -- 172.21.15.6:0/3237190203 >> 172.21.15.6:0/3237190203 conn(0x7f0320066e60 msgr2=0x7f0320067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.158+0000 7f0326400640 1 -- 172.21.15.6:0/3237190203 shutdown_connections 2024-08-17T02:26:48.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.158+0000 7f0326400640 1 -- 172.21.15.6:0/3237190203 wait complete. 2024-08-17T02:26:48.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.159+0000 7f0326400640 1 Processor -- start 2024-08-17T02:26:48.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.160+0000 7f0326400640 1 -- start start 2024-08-17T02:26:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.160+0000 7f0326400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f03200acf10 0x7f03200a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.161+0000 7f0326400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03200afca0 0x7f03200abe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.161+0000 7f0326400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03201590b0 0x7f0320169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.161+0000 7f0326400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03200ac3c0 con 0x7f03200afca0 2024-08-17T02:26:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.161+0000 7f0326400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03200a6010 con 0x7f03201590b0 2024-08-17T02:26:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.161+0000 7f0326400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03200a62f0 con 0x7f03200acf10 2024-08-17T02:26:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.161+0000 7f031ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03200afca0 0x7f03200abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.161+0000 7f031ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03200afca0 0x7f03200abe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49140/0 (socket says 172.21.15.6:49140) 2024-08-17T02:26:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.161+0000 7f031ea00640 1 -- 172.21.15.6:0/2314137090 learned_addr learned my addr 172.21.15.6:0/2314137090 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.161+0000 7f031fe00640 1 --2- 172.21.15.6:0/2314137090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03201590b0 0x7f0320169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.161+0000 7f031f400640 1 --2- 172.21.15.6:0/2314137090 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f03200acf10 0x7f03200a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.161+0000 7f031ea00640 1 -- 172.21.15.6:0/2314137090 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f03200acf10 msgr2=0x7f03200a59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.161+0000 7f031ea00640 1 --2- 172.21.15.6:0/2314137090 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f03200acf10 0x7f03200a59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.161+0000 7f031ea00640 1 -- 172.21.15.6:0/2314137090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03201590b0 msgr2=0x7f0320169f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.161+0000 7f031ea00640 1 --2- 172.21.15.6:0/2314137090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03201590b0 0x7f0320169f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.161+0000 7f031ea00640 1 -- 172.21.15.6:0/2314137090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0310009390 con 0x7f03200afca0 2024-08-17T02:26:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.162+0000 7f031ea00640 1 --2- 172.21.15.6:0/2314137090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03200afca0 0x7f03200abe80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f030c00c560 tx=0x7f030c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.162+0000 7f0316a00640 1 -- 172.21.15.6:0/2314137090 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c011590 con 0x7f03200afca0 2024-08-17T02:26:48.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.162+0000 7f0316a00640 1 -- 172.21.15.6:0/2314137090 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030c011710 con 0x7f03200afca0 2024-08-17T02:26:48.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.162+0000 7f0326400640 1 -- 172.21.15.6:0/2314137090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03200a65d0 con 0x7f03200afca0 2024-08-17T02:26:48.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.162+0000 7f0316a00640 1 -- 172.21.15.6:0/2314137090 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c011ad0 con 0x7f03200afca0 2024-08-17T02:26:48.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.162+0000 7f0326400640 1 -- 172.21.15.6:0/2314137090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03200a6b90 con 0x7f03200afca0 2024-08-17T02:26:48.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.163+0000 7f0326400640 1 -- 172.21.15.6:0/2314137090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0320158f10 con 0x7f03200afca0 2024-08-17T02:26:48.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.164+0000 7f0316a00640 1 -- 172.21.15.6:0/2314137090 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f030c01b3b0 con 0x7f03200afca0 2024-08-17T02:26:48.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.165+0000 7f0316a00640 1 --2- 172.21.15.6:0/2314137090 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0300065150 0x7f0300067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.165+0000 7f0316a00640 1 -- 172.21.15.6:0/2314137090 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f030c0819e0 con 0x7f03200afca0 2024-08-17T02:26:48.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.165+0000 7f031f400640 1 --2- 172.21.15.6:0/2314137090 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0300065150 0x7f0300067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.166+0000 7f031f400640 1 --2- 172.21.15.6:0/2314137090 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0300065150 0x7f0300067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0310034000 tx=0x7f0310032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.169+0000 7f0316a00640 1 -- 172.21.15.6:0/2314137090 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0320158f10 con 0x7f03200afca0 2024-08-17T02:26:48.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.392+0000 7f0326400640 1 -- 172.21.15.6:0/2314137090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0320158f10 con 0x7f03200afca0 2024-08-17T02:26:48.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.393+0000 7f0316a00640 1 -- 172.21.15.6:0/2314137090 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0320158f10 con 0x7f03200afca0 2024-08-17T02:26:48.393 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:48.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.394+0000 7f0326400640 1 -- 172.21.15.6:0/2314137090 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0300065150 msgr2=0x7f0300067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.394+0000 7f0326400640 1 --2- 172.21.15.6:0/2314137090 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0300065150 0x7f0300067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0310034000 tx=0x7f0310032000 comp rx=0 tx=0).stop 2024-08-17T02:26:48.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.394+0000 7f0326400640 1 -- 172.21.15.6:0/2314137090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03200afca0 msgr2=0x7f03200abe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.394+0000 7f0326400640 1 --2- 172.21.15.6:0/2314137090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03200afca0 0x7f03200abe80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f030c00c560 tx=0x7f030c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.395+0000 7f0326400640 1 -- 172.21.15.6:0/2314137090 shutdown_connections 2024-08-17T02:26:48.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.395+0000 7f0326400640 1 --2- 172.21.15.6:0/2314137090 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0300065150 0x7f0300067600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.395+0000 7f0326400640 1 --2- 172.21.15.6:0/2314137090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03201590b0 0x7f0320169f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.395+0000 7f0326400640 1 --2- 172.21.15.6:0/2314137090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03200afca0 0x7f03200abe80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.395+0000 7f0326400640 1 --2- 172.21.15.6:0/2314137090 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f03200acf10 0x7f03200a59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.395+0000 7f0326400640 1 -- 172.21.15.6:0/2314137090 >> 172.21.15.6:0/2314137090 conn(0x7f0320066e60 msgr2=0x7f032006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.395+0000 7f0326400640 1 -- 172.21.15.6:0/2314137090 shutdown_connections 2024-08-17T02:26:48.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:48.395+0000 7f0326400640 1 -- 172.21.15.6:0/2314137090 wait complete. 2024-08-17T02:26:48.411 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:48.411 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:48.411 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-08-17T02:26:48.411 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:26:48.412 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:48.412 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:48.412 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:48.412 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:48.412 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:26:48.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:48.412 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-08-17T02:26:48.447 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:48.447 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:48.448 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:48.448 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:48.448 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:48.448 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:48.448 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:48.448 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:48.448 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-08-17T02:26:48.448 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:48.448 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:48.448 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-08-17T02:26:48.448 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:48.448 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:48.448 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-08-17T02:26:48.449 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:26:48.449 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42631sec preferred_lft 42631sec 2024-08-17T02:26:48.449 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-08-17T02:26:48.449 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:48.449 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:48.449 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:48.449 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-08-17T02:26:48.449 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:26:48.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:48.450 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2024-08-17T02:26:48.450 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-08-17T02:26:48.450 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:26:48.450 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2024-08-17T02:26:48.450 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2024-08-17T02:26:48.450 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:26:48.450 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-08-17T02:26:48.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:48.816 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:48.872 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-08-17T02:26:48.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:48.875 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:48.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:48.930 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2024-08-17T02:26:48.930 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-08-17T02:26:48.930 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:26:48.930 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:26:48.930 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:26:48.930 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-08-17T02:26:49.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:49.475 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-08-17T02:26:49.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:49.512 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2024-08-17T02:26:49.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:49.587 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2024-08-17T02:26:49.587 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-08-17T02:26:49.587 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:26:49.587 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:26:49.587 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-08-17T02:26:49.713 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:26:49.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:49.714 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2024-08-17T02:26:49.714 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-08-17T02:26:49.714 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:26:49.714 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:49.714 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:26:49.714 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:26:49.714 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:26:49.714 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-08-17T02:26:49.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:49.895 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2024-08-17T02:26:49.896 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-08-17T02:26:49.896 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-08-17T02:26:49.896 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:26:49.896 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-08-17T02:26:50.011 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:50.012 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:50.048 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:26:50.048 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:50.048 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:50.123 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:26:50.123 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:50.123 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:50.259 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:50.259 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:50.880 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:50.880 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:50.880 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.136:3300,172.21.15.136:3301" 2024-08-17T02:26:50.880 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@61589148-c13d-47c7-8fbb-d1646bb8e5e2.cephfs=/ 2024-08-17T02:26:50.880 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2024-08-17T02:26:50.881 INFO:teuthology.orchestra.run.smithi006.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:26:50.882 INFO:teuthology.orchestra.run.smithi006.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:26:50.882 INFO:teuthology.orchestra.run.smithi006.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:26:50.882 INFO:teuthology.orchestra.run.smithi006.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:26:50.882 INFO:teuthology.orchestra.run.smithi006.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:26:50.885 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:26:50.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:50.885 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:50.942 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-08-17T02:26:50.943 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:51.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.093+0000 7f4065200640 1 Processor -- start 2024-08-17T02:26:51.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.093+0000 7f4065200640 1 -- start start 2024-08-17T02:26:51.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.094+0000 7f4065200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40600ad960 0x7f406015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.094+0000 7f4065200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f40600ca050 0x7f4060156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.094+0000 7f4065200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406015b5e0 con 0x7f40600add30 2024-08-17T02:26:51.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.094+0000 7f4065200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40600cb160 con 0x7f40600ca050 2024-08-17T02:26:51.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.094+0000 7f4065200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40600b0d10 con 0x7f40600ad960 2024-08-17T02:26:51.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.094+0000 7f405e800640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f40600add30 0x7f4060156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45526/0 (socket says 172.21.15.6:45526) 2024-08-17T02:26:51.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.094+0000 7f405e800640 1 -- 172.21.15.6:0/3790331600 learned_addr learned my addr 172.21.15.6:0/3790331600 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:51.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405de00640 1 --2- 172.21.15.6:0/3790331600 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40600ad960 0x7f406015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405d400640 1 --2- 172.21.15.6:0/3790331600 >> v2:172.21.15.136:3300/0 conn(0x7f40600ca050 0x7f4060156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405ca00640 1 -- 172.21.15.6:0/3790331600 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346552658 0 0) 0x7f4058001490 con 0x7f40600add30 2024-08-17T02:26:51.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405ca00640 1 -- 172.21.15.6:0/3790331600 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40440034e0 con 0x7f40600add30 2024-08-17T02:26:51.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405ca00640 1 -- 172.21.15.6:0/3790331600 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 536487538 0 0) 0x7f40440034e0 con 0x7f40600add30 2024-08-17T02:26:51.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405ca00640 1 -- 172.21.15.6:0/3790331600 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40600ad960 msgr2=0x7f406015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:51.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405ca00640 1 --2- 172.21.15.6:0/3790331600 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40600ad960 0x7f406015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405ca00640 1 -- 172.21.15.6:0/3790331600 >> v2:172.21.15.136:3300/0 conn(0x7f40600ca050 msgr2=0x7f4060156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:51.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405ca00640 1 --2- 172.21.15.6:0/3790331600 >> v2:172.21.15.136:3300/0 conn(0x7f40600ca050 0x7f4060156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405ca00640 1 -- 172.21.15.6:0/3790331600 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40600ca550 con 0x7f40600add30 2024-08-17T02:26:51.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405ca00640 1 -- 172.21.15.6:0/3790331600 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f4058001980 con 0x7f40600add30 2024-08-17T02:26:51.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405ca00640 1 -- 172.21.15.6:0/3790331600 >> v1:172.21.15.6:6789/0 conn(0x7f40600add30 legacy=0x7f4060156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405ca00640 1 --2- 172.21.15.6:0/3790331600 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40600ad960 0x7f4044003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405ca00640 1 --2- 172.21.15.6:0/3790331600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4044004020 0x7f4044004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405ca00640 1 --2- 172.21.15.6:0/3790331600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4044004cc0 0x7f4044005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405ca00640 1 -- 172.21.15.6:0/3790331600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40600cb160 con 0x7f4044004020 2024-08-17T02:26:51.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405ca00640 1 -- 172.21.15.6:0/3790331600 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40600b0d10 con 0x7f4044004cc0 2024-08-17T02:26:51.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.095+0000 7f405ca00640 1 -- 172.21.15.6:0/3790331600 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404400bad0 con 0x7f40600ad960 2024-08-17T02:26:51.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.096+0000 7f405d400640 1 --2- 172.21.15.6:0/3790331600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4044004020 0x7f4044004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.096+0000 7f405de00640 1 --2- 172.21.15.6:0/3790331600 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40600ad960 0x7f4044003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.096+0000 7f405e800640 1 --2- 172.21.15.6:0/3790331600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4044004cc0 0x7f4044005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.096+0000 7f405de00640 1 -- 172.21.15.6:0/3790331600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4044004cc0 msgr2=0x7f4044005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:51.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.096+0000 7f405de00640 1 --2- 172.21.15.6:0/3790331600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4044004cc0 0x7f4044005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.096+0000 7f405de00640 1 -- 172.21.15.6:0/3790331600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4044004020 msgr2=0x7f4044004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:51.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.096+0000 7f405de00640 1 --2- 172.21.15.6:0/3790331600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4044004020 0x7f4044004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.096+0000 7f405de00640 1 -- 172.21.15.6:0/3790331600 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40440034e0 con 0x7f40600ad960 2024-08-17T02:26:51.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.096+0000 7f405d400640 1 --2- 172.21.15.6:0/3790331600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4044004020 0x7f4044004780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:51.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.097+0000 7f405de00640 1 --2- 172.21.15.6:0/3790331600 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40600ad960 0x7f4044003a50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4050006e70 tx=0x7f40500090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a010443097bede1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.097+0000 7f405ca00640 1 -- 172.21.15.6:0/3790331600 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050031400 con 0x7f40600ad960 2024-08-17T02:26:51.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.097+0000 7f405ca00640 1 -- 172.21.15.6:0/3790331600 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405002d050 con 0x7f40600ad960 2024-08-17T02:26:51.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.097+0000 7f405ca00640 1 -- 172.21.15.6:0/3790331600 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050031790 con 0x7f40600ad960 2024-08-17T02:26:51.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.098+0000 7f4065200640 1 -- 172.21.15.6:0/3790331600 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40600ad960 msgr2=0x7f4044003a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.098+0000 7f4065200640 1 --2- 172.21.15.6:0/3790331600 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40600ad960 0x7f4044003a50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4050006e70 tx=0x7f40500090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.098+0000 7f405e800640 1 -- 172.21.15.6:0/3790331600 reap_dead start 2024-08-17T02:26:51.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.098+0000 7f4065200640 1 -- 172.21.15.6:0/3790331600 shutdown_connections 2024-08-17T02:26:51.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.098+0000 7f4065200640 1 -- 172.21.15.6:0/3790331600 >> 172.21.15.6:0/3790331600 conn(0x7f4060066e60 msgr2=0x7f4060067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.098+0000 7f4065200640 1 -- 172.21.15.6:0/3790331600 shutdown_connections 2024-08-17T02:26:51.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.098+0000 7f4065200640 1 -- 172.21.15.6:0/3790331600 wait complete. 2024-08-17T02:26:51.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.099+0000 7f4065200640 1 Processor -- start 2024-08-17T02:26:51.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.100+0000 7f4065200640 1 -- start start 2024-08-17T02:26:51.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.100+0000 7f4065200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600ad960 0x7f40600a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.100+0000 7f4065200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40600aa110 0x7f40600c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.100+0000 7f4065200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4060154820 0x7f4060154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.100+0000 7f4065200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40601551d0 con 0x7f40600ad960 2024-08-17T02:26:51.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.100+0000 7f4065200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40600a9880 con 0x7f4060154820 2024-08-17T02:26:51.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.100+0000 7f4065200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40600aa580 con 0x7f40600aa110 2024-08-17T02:26:51.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.101+0000 7f405de00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600ad960 0x7f40600a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.101+0000 7f405de00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600ad960 0x7f40600a88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49158/0 (socket says 172.21.15.6:49158) 2024-08-17T02:26:51.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.101+0000 7f405de00640 1 -- 172.21.15.6:0/714693639 learned_addr learned my addr 172.21.15.6:0/714693639 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:51.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.101+0000 7f405e800640 1 --2- 172.21.15.6:0/714693639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4060154820 0x7f4060154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.101+0000 7f405d400640 1 --2- 172.21.15.6:0/714693639 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40600aa110 0x7f40600c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.101+0000 7f405de00640 1 -- 172.21.15.6:0/714693639 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40600aa110 msgr2=0x7f40600c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.101+0000 7f405de00640 1 --2- 172.21.15.6:0/714693639 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40600aa110 0x7f40600c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.101+0000 7f405de00640 1 -- 172.21.15.6:0/714693639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4060154820 msgr2=0x7f4060154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.101+0000 7f405de00640 1 --2- 172.21.15.6:0/714693639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4060154820 0x7f4060154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.101+0000 7f405de00640 1 -- 172.21.15.6:0/714693639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40600a8fe0 con 0x7f40600ad960 2024-08-17T02:26:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.101+0000 7f405e800640 1 --2- 172.21.15.6:0/714693639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4060154820 0x7f4060154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.101+0000 7f405de00640 1 --2- 172.21.15.6:0/714693639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600ad960 0x7f40600a88e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4050009130 tx=0x7f4050035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.102+0000 7f4055600640 1 -- 172.21.15.6:0/714693639 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050030850 con 0x7f40600ad960 2024-08-17T02:26:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.102+0000 7f4055600640 1 -- 172.21.15.6:0/714693639 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40500309b0 con 0x7f40600ad960 2024-08-17T02:26:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.102+0000 7f4065200640 1 -- 172.21.15.6:0/714693639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40600a92c0 con 0x7f40600ad960 2024-08-17T02:26:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.102+0000 7f4055600640 1 -- 172.21.15.6:0/714693639 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050030d30 con 0x7f40600ad960 2024-08-17T02:26:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.102+0000 7f4065200640 1 -- 172.21.15.6:0/714693639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4060158160 con 0x7f40600ad960 2024-08-17T02:26:51.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.103+0000 7f4065200640 1 -- 172.21.15.6:0/714693639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4060063fb0 con 0x7f40600ad960 2024-08-17T02:26:51.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.104+0000 7f4055600640 1 -- 172.21.15.6:0/714693639 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f405003c630 con 0x7f40600ad960 2024-08-17T02:26:51.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.104+0000 7f4055600640 1 --2- 172.21.15.6:0/714693639 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4040065150 0x7f4040067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.104+0000 7f4055600640 1 -- 172.21.15.6:0/714693639 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40500a3900 con 0x7f40600ad960 2024-08-17T02:26:51.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.105+0000 7f405d400640 1 --2- 172.21.15.6:0/714693639 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4040065150 0x7f4040067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.105+0000 7f405d400640 1 --2- 172.21.15.6:0/714693639 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4040065150 0x7f4040067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f404c006d30 tx=0x7f404c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.108+0000 7f4055600640 1 -- 172.21.15.6:0/714693639 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4050071920 con 0x7f40600ad960 2024-08-17T02:26:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.330+0000 7f4065200640 1 -- 172.21.15.6:0/714693639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4060154420 con 0x7f40600ad960 2024-08-17T02:26:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.330+0000 7f4055600640 1 -- 172.21.15.6:0/714693639 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4050074f40 con 0x7f40600ad960 2024-08-17T02:26:51.331 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:51.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.332+0000 7f4065200640 1 -- 172.21.15.6:0/714693639 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4040065150 msgr2=0x7f4040067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.332+0000 7f4065200640 1 --2- 172.21.15.6:0/714693639 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4040065150 0x7f4040067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f404c006d30 tx=0x7f404c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:51.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.332+0000 7f4065200640 1 -- 172.21.15.6:0/714693639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600ad960 msgr2=0x7f40600a88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.332+0000 7f4065200640 1 --2- 172.21.15.6:0/714693639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600ad960 0x7f40600a88e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4050009130 tx=0x7f4050035000 comp rx=0 tx=0).stop 2024-08-17T02:26:51.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.332+0000 7f4065200640 1 -- 172.21.15.6:0/714693639 shutdown_connections 2024-08-17T02:26:51.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.332+0000 7f4065200640 1 --2- 172.21.15.6:0/714693639 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4040065150 0x7f4040067600 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.332+0000 7f4065200640 1 --2- 172.21.15.6:0/714693639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4060154820 0x7f4060154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.332+0000 7f4065200640 1 --2- 172.21.15.6:0/714693639 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40600aa110 0x7f40600c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.332+0000 7f4065200640 1 --2- 172.21.15.6:0/714693639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600ad960 0x7f40600a88e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.332+0000 7f4065200640 1 -- 172.21.15.6:0/714693639 >> 172.21.15.6:0/714693639 conn(0x7f4060066e60 msgr2=0x7f406006e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.332+0000 7f4065200640 1 -- 172.21.15.6:0/714693639 shutdown_connections 2024-08-17T02:26:51.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:51.332+0000 7f4065200640 1 -- 172.21.15.6:0/714693639 wait complete. 2024-08-17T02:26:51.347 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:51.347 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:51.347 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-08-17T02:26:51.347 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:26:51.348 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:51.348 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:51.348 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:51.348 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:51.348 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:26:51.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:51.348 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-08-17T02:26:51.385 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:51.385 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:51.385 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:51.385 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.385 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:51.385 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.385 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:51.385 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:51.386 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-08-17T02:26:51.386 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:51.386 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:51.386 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-08-17T02:26:51.386 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:51.386 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:51.386 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-08-17T02:26:51.386 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:26:51.386 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42628sec preferred_lft 42628sec 2024-08-17T02:26:51.386 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-08-17T02:26:51.386 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.386 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:51.387 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:51.387 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-08-17T02:26:51.387 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:51.387 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 1e:e3:92:c2:40:01 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:51.387 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:26:51.387 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.387 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::cd0:c9ff:fe4a:aa10/64 scope link 2024-08-17T02:26:51.387 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.387 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:51.387 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 1e:e3:92:c2:40:01 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:26:51.387 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::1ce3:92ff:fec2:4001/64 scope link tentative 2024-08-17T02:26:51.387 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:51.388 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:51.478 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-08-17T02:26:51.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:51.482 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-08-17T02:26:51.517 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-08-17T02:26:51.518 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:51.518 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:26:51.518 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:26:51.518 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:51.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:51.518 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2024-08-17T02:26:51.518 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-08-17T02:26:51.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:26:51.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:26:51.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:26:51.519 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-08-17T02:26:51.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:51.664 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-08-17T02:26:51.699 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:26:51.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:51.700 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2024-08-17T02:26:51.773 INFO:teuthology.orchestra.run.smithi006.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:26:51.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:51.775 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2024-08-17T02:26:51.775 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-08-17T02:26:51.775 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:26:51.775 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:26:51.775 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-08-17T02:26:51.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:51.899 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:26:51.955 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:51.955 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:51.955 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:51.955 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.955 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:51.955 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.955 INFO:teuthology.orchestra.run.smithi006.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:51.955 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 4a:e5:ee:f6:be:05 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:51.955 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:51.956 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.956 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::48e5:eeff:fef6:be05/64 scope link 2024-08-17T02:26:51.956 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:51.958 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:26:52.013 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:52.013 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:52.013 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:52.014 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:52.014 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:52.014 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:52.014 INFO:teuthology.orchestra.run.smithi006.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:52.014 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 4a:e5:ee:f6:be:05 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:52.014 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:52.014 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:52.014 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::48e5:eeff:fef6:be05/64 scope link 2024-08-17T02:26:52.014 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:52.016 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:26:52.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:52.017 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2024-08-17T02:26:52.017 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-08-17T02:26:52.017 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:26:52.017 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:52.017 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:26:52.017 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:26:52.017 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:26:52.017 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-08-17T02:26:52.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:52.183 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2024-08-17T02:26:52.183 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-08-17T02:26:52.183 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.1 up 2024-08-17T02:26:52.183 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:26:52.183 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-08-17T02:26:52.298 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:52.298 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:52.332 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:26:52.333 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:52.333 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:52.407 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-08-17T02:26:52.407 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:52.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:52.530 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:52.531 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:52.557 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:52.557 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:52.558 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.136:3300,172.21.15.136:3301" 2024-08-17T02:26:52.558 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 2@61589148-c13d-47c7-8fbb-d1646bb8e5e2.cephfs=/ 2024-08-17T02:26:52.558 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.6:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2024-08-17T02:26:52.558 INFO:teuthology.orchestra.run.smithi006.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-08-17T02:26:52.558 INFO:teuthology.orchestra.run.smithi006.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:26:52.558 INFO:teuthology.orchestra.run.smithi006.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:26:52.559 INFO:teuthology.orchestra.run.smithi006.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:26:52.559 INFO:teuthology.orchestra.run.smithi006.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:26:52.561 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:26:52.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:52.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:52.617 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-08-17T02:26:52.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:52.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.768+0000 7f9c8a600640 1 Processor -- start 2024-08-17T02:26:52.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.768+0000 7f9c8a600640 1 -- start start 2024-08-17T02:26:52.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.769+0000 7f9c8a600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c841589e0 0x7f9c84158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.769+0000 7f9c8a600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9c840ca9c0 0x7f9c840cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.770+0000 7f9c8a600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c840af9a0 con 0x7f9c840cda30 2024-08-17T02:26:52.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.770+0000 7f9c8a600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c840af810 con 0x7f9c841589e0 2024-08-17T02:26:52.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.770+0000 7f9c8a600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c840cb340 con 0x7f9c840ca9c0 2024-08-17T02:26:52.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.770+0000 7f9c83400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c841589e0 0x7f9c84158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.770+0000 7f9c83400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c841589e0 0x7f9c84158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49162/0 (socket says 172.21.15.6:49162) 2024-08-17T02:26:52.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.770+0000 7f9c83400640 1 -- 172.21.15.6:0/2859124524 learned_addr learned my addr 172.21.15.6:0/2859124524 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:52.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.770+0000 7f9c7be00640 1 --2- 172.21.15.6:0/2859124524 >> v2:172.21.15.136:3300/0 conn(0x7f9c840ca9c0 0x7f9c840cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.770+0000 7f9c83400640 1 -- 172.21.15.6:0/2859124524 >> v2:172.21.15.136:3300/0 conn(0x7f9c840ca9c0 msgr2=0x7f9c840cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:52.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.770+0000 7f9c83400640 1 --2- 172.21.15.6:0/2859124524 >> v2:172.21.15.136:3300/0 conn(0x7f9c840ca9c0 0x7f9c840cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.770+0000 7f9c83400640 1 -- 172.21.15.6:0/2859124524 >> v1:172.21.15.136:6789/0 conn(0x7f9c840cda30 legacy=0x7f9c840cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.770+0000 7f9c83400640 1 -- 172.21.15.6:0/2859124524 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c840ce740 con 0x7f9c841589e0 2024-08-17T02:26:52.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.771+0000 7f9c83400640 1 --2- 172.21.15.6:0/2859124524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c841589e0 0x7f9c84158db0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9c841592f0 tx=0x7f9c740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8813fd831083a7fe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.771+0000 7f9c82a00640 1 -- 172.21.15.6:0/2859124524 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7402ae80 con 0x7f9c841589e0 2024-08-17T02:26:52.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.772+0000 7f9c82a00640 1 -- 172.21.15.6:0/2859124524 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c74032440 con 0x7f9c841589e0 2024-08-17T02:26:52.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.772+0000 7f9c82a00640 1 -- 172.21.15.6:0/2859124524 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74032800 con 0x7f9c841589e0 2024-08-17T02:26:52.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.772+0000 7f9c8a600640 1 -- 172.21.15.6:0/2859124524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c841589e0 msgr2=0x7f9c84158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.772+0000 7f9c8a600640 1 --2- 172.21.15.6:0/2859124524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c841589e0 0x7f9c84158db0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9c841592f0 tx=0x7f9c740091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.772+0000 7f9c8a600640 1 -- 172.21.15.6:0/2859124524 shutdown_connections 2024-08-17T02:26:52.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.772+0000 7f9c8a600640 1 --2- 172.21.15.6:0/2859124524 >> v2:172.21.15.136:3300/0 conn(0x7f9c840ca9c0 0x7f9c840cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.772+0000 7f9c8a600640 1 --2- 172.21.15.6:0/2859124524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c841589e0 0x7f9c84158db0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.772+0000 7f9c8a600640 1 -- 172.21.15.6:0/2859124524 >> 172.21.15.6:0/2859124524 conn(0x7f9c8406e590 msgr2=0x7f9c8406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.772+0000 7f9c8a600640 1 -- 172.21.15.6:0/2859124524 shutdown_connections 2024-08-17T02:26:52.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.772+0000 7f9c8a600640 1 -- 172.21.15.6:0/2859124524 wait complete. 2024-08-17T02:26:52.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.774+0000 7f9c8a600640 1 Processor -- start 2024-08-17T02:26:52.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.774+0000 7f9c8a600640 1 -- start start 2024-08-17T02:26:52.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.775+0000 7f9c8a600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9c840ca9c0 0x7f9c841534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.775+0000 7f9c8a600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c840cda30 0x7f9c8415ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.775+0000 7f9c8a600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c841589e0 0x7f9c8415ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.775+0000 7f9c8a600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c841515e0 con 0x7f9c840cda30 2024-08-17T02:26:52.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.775+0000 7f9c8a600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840b55d0 con 0x7f9c841589e0 2024-08-17T02:26:52.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.775+0000 7f9c8a600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840b58b0 con 0x7f9c840ca9c0 2024-08-17T02:26:52.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.775+0000 7f9c7be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c840cda30 0x7f9c8415ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.775+0000 7f9c7be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c840cda30 0x7f9c8415ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49176/0 (socket says 172.21.15.6:49176) 2024-08-17T02:26:52.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.775+0000 7f9c7be00640 1 -- 172.21.15.6:0/1233227920 learned_addr learned my addr 172.21.15.6:0/1233227920 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:52.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.775+0000 7f9c83400640 1 --2- 172.21.15.6:0/1233227920 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9c840ca9c0 0x7f9c841534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.775+0000 7f9c83e00640 1 --2- 172.21.15.6:0/1233227920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c841589e0 0x7f9c8415ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.775+0000 7f9c7be00640 1 -- 172.21.15.6:0/1233227920 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9c840ca9c0 msgr2=0x7f9c841534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.775+0000 7f9c7be00640 1 --2- 172.21.15.6:0/1233227920 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9c840ca9c0 0x7f9c841534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.775+0000 7f9c7be00640 1 -- 172.21.15.6:0/1233227920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c841589e0 msgr2=0x7f9c8415ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.775+0000 7f9c7be00640 1 --2- 172.21.15.6:0/1233227920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c841589e0 0x7f9c8415ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.775+0000 7f9c7be00640 1 -- 172.21.15.6:0/1233227920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c74009450 con 0x7f9c840cda30 2024-08-17T02:26:52.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.775+0000 7f9c83e00640 1 --2- 172.21.15.6:0/1233227920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c841589e0 0x7f9c8415ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:52.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.776+0000 7f9c7be00640 1 --2- 172.21.15.6:0/1233227920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c840cda30 0x7f9c8415ea50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c00d890 tx=0x7f9c6c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.776+0000 7f9c7aa00640 1 -- 172.21.15.6:0/1233227920 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c00de20 con 0x7f9c840cda30 2024-08-17T02:26:52.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.776+0000 7f9c7aa00640 1 -- 172.21.15.6:0/1233227920 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c0098b0 con 0x7f9c840cda30 2024-08-17T02:26:52.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.776+0000 7f9c7aa00640 1 -- 172.21.15.6:0/1233227920 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c009c50 con 0x7f9c840cda30 2024-08-17T02:26:52.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.776+0000 7f9c8a600640 1 -- 172.21.15.6:0/1233227920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c84152a00 con 0x7f9c840cda30 2024-08-17T02:26:52.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.776+0000 7f9c8a600640 1 -- 172.21.15.6:0/1233227920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c84152fc0 con 0x7f9c840cda30 2024-08-17T02:26:52.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.777+0000 7f9c8a600640 1 -- 172.21.15.6:0/1233227920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c84063fb0 con 0x7f9c840cda30 2024-08-17T02:26:52.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.778+0000 7f9c7aa00640 1 -- 172.21.15.6:0/1233227920 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9c6c014620 con 0x7f9c840cda30 2024-08-17T02:26:52.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.779+0000 7f9c7aa00640 1 --2- 172.21.15.6:0/1233227920 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9c60065150 0x7f9c60067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.779+0000 7f9c7aa00640 1 -- 172.21.15.6:0/1233227920 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c6c082c90 con 0x7f9c840cda30 2024-08-17T02:26:52.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.779+0000 7f9c83400640 1 --2- 172.21.15.6:0/1233227920 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9c60065150 0x7f9c60067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.780+0000 7f9c83400640 1 --2- 172.21.15.6:0/1233227920 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9c60065150 0x7f9c60067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9c74034000 tx=0x7f9c74032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:52.783+0000 7f9c7aa00640 1 -- 172.21.15.6:0/1233227920 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9c6c050cb0 con 0x7f9c840cda30 2024-08-17T02:26:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:53.007+0000 7f9c8a600640 1 -- 172.21.15.6:0/1233227920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9c840c5e70 con 0x7f9c840cda30 2024-08-17T02:26:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:53.007+0000 7f9c7aa00640 1 -- 172.21.15.6:0/1233227920 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9c6c0542d0 con 0x7f9c840cda30 2024-08-17T02:26:53.008 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:53.009+0000 7f9c8a600640 1 -- 172.21.15.6:0/1233227920 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9c60065150 msgr2=0x7f9c60067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:53.009+0000 7f9c8a600640 1 --2- 172.21.15.6:0/1233227920 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9c60065150 0x7f9c60067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9c74034000 tx=0x7f9c74032000 comp rx=0 tx=0).stop 2024-08-17T02:26:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:53.009+0000 7f9c8a600640 1 -- 172.21.15.6:0/1233227920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c840cda30 msgr2=0x7f9c8415ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:53.009+0000 7f9c8a600640 1 --2- 172.21.15.6:0/1233227920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c840cda30 0x7f9c8415ea50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c00d890 tx=0x7f9c6c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:53.009+0000 7f9c8a600640 1 -- 172.21.15.6:0/1233227920 shutdown_connections 2024-08-17T02:26:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:53.009+0000 7f9c8a600640 1 --2- 172.21.15.6:0/1233227920 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9c60065150 0x7f9c60067600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:53.009+0000 7f9c8a600640 1 --2- 172.21.15.6:0/1233227920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c841589e0 0x7f9c8415ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:53.009+0000 7f9c8a600640 1 --2- 172.21.15.6:0/1233227920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c840cda30 0x7f9c8415ea50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:53.009+0000 7f9c8a600640 1 --2- 172.21.15.6:0/1233227920 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9c840ca9c0 0x7f9c841534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:53.009+0000 7f9c8a600640 1 -- 172.21.15.6:0/1233227920 >> 172.21.15.6:0/1233227920 conn(0x7f9c8406e590 msgr2=0x7f9c841540e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:53.009+0000 7f9c8a600640 1 -- 172.21.15.6:0/1233227920 shutdown_connections 2024-08-17T02:26:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:53.010+0000 7f9c8a600640 1 -- 172.21.15.6:0/1233227920 wait complete. 2024-08-17T02:26:53.025 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:53.025 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:53.025 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2024-08-17T02:26:53.025 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:26:53.025 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:53.025 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:53.025 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:53.025 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:53.025 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:26:53.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:53.025 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2024-08-17T02:26:53.065 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:53.065 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:53.065 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:53.065 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:53.065 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:53.065 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:53.065 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:53.065 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:53.065 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2024-08-17T02:26:53.065 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:53.065 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:53.065 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2024-08-17T02:26:53.065 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:53.065 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:53.066 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:53.066 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:53.066 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:26:53.066 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42673sec preferred_lft 42673sec 2024-08-17T02:26:53.066 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec4:7aff:fe88:6e43/64 scope link 2024-08-17T02:26:53.066 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:53.067 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:26:53.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:53.067 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-08-17T02:26:53.067 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-08-17T02:26:53.067 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:26:53.067 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr flush dev ceph-brx 2024-08-17T02:26:53.067 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set ceph-brx up 2024-08-17T02:26:53.067 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:26:53.067 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-08-17T02:26:53.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:53.426 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:53.482 INFO:teuthology.orchestra.run.smithi136.stdout:1 2024-08-17T02:26:53.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:53.486 DEBUG:teuthology.orchestra.run.smithi136:> route 2024-08-17T02:26:53.539 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2024-08-17T02:26:53.539 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:53.539 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:53.539 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:26:53.539 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:53.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:53.540 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-08-17T02:26:53.540 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-08-17T02:26:53.540 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:53.540 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:53.540 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:53.540 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-08-17T02:26:54.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:54.095 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-08-17T02:26:54.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:54.131 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list-id 2024-08-17T02:26:54.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:54.207 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-08-17T02:26:54.207 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-08-17T02:26:54.207 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:26:54.207 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:26:54.207 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-08-17T02:26:54.338 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:26:54.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:54.338 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-08-17T02:26:54.339 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-08-17T02:26:54.339 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:26:54.339 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:54.339 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:26:54.339 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:26:54.339 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:26:54.339 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-08-17T02:26:54.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:54.531 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-08-17T02:26:54.531 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-08-17T02:26:54.531 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.0 up 2024-08-17T02:26:54.531 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:26:54.532 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-08-17T02:26:54.649 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:54.650 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:54.684 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:26:54.685 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:54.685 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:54.760 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:26:54.760 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:54.760 DEBUG:teuthology.orchestra.run.smithi136:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:54.902 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:54.902 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:55.524 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:55.524 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:55.524 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.136:3300,172.21.15.136:3301" 2024-08-17T02:26:55.524 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: trying mount with new device syntax: 1@61589148-c13d-47c7-8fbb-d1646bb8e5e2.cephfs=/ 2024-08-17T02:26:55.524 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2024-08-17T02:26:55.526 INFO:teuthology.orchestra.run.smithi136.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:26:55.526 INFO:teuthology.orchestra.run.smithi136.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:26:55.526 INFO:teuthology.orchestra.run.smithi136.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:26:55.526 INFO:teuthology.orchestra.run.smithi136.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:26:55.526 INFO:teuthology.orchestra.run.smithi136.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:26:55.529 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:26:55.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:55.529 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:55.586 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-08-17T02:26:55.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:55.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.747+0000 7ff6c6600640 1 Processor -- start 2024-08-17T02:26:55.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.748+0000 7ff6c6600640 1 -- start start 2024-08-17T02:26:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.749+0000 7ff6c6600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff6c0153070 0x7ff6c015a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.749+0000 7ff6c6600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff6c0159dd0 0x7ff6c00cab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.749+0000 7ff6c6600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6c00cc5a0 0x7ff6c00cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.749+0000 7ff6c6600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c00ce830 con 0x7ff6c0159dd0 2024-08-17T02:26:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.749+0000 7ff6c6600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c00cdca0 con 0x7ff6c0153070 2024-08-17T02:26:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.749+0000 7ff6c6600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00cdf40 con 0x7ff6c00cc5a0 2024-08-17T02:26:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.749+0000 7ff6bfe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff6c0159dd0 0x7ff6c00cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.749+0000 7ff6bfe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff6c0159dd0 0x7ff6c00cab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40746/0 (socket says 172.21.15.6:40746) 2024-08-17T02:26:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.749+0000 7ff6bfe00640 1 -- 172.21.15.6:0/2256824143 learned_addr learned my addr 172.21.15.6:0/2256824143 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.749+0000 7ff6c5200640 1 --2- 172.21.15.6:0/2256824143 >> v2:172.21.15.136:3300/0 conn(0x7ff6c0153070 0x7ff6c015a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.749+0000 7ff6c5c00640 1 --2- 172.21.15.6:0/2256824143 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6c00cc5a0 0x7ff6c00cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.750+0000 7ff6bfe00640 1 -- 172.21.15.6:0/2256824143 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6c00cc5a0 msgr2=0x7ff6c00cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.750+0000 7ff6bfe00640 1 --2- 172.21.15.6:0/2256824143 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6c00cc5a0 0x7ff6c00cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.750+0000 7ff6bfe00640 1 -- 172.21.15.6:0/2256824143 >> v2:172.21.15.136:3300/0 conn(0x7ff6c0153070 msgr2=0x7ff6c015a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.750+0000 7ff6bfe00640 1 --2- 172.21.15.6:0/2256824143 >> v2:172.21.15.136:3300/0 conn(0x7ff6c0153070 0x7ff6c015a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.750+0000 7ff6bfe00640 1 -- 172.21.15.6:0/2256824143 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c00ccf60 con 0x7ff6c0159dd0 2024-08-17T02:26:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.750+0000 7ff6c5c00640 1 --2- 172.21.15.6:0/2256824143 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6c00cc5a0 0x7ff6c00cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.751+0000 7ff6bfe00640 1 --2- 172.21.15.6:0/2256824143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c0159dd0 0x7ff6c00cab30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff6c006f570 tx=0x7ff6ac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9f4486fa1da455 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.751+0000 7ff6bf400640 1 -- 172.21.15.6:0/2256824143 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac02ad40 con 0x7ff6c0159dd0 2024-08-17T02:26:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.751+0000 7ff6bf400640 1 -- 172.21.15.6:0/2256824143 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac032440 con 0x7ff6c0159dd0 2024-08-17T02:26:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.751+0000 7ff6bf400640 1 -- 172.21.15.6:0/2256824143 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac02aea0 con 0x7ff6c0159dd0 2024-08-17T02:26:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.752+0000 7ff6c6600640 1 -- 172.21.15.6:0/2256824143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c0159dd0 msgr2=0x7ff6c00cab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.752+0000 7ff6c6600640 1 --2- 172.21.15.6:0/2256824143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c0159dd0 0x7ff6c00cab30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff6c006f570 tx=0x7ff6ac0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.752+0000 7ff6c6600640 1 -- 172.21.15.6:0/2256824143 shutdown_connections 2024-08-17T02:26:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.752+0000 7ff6c6600640 1 --2- 172.21.15.6:0/2256824143 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6c00cc5a0 0x7ff6c00cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.752+0000 7ff6c6600640 1 --2- 172.21.15.6:0/2256824143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c0159dd0 0x7ff6c00cab30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.752+0000 7ff6c6600640 1 --2- 172.21.15.6:0/2256824143 >> v2:172.21.15.136:3300/0 conn(0x7ff6c0153070 0x7ff6c015a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.752+0000 7ff6c6600640 1 -- 172.21.15.6:0/2256824143 >> 172.21.15.6:0/2256824143 conn(0x7ff6c0087a80 msgr2=0x7ff6c006e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.752+0000 7ff6c6600640 1 -- 172.21.15.6:0/2256824143 shutdown_connections 2024-08-17T02:26:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.752+0000 7ff6c6600640 1 -- 172.21.15.6:0/2256824143 wait complete. 2024-08-17T02:26:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.753+0000 7ff6c6600640 1 Processor -- start 2024-08-17T02:26:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.753+0000 7ff6c6600640 1 -- start start 2024-08-17T02:26:55.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.754+0000 7ff6c6600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c00cc5a0 0x7ff6c0168800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.754+0000 7ff6c6600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6c0153070 0x7ff6c015add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.754+0000 7ff6c6600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6c0159dd0 0x7ff6c015b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.754+0000 7ff6c6600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00b5260 con 0x7ff6c00cc5a0 2024-08-17T02:26:55.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.754+0000 7ff6c6600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0168eb0 con 0x7ff6c0159dd0 2024-08-17T02:26:55.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.754+0000 7ff6c6600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0169190 con 0x7ff6c0153070 2024-08-17T02:26:55.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.754+0000 7ff6c5200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c00cc5a0 0x7ff6c0168800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.754+0000 7ff6c5200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c00cc5a0 0x7ff6c0168800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40752/0 (socket says 172.21.15.6:40752) 2024-08-17T02:26:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.754+0000 7ff6c5200640 1 -- 172.21.15.6:0/1143438440 learned_addr learned my addr 172.21.15.6:0/1143438440 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.754+0000 7ff6bfe00640 1 --2- 172.21.15.6:0/1143438440 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6c0153070 0x7ff6c015add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.754+0000 7ff6c5c00640 1 --2- 172.21.15.6:0/1143438440 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6c0159dd0 0x7ff6c015b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.755+0000 7ff6c5200640 1 -- 172.21.15.6:0/1143438440 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6c0153070 msgr2=0x7ff6c015add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.755+0000 7ff6c5200640 1 --2- 172.21.15.6:0/1143438440 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6c0153070 0x7ff6c015add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.755+0000 7ff6c5200640 1 -- 172.21.15.6:0/1143438440 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6c0159dd0 msgr2=0x7ff6c015b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.755+0000 7ff6c5200640 1 --2- 172.21.15.6:0/1143438440 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6c0159dd0 0x7ff6c015b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.755+0000 7ff6c5200640 1 -- 172.21.15.6:0/1143438440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac009450 con 0x7ff6c00cc5a0 2024-08-17T02:26:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.755+0000 7ff6bfe00640 1 --2- 172.21.15.6:0/1143438440 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6c0153070 0x7ff6c015add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.755+0000 7ff6c5200640 1 --2- 172.21.15.6:0/1143438440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c00cc5a0 0x7ff6c0168800 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400ea20 tx=0x7ff6b40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.755+0000 7ff6b3e00640 1 -- 172.21.15.6:0/1143438440 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b400ca10 con 0x7ff6c00cc5a0 2024-08-17T02:26:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.755+0000 7ff6b3e00640 1 -- 172.21.15.6:0/1143438440 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b400cb70 con 0x7ff6c00cc5a0 2024-08-17T02:26:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.755+0000 7ff6b3e00640 1 -- 172.21.15.6:0/1143438440 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4013470 con 0x7ff6c00cc5a0 2024-08-17T02:26:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.755+0000 7ff6c6600640 1 -- 172.21.15.6:0/1143438440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c0169470 con 0x7ff6c00cc5a0 2024-08-17T02:26:55.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.756+0000 7ff6c6600640 1 -- 172.21.15.6:0/1143438440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c0169ad0 con 0x7ff6c00cc5a0 2024-08-17T02:26:55.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.757+0000 7ff6c6600640 1 -- 172.21.15.6:0/1143438440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c0070720 con 0x7ff6c00cc5a0 2024-08-17T02:26:55.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.758+0000 7ff6b3e00640 1 -- 172.21.15.6:0/1143438440 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff6b4013860 con 0x7ff6c00cc5a0 2024-08-17T02:26:55.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.759+0000 7ff6b3e00640 1 --2- 172.21.15.6:0/1143438440 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff6a0065150 0x7ff6a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.759+0000 7ff6b3e00640 1 -- 172.21.15.6:0/1143438440 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff6b4082730 con 0x7ff6c00cc5a0 2024-08-17T02:26:55.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.759+0000 7ff6bfe00640 1 --2- 172.21.15.6:0/1143438440 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff6a0065150 0x7ff6a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.760+0000 7ff6bfe00640 1 --2- 172.21.15.6:0/1143438440 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff6a0065150 0x7ff6a0067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac034000 tx=0x7ff6ac032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.763+0000 7ff6b3e00640 1 -- 172.21.15.6:0/1143438440 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff6b4050800 con 0x7ff6c00cc5a0 2024-08-17T02:26:55.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.985+0000 7ff6c6600640 1 -- 172.21.15.6:0/1143438440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff6c015bf30 con 0x7ff6c00cc5a0 2024-08-17T02:26:55.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.985+0000 7ff6b3e00640 1 -- 172.21.15.6:0/1143438440 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff6b4053e20 con 0x7ff6c00cc5a0 2024-08-17T02:26:55.986 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:55.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.987+0000 7ff6c6600640 1 -- 172.21.15.6:0/1143438440 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff6a0065150 msgr2=0x7ff6a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.987+0000 7ff6c6600640 1 --2- 172.21.15.6:0/1143438440 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff6a0065150 0x7ff6a0067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac034000 tx=0x7ff6ac032000 comp rx=0 tx=0).stop 2024-08-17T02:26:55.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.987+0000 7ff6c6600640 1 -- 172.21.15.6:0/1143438440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c00cc5a0 msgr2=0x7ff6c0168800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.987+0000 7ff6c6600640 1 --2- 172.21.15.6:0/1143438440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c00cc5a0 0x7ff6c0168800 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400ea20 tx=0x7ff6b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.987+0000 7ff6c6600640 1 -- 172.21.15.6:0/1143438440 shutdown_connections 2024-08-17T02:26:55.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.987+0000 7ff6c6600640 1 --2- 172.21.15.6:0/1143438440 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff6a0065150 0x7ff6a0067600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.987+0000 7ff6c6600640 1 --2- 172.21.15.6:0/1143438440 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6c0159dd0 0x7ff6c015b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.987+0000 7ff6c6600640 1 --2- 172.21.15.6:0/1143438440 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6c0153070 0x7ff6c015add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.987+0000 7ff6c6600640 1 --2- 172.21.15.6:0/1143438440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c00cc5a0 0x7ff6c0168800 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.987+0000 7ff6c6600640 1 -- 172.21.15.6:0/1143438440 >> 172.21.15.6:0/1143438440 conn(0x7ff6c0087a80 msgr2=0x7ff6c00b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.987+0000 7ff6c6600640 1 -- 172.21.15.6:0/1143438440 shutdown_connections 2024-08-17T02:26:55.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:55.987+0000 7ff6c6600640 1 -- 172.21.15.6:0/1143438440 wait complete. 2024-08-17T02:26:56.003 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:56.003 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:56.003 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2024-08-17T02:26:56.003 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:26:56.003 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:56.003 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:56.004 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:56.004 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:56.004 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:26:56.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:56.004 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2024-08-17T02:26:56.039 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:56.039 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:56.040 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:56.040 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:56.040 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:56.040 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:56.040 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:56.040 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:56.040 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2024-08-17T02:26:56.041 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:56.041 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:56.041 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2024-08-17T02:26:56.041 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:56.041 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:56.041 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:56.041 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:56.042 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:26:56.042 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42670sec preferred_lft 42670sec 2024-08-17T02:26:56.042 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec4:7aff:fe88:6e43/64 scope link 2024-08-17T02:26:56.042 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:56.042 INFO:teuthology.orchestra.run.smithi136.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:56.043 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether b6:72:3e:1c:a3:5b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:56.043 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:26:56.043 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:56.043 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::d489:d1ff:fe99:4ad7/64 scope link 2024-08-17T02:26:56.043 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:56.043 INFO:teuthology.orchestra.run.smithi136.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:56.043 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether b6:72:3e:1c:a3:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:26:56.043 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::b472:3eff:fe1c:a35b/64 scope link 2024-08-17T02:26:56.043 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:56.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:56.044 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:56.138 INFO:teuthology.orchestra.run.smithi136.stdout:1 2024-08-17T02:26:56.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:56.141 DEBUG:teuthology.orchestra.run.smithi136:> route 2024-08-17T02:26:56.177 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2024-08-17T02:26:56.177 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:56.177 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:56.178 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:26:56.178 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:56.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:56.178 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-08-17T02:26:56.178 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-08-17T02:26:56.178 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:56.178 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:56.178 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:56.178 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-08-17T02:26:56.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:56.323 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-08-17T02:26:56.358 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:26:56.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:56.359 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list-id 2024-08-17T02:26:56.434 INFO:teuthology.orchestra.run.smithi136.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:26:56.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:56.435 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-08-17T02:26:56.435 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-08-17T02:26:56.435 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:26:56.435 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:26:56.435 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-08-17T02:26:56.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:56.560 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:26:56.615 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:56.615 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi136.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 52:60:fb:fb:6d:bd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::5060:fbff:fefb:6dbd/64 scope link 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:56.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:56.618 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:26:56.673 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:56.673 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:56.673 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:56.673 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:56.674 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:56.674 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:56.674 INFO:teuthology.orchestra.run.smithi136.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:56.674 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 52:60:fb:fb:6d:bd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:56.674 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:56.674 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:56.674 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::5060:fbff:fefb:6dbd/64 scope link 2024-08-17T02:26:56.674 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:56.676 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:26:56.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:56.677 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-08-17T02:26:56.677 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-08-17T02:26:56.677 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:26:56.677 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:56.677 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:26:56.677 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:26:56.677 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:26:56.677 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-08-17T02:26:56.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:56.843 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-08-17T02:26:56.843 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-08-17T02:26:56.843 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.1 up 2024-08-17T02:26:56.843 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:26:56.843 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-08-17T02:26:56.957 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:56.958 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:56.994 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:26:56.994 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:56.994 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:57.068 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-08-17T02:26:57.068 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:57.068 DEBUG:teuthology.orchestra.run.smithi136:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:57.189 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:57.189 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:57.215 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:57.216 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:57.216 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.136:3300,172.21.15.136:3301" 2024-08-17T02:26:57.216 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: trying mount with new device syntax: 3@61589148-c13d-47c7-8fbb-d1646bb8e5e2.cephfs=/ 2024-08-17T02:26:57.216 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.6:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2024-08-17T02:26:57.217 INFO:teuthology.orchestra.run.smithi136.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-08-17T02:26:57.217 INFO:teuthology.orchestra.run.smithi136.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:26:57.217 INFO:teuthology.orchestra.run.smithi136.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:26:57.217 INFO:teuthology.orchestra.run.smithi136.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:26:57.217 INFO:teuthology.orchestra.run.smithi136.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:26:57.220 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:26:57.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:57.220 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:57.275 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:26:57.292 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:57.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.453+0000 7f741e600640 1 Processor -- start 2024-08-17T02:26:57.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.453+0000 7f741e600640 1 -- start start 2024-08-17T02:26:57.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.455+0000 7f741e600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74180ad960 0x7f741815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.455+0000 7f741e600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74180add30 0x7f7418156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.455+0000 7f741e600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741815b5e0 con 0x7f74180ca050 2024-08-17T02:26:57.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.455+0000 7f741e600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74180cb160 con 0x7f74180add30 2024-08-17T02:26:57.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.455+0000 7f741e600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74180b0d10 con 0x7f74180ad960 2024-08-17T02:26:57.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.455+0000 7f7417e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74180add30 0x7f7418156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.455+0000 7f7417e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74180add30 0x7f7418156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40766/0 (socket says 172.21.15.6:40766) 2024-08-17T02:26:57.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.455+0000 7f7417e00640 1 -- 172.21.15.6:0/200615770 learned_addr learned my addr 172.21.15.6:0/200615770 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:57.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.455+0000 7f7417400640 1 --2- 172.21.15.6:0/200615770 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74180ad960 0x7f741815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.455+0000 7f7417e00640 1 -- 172.21.15.6:0/200615770 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74180ad960 msgr2=0x7f741815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:57.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.455+0000 7f7417e00640 1 --2- 172.21.15.6:0/200615770 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74180ad960 0x7f741815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.455+0000 7f7417e00640 1 -- 172.21.15.6:0/200615770 >> v1:172.21.15.136:6789/0 conn(0x7f74180ca050 legacy=0x7f7418156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.456+0000 7f7417e00640 1 -- 172.21.15.6:0/200615770 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74180ca550 con 0x7f74180add30 2024-08-17T02:26:57.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.457+0000 7f7417e00640 1 --2- 172.21.15.6:0/200615770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74180add30 0x7f7418156b30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7410009f20 tx=0x7f7410009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d805ec4379b58cf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.457+0000 7f7416a00640 1 -- 172.21.15.6:0/200615770 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7410032450 con 0x7f74180add30 2024-08-17T02:26:57.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.457+0000 7f7416a00640 1 -- 172.21.15.6:0/200615770 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74100325b0 con 0x7f74180add30 2024-08-17T02:26:57.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.457+0000 7f7416a00640 1 -- 172.21.15.6:0/200615770 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7410032990 con 0x7f74180add30 2024-08-17T02:26:57.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.457+0000 7f741e600640 1 -- 172.21.15.6:0/200615770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74180add30 msgr2=0x7f7418156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.457+0000 7f741e600640 1 --2- 172.21.15.6:0/200615770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74180add30 0x7f7418156b30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7410009f20 tx=0x7f7410009840 comp rx=0 tx=0).stop 2024-08-17T02:26:57.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.457+0000 7f741e600640 1 -- 172.21.15.6:0/200615770 shutdown_connections 2024-08-17T02:26:57.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.457+0000 7f741e600640 1 --2- 172.21.15.6:0/200615770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74180add30 0x7f7418156b30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.457+0000 7f741e600640 1 --2- 172.21.15.6:0/200615770 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74180ad960 0x7f741815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.457+0000 7f741e600640 1 -- 172.21.15.6:0/200615770 >> 172.21.15.6:0/200615770 conn(0x7f7418066e60 msgr2=0x7f7418067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.458+0000 7f741e600640 1 -- 172.21.15.6:0/200615770 shutdown_connections 2024-08-17T02:26:57.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.458+0000 7f741e600640 1 -- 172.21.15.6:0/200615770 wait complete. 2024-08-17T02:26:57.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.459+0000 7f741e600640 1 Processor -- start 2024-08-17T02:26:57.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.459+0000 7f741e600640 1 -- start start 2024-08-17T02:26:57.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.460+0000 7f741e600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74180ad960 0x7f7418147220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.460+0000 7f741e600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74180add30 0x7f7418152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.460+0000 7f741e600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74180ca050 0x7f7418157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.460+0000 7f741e600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74180ab4c0 con 0x7f74180ad960 2024-08-17T02:26:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.460+0000 7f741e600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74180ab7a0 con 0x7f74180add30 2024-08-17T02:26:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.460+0000 7f741e600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7418153580 con 0x7f74180ca050 2024-08-17T02:26:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.460+0000 7f7417400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74180ad960 0x7f7418147220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.460+0000 7f7417400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74180ad960 0x7f7418147220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40772/0 (socket says 172.21.15.6:40772) 2024-08-17T02:26:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.460+0000 7f7417400640 1 -- 172.21.15.6:0/4187121034 learned_addr learned my addr 172.21.15.6:0/4187121034 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.460+0000 7f740fe00640 1 --2- 172.21.15.6:0/4187121034 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74180add30 0x7f7418152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.460+0000 7f7417e00640 1 --2- 172.21.15.6:0/4187121034 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74180ca050 0x7f7418157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.461+0000 7f7417400640 1 -- 172.21.15.6:0/4187121034 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74180ca050 msgr2=0x7f7418157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.461+0000 7f7417400640 1 --2- 172.21.15.6:0/4187121034 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74180ca050 0x7f7418157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.461+0000 7f7417400640 1 -- 172.21.15.6:0/4187121034 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74180add30 msgr2=0x7f7418152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.461+0000 7f7417400640 1 --2- 172.21.15.6:0/4187121034 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74180add30 0x7f7418152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.461+0000 7f7417400640 1 -- 172.21.15.6:0/4187121034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7410009ae0 con 0x7f74180ad960 2024-08-17T02:26:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.461+0000 7f7417e00640 1 --2- 172.21.15.6:0/4187121034 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74180ca050 0x7f7418157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:57.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.461+0000 7f7417400640 1 --2- 172.21.15.6:0/4187121034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74180ad960 0x7f7418147220 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f740800d8c0 tx=0x7f7408008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.461+0000 7f740ea00640 1 -- 172.21.15.6:0/4187121034 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740800de50 con 0x7f74180ad960 2024-08-17T02:26:57.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.461+0000 7f740ea00640 1 -- 172.21.15.6:0/4187121034 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740800b8d0 con 0x7f74180ad960 2024-08-17T02:26:57.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.461+0000 7f740ea00640 1 -- 172.21.15.6:0/4187121034 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740800bc90 con 0x7f74180ad960 2024-08-17T02:26:57.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.461+0000 7f741e600640 1 -- 172.21.15.6:0/4187121034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7418153860 con 0x7f74180ad960 2024-08-17T02:26:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.461+0000 7f741e600640 1 -- 172.21.15.6:0/4187121034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7418159ff0 con 0x7f74180ad960 2024-08-17T02:26:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.462+0000 7f741e600640 1 -- 172.21.15.6:0/4187121034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7418063fb0 con 0x7f74180ad960 2024-08-17T02:26:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.463+0000 7f740ea00640 1 -- 172.21.15.6:0/4187121034 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f740801e460 con 0x7f74180ad960 2024-08-17T02:26:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.464+0000 7f740ea00640 1 --2- 172.21.15.6:0/4187121034 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f73f4065150 0x7f73f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.464+0000 7f740ea00640 1 -- 172.21.15.6:0/4187121034 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7408082b80 con 0x7f74180ad960 2024-08-17T02:26:57.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.464+0000 7f740fe00640 1 --2- 172.21.15.6:0/4187121034 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f73f4065150 0x7f73f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.465+0000 7f740fe00640 1 --2- 172.21.15.6:0/4187121034 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f73f4065150 0x7f73f4067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f74180ad5d0 tx=0x7f7400009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.468+0000 7f740ea00640 1 -- 172.21.15.6:0/4187121034 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7408050c50 con 0x7f74180ad960 2024-08-17T02:26:57.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.651+0000 7f741e600640 1 -- 172.21.15.6:0/4187121034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74180ab140 con 0x7f74180ad960 2024-08-17T02:26:57.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.652+0000 7f740ea00640 1 -- 172.21.15.6:0/4187121034 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f7408082e60 con 0x7f74180ad960 2024-08-17T02:26:57.682 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:57.682 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:33.190571+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:29.257601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:30.596556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.654+0000 7f741e600640 1 -- 172.21.15.6:0/4187121034 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f73f4065150 msgr2=0x7f73f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.654+0000 7f741e600640 1 --2- 172.21.15.6:0/4187121034 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f73f4065150 0x7f73f4067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f74180ad5d0 tx=0x7f7400009040 comp rx=0 tx=0).stop 2024-08-17T02:26:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.654+0000 7f741e600640 1 -- 172.21.15.6:0/4187121034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74180ad960 msgr2=0x7f7418147220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.654+0000 7f741e600640 1 --2- 172.21.15.6:0/4187121034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74180ad960 0x7f7418147220 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f740800d8c0 tx=0x7f7408008040 comp rx=0 tx=0).stop 2024-08-17T02:26:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.655+0000 7f741e600640 1 -- 172.21.15.6:0/4187121034 shutdown_connections 2024-08-17T02:26:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.655+0000 7f741e600640 1 --2- 172.21.15.6:0/4187121034 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f73f4065150 0x7f73f4067600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.655+0000 7f741e600640 1 --2- 172.21.15.6:0/4187121034 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74180ca050 0x7f7418157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.655+0000 7f741e600640 1 --2- 172.21.15.6:0/4187121034 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74180add30 0x7f7418152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.655+0000 7f741e600640 1 --2- 172.21.15.6:0/4187121034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74180ad960 0x7f7418147220 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.655+0000 7f741e600640 1 -- 172.21.15.6:0/4187121034 >> 172.21.15.6:0/4187121034 conn(0x7f7418066e60 msgr2=0x7f74180aeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.655+0000 7f741e600640 1 -- 172.21.15.6:0/4187121034 shutdown_connections 2024-08-17T02:26:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.655+0000 7f741e600640 1 -- 172.21.15.6:0/4187121034 wait complete. 2024-08-17T02:26:57.684 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:25.463503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:29.257601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:30.596556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:57.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:57.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.838+0000 7f9f83200640 1 Processor -- start 2024-08-17T02:26:57.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.839+0000 7f9f83200640 1 -- start start 2024-08-17T02:26:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.840+0000 7f9f83200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f7c0b0ac0 0x7f9f7c0add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.840+0000 7f9f83200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9f7c0ae860 0x7f9f7c0ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.840+0000 7f9f83200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7c0ad8a0 con 0x7f9f7c158e60 2024-08-17T02:26:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.840+0000 7f9f83200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7c06edf0 con 0x7f9f7c0b0ac0 2024-08-17T02:26:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.840+0000 7f9f83200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7c0acc90 con 0x7f9f7c0ae860 2024-08-17T02:26:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.840+0000 7f9f73e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f7c0b0ac0 0x7f9f7c0add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.840+0000 7f9f73e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f7c0b0ac0 0x7f9f7c0add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40788/0 (socket says 172.21.15.6:40788) 2024-08-17T02:26:57.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.840+0000 7f9f73e00640 1 -- 172.21.15.6:0/65205183 learned_addr learned my addr 172.21.15.6:0/65205183 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:57.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.840+0000 7f9f81200640 1 --2- 172.21.15.6:0/65205183 >> v2:172.21.15.136:3300/0 conn(0x7f9f7c0ae860 0x7f9f7c0ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.841+0000 7f9f73e00640 1 -- 172.21.15.6:0/65205183 >> v2:172.21.15.136:3300/0 conn(0x7f9f7c0ae860 msgr2=0x7f9f7c0ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:57.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.841+0000 7f9f73e00640 1 --2- 172.21.15.6:0/65205183 >> v2:172.21.15.136:3300/0 conn(0x7f9f7c0ae860 0x7f9f7c0ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.841+0000 7f9f73e00640 1 -- 172.21.15.6:0/65205183 >> v1:172.21.15.136:6789/0 conn(0x7f9f7c158e60 legacy=0x7f9f7c0b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.841+0000 7f9f73e00640 1 -- 172.21.15.6:0/65205183 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c0acf70 con 0x7f9f7c0b0ac0 2024-08-17T02:26:57.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.841+0000 7f9f81200640 1 --2- 172.21.15.6:0/65205183 >> v2:172.21.15.136:3300/0 conn(0x7f9f7c0ae860 0x7f9f7c0ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:57.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.842+0000 7f9f73e00640 1 --2- 172.21.15.6:0/65205183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f7c0b0ac0 0x7f9f7c0add30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0c80f0 tx=0x7f9f640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbcfeff4321d9ef server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.842+0000 7f9f7b400640 1 -- 172.21.15.6:0/65205183 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6402ae80 con 0x7f9f7c0b0ac0 2024-08-17T02:26:57.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.842+0000 7f9f7b400640 1 -- 172.21.15.6:0/65205183 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f64032440 con 0x7f9f7c0b0ac0 2024-08-17T02:26:57.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.842+0000 7f9f7b400640 1 -- 172.21.15.6:0/65205183 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f64032800 con 0x7f9f7c0b0ac0 2024-08-17T02:26:57.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.842+0000 7f9f83200640 1 -- 172.21.15.6:0/65205183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f7c0b0ac0 msgr2=0x7f9f7c0add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.842+0000 7f9f83200640 1 --2- 172.21.15.6:0/65205183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f7c0b0ac0 0x7f9f7c0add30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0c80f0 tx=0x7f9f640091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.843+0000 7f9f83200640 1 -- 172.21.15.6:0/65205183 shutdown_connections 2024-08-17T02:26:57.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.843+0000 7f9f83200640 1 --2- 172.21.15.6:0/65205183 >> v2:172.21.15.136:3300/0 conn(0x7f9f7c0ae860 0x7f9f7c0ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.843+0000 7f9f83200640 1 --2- 172.21.15.6:0/65205183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f7c0b0ac0 0x7f9f7c0add30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.843+0000 7f9f83200640 1 -- 172.21.15.6:0/65205183 >> 172.21.15.6:0/65205183 conn(0x7f9f7c0cc390 msgr2=0x7f9f7c066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.843+0000 7f9f83200640 1 -- 172.21.15.6:0/65205183 shutdown_connections 2024-08-17T02:26:57.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.843+0000 7f9f83200640 1 -- 172.21.15.6:0/65205183 wait complete. 2024-08-17T02:26:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.844+0000 7f9f83200640 1 Processor -- start 2024-08-17T02:26:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.844+0000 7f9f83200640 1 -- start start 2024-08-17T02:26:57.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.845+0000 7f9f83200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9f7c0ae860 0x7f9f7c145210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.845+0000 7f9f83200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f7c0b0ac0 0x7f9f7c14b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.845+0000 7f9f83200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f7c158e60 0x7f9f7c14bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.845+0000 7f9f83200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c146790 con 0x7f9f7c158e60 2024-08-17T02:26:57.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.845+0000 7f9f83200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c146a70 con 0x7f9f7c0b0ac0 2024-08-17T02:26:57.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.845+0000 7f9f83200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c146d50 con 0x7f9f7c0ae860 2024-08-17T02:26:57.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.845+0000 7f9f81200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f7c158e60 0x7f9f7c14bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.845+0000 7f9f81200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f7c158e60 0x7f9f7c14bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40790/0 (socket says 172.21.15.6:40790) 2024-08-17T02:26:57.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.845+0000 7f9f81200640 1 -- 172.21.15.6:0/3813650017 learned_addr learned my addr 172.21.15.6:0/3813650017 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:57.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.846+0000 7f9f7be00640 1 --2- 172.21.15.6:0/3813650017 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9f7c0ae860 0x7f9f7c145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.846+0000 7f9f73e00640 1 --2- 172.21.15.6:0/3813650017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f7c0b0ac0 0x7f9f7c14b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.846+0000 7f9f81200640 1 -- 172.21.15.6:0/3813650017 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9f7c0ae860 msgr2=0x7f9f7c145210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.846+0000 7f9f81200640 1 --2- 172.21.15.6:0/3813650017 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9f7c0ae860 0x7f9f7c145210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.846+0000 7f9f81200640 1 -- 172.21.15.6:0/3813650017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f7c0b0ac0 msgr2=0x7f9f7c14b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.846+0000 7f9f81200640 1 --2- 172.21.15.6:0/3813650017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f7c0b0ac0 0x7f9f7c14b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.846+0000 7f9f81200640 1 -- 172.21.15.6:0/3813650017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f64009450 con 0x7f9f7c158e60 2024-08-17T02:26:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.846+0000 7f9f81200640 1 --2- 172.21.15.6:0/3813650017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f7c158e60 0x7f9f7c14bb30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400d180 tx=0x7f9f74009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.846+0000 7f9f73400640 1 -- 172.21.15.6:0/3813650017 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74015440 con 0x7f9f7c158e60 2024-08-17T02:26:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.846+0000 7f9f73400640 1 -- 172.21.15.6:0/3813650017 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7400f040 con 0x7f9f7c158e60 2024-08-17T02:26:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.846+0000 7f9f73400640 1 -- 172.21.15.6:0/3813650017 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74015810 con 0x7f9f7c158e60 2024-08-17T02:26:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.847+0000 7f9f83200640 1 -- 172.21.15.6:0/3813650017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7c147030 con 0x7f9f7c158e60 2024-08-17T02:26:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.847+0000 7f9f83200640 1 -- 172.21.15.6:0/3813650017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7c147810 con 0x7f9f7c158e60 2024-08-17T02:26:57.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.848+0000 7f9f83200640 1 -- 172.21.15.6:0/3813650017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7c063fb0 con 0x7f9f7c158e60 2024-08-17T02:26:57.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.849+0000 7f9f73400640 1 -- 172.21.15.6:0/3813650017 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9f7401e3b0 con 0x7f9f7c158e60 2024-08-17T02:26:57.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.849+0000 7f9f73400640 1 --2- 172.21.15.6:0/3813650017 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9f58065150 0x7f9f58067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.850+0000 7f9f73400640 1 -- 172.21.15.6:0/3813650017 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9f74082e60 con 0x7f9f7c158e60 2024-08-17T02:26:57.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.850+0000 7f9f7be00640 1 --2- 172.21.15.6:0/3813650017 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9f58065150 0x7f9f58067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.851+0000 7f9f7be00640 1 --2- 172.21.15.6:0/3813650017 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9f58065150 0x7f9f58067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c007fd0 tx=0x7f9f6c007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:57.854+0000 7f9f73400640 1 -- 172.21.15.6:0/3813650017 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9f74050f30 con 0x7f9f7c158e60 2024-08-17T02:26:58.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.037+0000 7f9f83200640 1 -- 172.21.15.6:0/3813650017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f7c0ab630 con 0x7f9f7c158e60 2024-08-17T02:26:58.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.037+0000 7f9f73400640 1 -- 172.21.15.6:0/3813650017 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f7401a020 con 0x7f9f7c158e60 2024-08-17T02:26:58.038 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-08-17T02:26:58.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.039+0000 7f9f83200640 1 -- 172.21.15.6:0/3813650017 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9f58065150 msgr2=0x7f9f58067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.039+0000 7f9f83200640 1 --2- 172.21.15.6:0/3813650017 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9f58065150 0x7f9f58067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c007fd0 tx=0x7f9f6c007e30 comp rx=0 tx=0).stop 2024-08-17T02:26:58.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.039+0000 7f9f83200640 1 -- 172.21.15.6:0/3813650017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f7c158e60 msgr2=0x7f9f7c14bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.039+0000 7f9f83200640 1 --2- 172.21.15.6:0/3813650017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f7c158e60 0x7f9f7c14bb30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400d180 tx=0x7f9f74009a50 comp rx=0 tx=0).stop 2024-08-17T02:26:58.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.039+0000 7f9f83200640 1 -- 172.21.15.6:0/3813650017 shutdown_connections 2024-08-17T02:26:58.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.039+0000 7f9f83200640 1 --2- 172.21.15.6:0/3813650017 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9f58065150 0x7f9f58067600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.039+0000 7f9f83200640 1 --2- 172.21.15.6:0/3813650017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f7c158e60 0x7f9f7c14bb30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.039+0000 7f9f83200640 1 --2- 172.21.15.6:0/3813650017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f7c0b0ac0 0x7f9f7c14b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.039+0000 7f9f83200640 1 --2- 172.21.15.6:0/3813650017 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9f7c0ae860 0x7f9f7c145210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.039+0000 7f9f83200640 1 -- 172.21.15.6:0/3813650017 >> 172.21.15.6:0/3813650017 conn(0x7f9f7c0cc390 msgr2=0x7f9f7c069920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.039+0000 7f9f83200640 1 -- 172.21.15.6:0/3813650017 shutdown_connections 2024-08-17T02:26:58.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.039+0000 7f9f83200640 1 -- 172.21.15.6:0/3813650017 wait complete. 2024-08-17T02:26:58.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.209+0000 7f9337200640 1 Processor -- start 2024-08-17T02:26:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.209+0000 7f9337200640 1 -- start start 2024-08-17T02:26:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.210+0000 7f9337200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9330158a20 0x7f93300a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.211+0000 7f9337200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f93300ae860 0x7f933006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.211+0000 7f9337200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93300aed90 con 0x7f9330158df0 2024-08-17T02:26:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.211+0000 7f9337200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93300af070 con 0x7f93300ae860 2024-08-17T02:26:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.211+0000 7f9337200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93300af350 con 0x7f9330158a20 2024-08-17T02:26:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.211+0000 7f9327e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f93300ae860 0x7f933006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.211+0000 7f9335200640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9330158df0 0x7f933015c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40170/0 (socket says 172.21.15.6:40170) 2024-08-17T02:26:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.211+0000 7f9335200640 1 -- 172.21.15.6:0/1699746604 learned_addr learned my addr 172.21.15.6:0/1699746604 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.211+0000 7f932fe00640 1 --2- 172.21.15.6:0/1699746604 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9330158a20 0x7f93300a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.211+0000 7f9327e00640 1 -- 172.21.15.6:0/1699746604 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9330158a20 msgr2=0x7f93300a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.211+0000 7f9327e00640 1 --2- 172.21.15.6:0/1699746604 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9330158a20 0x7f93300a89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.211+0000 7f9327e00640 1 -- 172.21.15.6:0/1699746604 >> v1:172.21.15.6:6789/0 conn(0x7f9330158df0 legacy=0x7f933015c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.211+0000 7f9327e00640 1 -- 172.21.15.6:0/1699746604 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93300af630 con 0x7f93300ae860 2024-08-17T02:26:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.212+0000 7f9327e00640 1 --2- 172.21.15.6:0/1699746604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93300ae860 0x7f933006d7d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9318009850 tx=0x7f93180090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0bb28981bea9c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.213+0000 7f932f400640 1 -- 172.21.15.6:0/1699746604 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931802ad90 con 0x7f93300ae860 2024-08-17T02:26:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.213+0000 7f932f400640 1 -- 172.21.15.6:0/1699746604 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9318032440 con 0x7f93300ae860 2024-08-17T02:26:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.213+0000 7f932f400640 1 -- 172.21.15.6:0/1699746604 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318032820 con 0x7f93300ae860 2024-08-17T02:26:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.213+0000 7f9337200640 1 -- 172.21.15.6:0/1699746604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93300ae860 msgr2=0x7f933006d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.213+0000 7f9337200640 1 --2- 172.21.15.6:0/1699746604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93300ae860 0x7f933006d7d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9318009850 tx=0x7f93180090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.213+0000 7f9337200640 1 -- 172.21.15.6:0/1699746604 shutdown_connections 2024-08-17T02:26:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.213+0000 7f9337200640 1 --2- 172.21.15.6:0/1699746604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93300ae860 0x7f933006d7d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.213+0000 7f9337200640 1 --2- 172.21.15.6:0/1699746604 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9330158a20 0x7f93300a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.213+0000 7f9337200640 1 -- 172.21.15.6:0/1699746604 >> 172.21.15.6:0/1699746604 conn(0x7f9330066e60 msgr2=0x7f9330067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.213+0000 7f9337200640 1 -- 172.21.15.6:0/1699746604 shutdown_connections 2024-08-17T02:26:58.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.213+0000 7f9337200640 1 -- 172.21.15.6:0/1699746604 wait complete. 2024-08-17T02:26:58.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.215+0000 7f9337200640 1 Processor -- start 2024-08-17T02:26:58.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.215+0000 7f9337200640 1 -- start start 2024-08-17T02:26:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.216+0000 7f9337200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93300ae860 0x7f9330146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.216+0000 7f9337200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9330158a20 0x7f9330159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.216+0000 7f9337200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9330158df0 0x7f933015aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.216+0000 7f9337200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93301692e0 con 0x7f9330158df0 2024-08-17T02:26:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.216+0000 7f9337200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9330155fe0 con 0x7f9330158a20 2024-08-17T02:26:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.216+0000 7f9337200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9330156b60 con 0x7f93300ae860 2024-08-17T02:26:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.216+0000 7f9335200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9330158df0 0x7f933015aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.216+0000 7f932fe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93300ae860 0x7f9330146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.216+0000 7f9335200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9330158df0 0x7f933015aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40798/0 (socket says 172.21.15.6:40798) 2024-08-17T02:26:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.216+0000 7f9335200640 1 -- 172.21.15.6:0/115266214 learned_addr learned my addr 172.21.15.6:0/115266214 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.216+0000 7f9327e00640 1 --2- 172.21.15.6:0/115266214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9330158a20 0x7f9330159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.216+0000 7f9335200640 1 -- 172.21.15.6:0/115266214 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93300ae860 msgr2=0x7f9330146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.216+0000 7f9335200640 1 --2- 172.21.15.6:0/115266214 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93300ae860 0x7f9330146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.216+0000 7f9335200640 1 -- 172.21.15.6:0/115266214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9330158a20 msgr2=0x7f9330159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.216+0000 7f9335200640 1 --2- 172.21.15.6:0/115266214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9330158a20 0x7f9330159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.216+0000 7f9335200640 1 -- 172.21.15.6:0/115266214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9318009390 con 0x7f9330158df0 2024-08-17T02:26:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.217+0000 7f9335200640 1 --2- 172.21.15.6:0/115266214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9330158df0 0x7f933015aca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f932800cbc0 tx=0x7f93280019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.217+0000 7f9327400640 1 -- 172.21.15.6:0/115266214 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932800a640 con 0x7f9330158df0 2024-08-17T02:26:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.217+0000 7f9327400640 1 -- 172.21.15.6:0/115266214 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932800a7a0 con 0x7f9330158df0 2024-08-17T02:26:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.217+0000 7f9327400640 1 -- 172.21.15.6:0/115266214 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932800ab20 con 0x7f9330158df0 2024-08-17T02:26:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.217+0000 7f9337200640 1 -- 172.21.15.6:0/115266214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9330146a90 con 0x7f9330158df0 2024-08-17T02:26:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.217+0000 7f9337200640 1 -- 172.21.15.6:0/115266214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9330156510 con 0x7f9330158df0 2024-08-17T02:26:58.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.218+0000 7f9337200640 1 -- 172.21.15.6:0/115266214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9330156cd0 con 0x7f9330158df0 2024-08-17T02:26:58.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.219+0000 7f9327400640 1 -- 172.21.15.6:0/115266214 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9328007300 con 0x7f9330158df0 2024-08-17T02:26:58.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.220+0000 7f9327400640 1 --2- 172.21.15.6:0/115266214 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f930c065150 0x7f930c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.220+0000 7f9327400640 1 -- 172.21.15.6:0/115266214 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9328082610 con 0x7f9330158df0 2024-08-17T02:26:58.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.221+0000 7f932fe00640 1 --2- 172.21.15.6:0/115266214 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f930c065150 0x7f930c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.221+0000 7f932fe00640 1 --2- 172.21.15.6:0/115266214 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f930c065150 0x7f930c067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9320009d20 tx=0x7f93200090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.224+0000 7f9327400640 1 -- 172.21.15.6:0/115266214 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9328050820 con 0x7f9330158df0 2024-08-17T02:26:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.404+0000 7f9337200640 1 -- 172.21.15.6:0/115266214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9330063fb0 con 0x7f9330158df0 2024-08-17T02:26:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.404+0000 7f9327400640 1 -- 172.21.15.6:0/115266214 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9328053e40 con 0x7f9330158df0 2024-08-17T02:26:58.405 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-08-17T02:26:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.406+0000 7f9337200640 1 -- 172.21.15.6:0/115266214 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f930c065150 msgr2=0x7f930c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.406+0000 7f9337200640 1 --2- 172.21.15.6:0/115266214 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f930c065150 0x7f930c067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9320009d20 tx=0x7f93200090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.406+0000 7f9337200640 1 -- 172.21.15.6:0/115266214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9330158df0 msgr2=0x7f933015aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.406+0000 7f9337200640 1 --2- 172.21.15.6:0/115266214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9330158df0 0x7f933015aca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f932800cbc0 tx=0x7f93280019c0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.407+0000 7f9337200640 1 -- 172.21.15.6:0/115266214 shutdown_connections 2024-08-17T02:26:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.407+0000 7f9337200640 1 --2- 172.21.15.6:0/115266214 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f930c065150 0x7f930c067600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.407+0000 7f9337200640 1 --2- 172.21.15.6:0/115266214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9330158df0 0x7f933015aca0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.407+0000 7f9337200640 1 --2- 172.21.15.6:0/115266214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9330158a20 0x7f9330159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.407+0000 7f9337200640 1 --2- 172.21.15.6:0/115266214 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93300ae860 0x7f9330146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.407+0000 7f9337200640 1 -- 172.21.15.6:0/115266214 >> 172.21.15.6:0/115266214 conn(0x7f9330066e60 msgr2=0x7f93301522b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.407+0000 7f9337200640 1 -- 172.21.15.6:0/115266214 shutdown_connections 2024-08-17T02:26:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.407+0000 7f9337200640 1 -- 172.21.15.6:0/115266214 wait complete. 2024-08-17T02:26:58.422 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:58.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.575+0000 7f43c9c00640 1 Processor -- start 2024-08-17T02:26:58.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.575+0000 7f43c9c00640 1 -- start start 2024-08-17T02:26:58.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.577+0000 7f43c9c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f43c40d0650 0x7f43c40b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.577+0000 7f43c9c00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c40ce770 con 0x7f43c41585a0 2024-08-17T02:26:58.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.577+0000 7f43c9c00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c40ce9b0 con 0x7f43c40b1850 2024-08-17T02:26:58.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.577+0000 7f43c9c00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c40cec90 con 0x7f43c40d0650 2024-08-17T02:26:58.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.577+0000 7f43c9200640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f43c41585a0 0x7f43c41589d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40184/0 (socket says 172.21.15.6:40184) 2024-08-17T02:26:58.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.577+0000 7f43c9200640 1 -- 172.21.15.6:0/63516801 learned_addr learned my addr 172.21.15.6:0/63516801 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:58.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.577+0000 7f43bbe00640 1 --2- 172.21.15.6:0/63516801 >> v2:172.21.15.136:3300/0 conn(0x7f43c40d0650 0x7f43c40b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.577+0000 7f43c3400640 1 -- 172.21.15.6:0/63516801 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360708618 0 0) 0x7f43bc001490 con 0x7f43c41585a0 2024-08-17T02:26:58.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43c3400640 1 -- 172.21.15.6:0/63516801 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43a80034e0 con 0x7f43c41585a0 2024-08-17T02:26:58.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43c3400640 1 -- 172.21.15.6:0/63516801 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329946021 0 0) 0x7f43c40ce9b0 con 0x7f43c40b1850 2024-08-17T02:26:58.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43c3400640 1 -- 172.21.15.6:0/63516801 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43bc001490 con 0x7f43c40b1850 2024-08-17T02:26:58.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43c3400640 1 -- 172.21.15.6:0/63516801 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 287547122 0 0) 0x7f43a80034e0 con 0x7f43c41585a0 2024-08-17T02:26:58.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43c3400640 1 -- 172.21.15.6:0/63516801 >> v2:172.21.15.136:3300/0 conn(0x7f43c40d0650 msgr2=0x7f43c40b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43c3400640 1 --2- 172.21.15.6:0/63516801 >> v2:172.21.15.136:3300/0 conn(0x7f43c40d0650 0x7f43c40b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43c3400640 1 -- 172.21.15.6:0/63516801 >> v1:172.21.15.136:6789/0 conn(0x7f43c40b1850 legacy=0x7f43c40ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43c3400640 1 -- 172.21.15.6:0/63516801 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c40cef70 con 0x7f43c41585a0 2024-08-17T02:26:58.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43c3400640 1 -- 172.21.15.6:0/63516801 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f43bc001980 con 0x7f43c41585a0 2024-08-17T02:26:58.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43c3400640 1 -- 172.21.15.6:0/63516801 >> v1:172.21.15.6:6789/0 conn(0x7f43c41585a0 legacy=0x7f43c41589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43c3400640 1 --2- 172.21.15.6:0/63516801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a8003bb0 0x7f43a8003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43c3400640 1 --2- 172.21.15.6:0/63516801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43a8004780 0x7f43a8004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43c3400640 1 --2- 172.21.15.6:0/63516801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43a8005180 0x7f43a800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43c3400640 1 -- 172.21.15.6:0/63516801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40cec90 con 0x7f43a8003bb0 2024-08-17T02:26:58.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43c3400640 1 -- 172.21.15.6:0/63516801 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a800c0a0 con 0x7f43a8004780 2024-08-17T02:26:58.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43c3400640 1 -- 172.21.15.6:0/63516801 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a800c230 con 0x7f43a8005180 2024-08-17T02:26:58.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43c3e00640 1 --2- 172.21.15.6:0/63516801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a8003bb0 0x7f43a8003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.578+0000 7f43bbe00640 1 --2- 172.21.15.6:0/63516801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43a8004780 0x7f43a8004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.579+0000 7f43c9200640 1 --2- 172.21.15.6:0/63516801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43a8005180 0x7f43a800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.579+0000 7f43c3e00640 1 -- 172.21.15.6:0/63516801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43a8005180 msgr2=0x7f43a800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.579+0000 7f43c3e00640 1 --2- 172.21.15.6:0/63516801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43a8005180 0x7f43a800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.579+0000 7f43c3e00640 1 -- 172.21.15.6:0/63516801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43a8004780 msgr2=0x7f43a8004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.579+0000 7f43c3e00640 1 --2- 172.21.15.6:0/63516801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43a8004780 0x7f43a8004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.579+0000 7f43c3e00640 1 -- 172.21.15.6:0/63516801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a80034e0 con 0x7f43a8003bb0 2024-08-17T02:26:58.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.579+0000 7f43c9200640 1 -- 172.21.15.6:0/63516801 reap_dead start 2024-08-17T02:26:58.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.580+0000 7f43c3e00640 1 --2- 172.21.15.6:0/63516801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a8003bb0 0x7f43a8003fa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f43b4001990 tx=0x7f43b4007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05a394805681f14 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.580+0000 7f43c3400640 1 -- 172.21.15.6:0/63516801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b402aa20 con 0x7f43a8003bb0 2024-08-17T02:26:58.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.580+0000 7f43c3400640 1 -- 172.21.15.6:0/63516801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b402ab80 con 0x7f43a8003bb0 2024-08-17T02:26:58.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.580+0000 7f43c3400640 1 -- 172.21.15.6:0/63516801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b40323f0 con 0x7f43a8003bb0 2024-08-17T02:26:58.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.580+0000 7f43c9c00640 1 -- 172.21.15.6:0/63516801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a8003bb0 msgr2=0x7f43a8003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.580+0000 7f43c9c00640 1 --2- 172.21.15.6:0/63516801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a8003bb0 0x7f43a8003fa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f43b4001990 tx=0x7f43b4007ca0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.581+0000 7f43c9c00640 1 -- 172.21.15.6:0/63516801 shutdown_connections 2024-08-17T02:26:58.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.581+0000 7f43c9c00640 1 --2- 172.21.15.6:0/63516801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a8003bb0 0x7f43a8003fa0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.581+0000 7f43c9c00640 1 -- 172.21.15.6:0/63516801 >> 172.21.15.6:0/63516801 conn(0x7f43c406e590 msgr2=0x7f43c406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.581+0000 7f43c9c00640 1 -- 172.21.15.6:0/63516801 shutdown_connections 2024-08-17T02:26:58.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.581+0000 7f43c9c00640 1 -- 172.21.15.6:0/63516801 wait complete. 2024-08-17T02:26:58.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.582+0000 7f43c9c00640 1 Processor -- start 2024-08-17T02:26:58.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.582+0000 7f43c9c00640 1 -- start start 2024-08-17T02:26:58.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.583+0000 7f43c9c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43a8003bb0 0x7f43c4150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.583+0000 7f43c9c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c41595f0 0x7f43c415b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.583+0000 7f43c9c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43c41424b0 0x7f43c41547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.583+0000 7f43c9c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c415a320 con 0x7f43c41595f0 2024-08-17T02:26:58.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.583+0000 7f43c9c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c4159d60 con 0x7f43c41424b0 2024-08-17T02:26:58.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.583+0000 7f43c9c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c415a040 con 0x7f43a8003bb0 2024-08-17T02:26:58.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.583+0000 7f43bbe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c41595f0 0x7f43c415b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.583+0000 7f43bbe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c41595f0 0x7f43c415b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40830/0 (socket says 172.21.15.6:40830) 2024-08-17T02:26:58.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.583+0000 7f43bbe00640 1 -- 172.21.15.6:0/2804459675 learned_addr learned my addr 172.21.15.6:0/2804459675 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:58.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.584+0000 7f43c3e00640 1 --2- 172.21.15.6:0/2804459675 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43a8003bb0 0x7f43c4150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.584+0000 7f43c9200640 1 --2- 172.21.15.6:0/2804459675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43c41424b0 0x7f43c41547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.584+0000 7f43bbe00640 1 -- 172.21.15.6:0/2804459675 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43a8003bb0 msgr2=0x7f43c4150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.584+0000 7f43bbe00640 1 --2- 172.21.15.6:0/2804459675 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43a8003bb0 0x7f43c4150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.584+0000 7f43bbe00640 1 -- 172.21.15.6:0/2804459675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43c41424b0 msgr2=0x7f43c41547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.584+0000 7f43bbe00640 1 --2- 172.21.15.6:0/2804459675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43c41424b0 0x7f43c41547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.584+0000 7f43bbe00640 1 -- 172.21.15.6:0/2804459675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c4151e00 con 0x7f43c41595f0 2024-08-17T02:26:58.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.584+0000 7f43bbe00640 1 --2- 172.21.15.6:0/2804459675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c41595f0 0x7f43c415b800 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f43ac011b40 tx=0x7f43ac0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.584+0000 7f43bb400640 1 -- 172.21.15.6:0/2804459675 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac00fb00 con 0x7f43c41595f0 2024-08-17T02:26:58.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.584+0000 7f43bb400640 1 -- 172.21.15.6:0/2804459675 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac00fc60 con 0x7f43c41595f0 2024-08-17T02:26:58.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.584+0000 7f43bb400640 1 -- 172.21.15.6:0/2804459675 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac014440 con 0x7f43c41595f0 2024-08-17T02:26:58.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.584+0000 7f43c9c00640 1 -- 172.21.15.6:0/2804459675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c41520e0 con 0x7f43c41595f0 2024-08-17T02:26:58.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.585+0000 7f43c9c00640 1 -- 172.21.15.6:0/2804459675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c415bd40 con 0x7f43c41595f0 2024-08-17T02:26:58.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.585+0000 7f43c9c00640 1 -- 172.21.15.6:0/2804459675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c4070720 con 0x7f43c41595f0 2024-08-17T02:26:58.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.586+0000 7f43bb400640 1 -- 172.21.15.6:0/2804459675 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f43ac0147f0 con 0x7f43c41595f0 2024-08-17T02:26:58.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.587+0000 7f43bb400640 1 --2- 172.21.15.6:0/2804459675 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f43a0065180 0x7f43a0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.587+0000 7f43bb400640 1 -- 172.21.15.6:0/2804459675 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43ac018030 con 0x7f43c41595f0 2024-08-17T02:26:58.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.587+0000 7f43c3e00640 1 --2- 172.21.15.6:0/2804459675 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f43a0065180 0x7f43a0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.588+0000 7f43c3e00640 1 --2- 172.21.15.6:0/2804459675 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f43a0065180 0x7f43a0067630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f43b4032000 tx=0x7f43b4003000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.591+0000 7f43bb400640 1 -- 172.21.15.6:0/2804459675 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f43ac054ab0 con 0x7f43c41595f0 2024-08-17T02:26:58.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.772+0000 7f43c9c00640 1 -- 172.21.15.6:0/2804459675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f43c4068140 con 0x7f43c41595f0 2024-08-17T02:26:58.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.772+0000 7f43bb400640 1 -- 172.21.15.6:0/2804459675 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f43ac0220a0 con 0x7f43c41595f0 2024-08-17T02:26:58.773 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-08-17T02:26:58.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.774+0000 7f43c9c00640 1 -- 172.21.15.6:0/2804459675 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f43a0065180 msgr2=0x7f43a0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.774+0000 7f43c9c00640 1 --2- 172.21.15.6:0/2804459675 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f43a0065180 0x7f43a0067630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f43b4032000 tx=0x7f43b4003000 comp rx=0 tx=0).stop 2024-08-17T02:26:58.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.774+0000 7f43c9c00640 1 -- 172.21.15.6:0/2804459675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c41595f0 msgr2=0x7f43c415b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.774+0000 7f43c9c00640 1 --2- 172.21.15.6:0/2804459675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c41595f0 0x7f43c415b800 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f43ac011b40 tx=0x7f43ac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.774+0000 7f43c9c00640 1 -- 172.21.15.6:0/2804459675 shutdown_connections 2024-08-17T02:26:58.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.774+0000 7f43c9c00640 1 --2- 172.21.15.6:0/2804459675 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f43a0065180 0x7f43a0067630 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.774+0000 7f43c9c00640 1 --2- 172.21.15.6:0/2804459675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43c41424b0 0x7f43c41547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.774+0000 7f43c9c00640 1 --2- 172.21.15.6:0/2804459675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c41595f0 0x7f43c415b800 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.774+0000 7f43c9c00640 1 --2- 172.21.15.6:0/2804459675 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43a8003bb0 0x7f43c4150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.774+0000 7f43c9c00640 1 -- 172.21.15.6:0/2804459675 >> 172.21.15.6:0/2804459675 conn(0x7f43c406e590 msgr2=0x7f43c4157720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.774+0000 7f43c9c00640 1 -- 172.21.15.6:0/2804459675 shutdown_connections 2024-08-17T02:26:58.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.774+0000 7f43c9c00640 1 -- 172.21.15.6:0/2804459675 wait complete. 2024-08-17T02:26:58.790 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:58.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.942+0000 7f10cbe00640 1 Processor -- start 2024-08-17T02:26:58.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.942+0000 7f10cbe00640 1 -- start start 2024-08-17T02:26:58.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.944+0000 7f10cbe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f10cc158c60 0x7f10cc15a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.944+0000 7f10cbe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f10cc159030 0x7f10cc0ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.944+0000 7f10cbe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f10cc159420 0x7f10cc0b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.944+0000 7f10cbe00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc0b0540 con 0x7f10cc159030 2024-08-17T02:26:58.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.944+0000 7f10cbe00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc15b6b0 con 0x7f10cc159420 2024-08-17T02:26:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.944+0000 7f10cbe00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc15aac0 con 0x7f10cc158c60 2024-08-17T02:26:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.944+0000 7f10ca000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f10cc159030 0x7f10cc0ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.944+0000 7f10ca000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f10cc159030 0x7f10cc0ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40844/0 (socket says 172.21.15.6:40844) 2024-08-17T02:26:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.944+0000 7f10ca000640 1 -- 172.21.15.6:0/4220110597 learned_addr learned my addr 172.21.15.6:0/4220110597 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.944+0000 7f10cb400640 1 --2- 172.21.15.6:0/4220110597 >> v2:172.21.15.136:3300/0 conn(0x7f10cc159420 0x7f10cc0b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.944+0000 7f10caa00640 1 --2- 172.21.15.6:0/4220110597 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f10cc158c60 0x7f10cc15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.944+0000 7f10ca000640 1 -- 172.21.15.6:0/4220110597 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f10cc158c60 msgr2=0x7f10cc15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.944+0000 7f10ca000640 1 --2- 172.21.15.6:0/4220110597 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f10cc158c60 0x7f10cc15a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.944+0000 7f10ca000640 1 -- 172.21.15.6:0/4220110597 >> v2:172.21.15.136:3300/0 conn(0x7f10cc159420 msgr2=0x7f10cc0b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.944+0000 7f10ca000640 1 --2- 172.21.15.6:0/4220110597 >> v2:172.21.15.136:3300/0 conn(0x7f10cc159420 0x7f10cc0b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.944+0000 7f10ca000640 1 -- 172.21.15.6:0/4220110597 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc15ad80 con 0x7f10cc159030 2024-08-17T02:26:58.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.945+0000 7f10ca000640 1 --2- 172.21.15.6:0/4220110597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10cc159030 0x7f10cc0ca8b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0b57a0 tx=0x7f10b80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4290bc974e83a53 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.945+0000 7f10c9600640 1 -- 172.21.15.6:0/4220110597 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b802ad40 con 0x7f10cc159030 2024-08-17T02:26:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.946+0000 7f10c9600640 1 -- 172.21.15.6:0/4220110597 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b8032440 con 0x7f10cc159030 2024-08-17T02:26:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.946+0000 7f10c9600640 1 -- 172.21.15.6:0/4220110597 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b802aea0 con 0x7f10cc159030 2024-08-17T02:26:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.946+0000 7f10cbe00640 1 -- 172.21.15.6:0/4220110597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10cc159030 msgr2=0x7f10cc0ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.946+0000 7f10cbe00640 1 --2- 172.21.15.6:0/4220110597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10cc159030 0x7f10cc0ca8b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0b57a0 tx=0x7f10b80091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.946+0000 7f10cbe00640 1 -- 172.21.15.6:0/4220110597 shutdown_connections 2024-08-17T02:26:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.946+0000 7f10cbe00640 1 --2- 172.21.15.6:0/4220110597 >> v2:172.21.15.136:3300/0 conn(0x7f10cc159420 0x7f10cc0b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.946+0000 7f10cbe00640 1 --2- 172.21.15.6:0/4220110597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10cc159030 0x7f10cc0ca8b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.946+0000 7f10cbe00640 1 --2- 172.21.15.6:0/4220110597 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f10cc158c60 0x7f10cc15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.946+0000 7f10cbe00640 1 -- 172.21.15.6:0/4220110597 >> 172.21.15.6:0/4220110597 conn(0x7f10cc06e590 msgr2=0x7f10cc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.946+0000 7f10cbe00640 1 -- 172.21.15.6:0/4220110597 shutdown_connections 2024-08-17T02:26:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.946+0000 7f10cbe00640 1 -- 172.21.15.6:0/4220110597 wait complete. 2024-08-17T02:26:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.948+0000 7f10cbe00640 1 Processor -- start 2024-08-17T02:26:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.948+0000 7f10cbe00640 1 -- start start 2024-08-17T02:26:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.949+0000 7f10cbe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f10cc158c60 0x7f10cc0cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.949+0000 7f10cbe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10cc159030 0x7f10cc0cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.949+0000 7f10cbe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10cc159420 0x7f10cc0ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.949+0000 7f10cbe00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0c6e90 con 0x7f10cc159420 2024-08-17T02:26:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.949+0000 7f10cbe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0c7cf0 con 0x7f10cc159030 2024-08-17T02:26:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.949+0000 7f10cbe00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0ce800 con 0x7f10cc158c60 2024-08-17T02:26:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.949+0000 7f10cb400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10cc159420 0x7f10cc0ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.949+0000 7f10cb400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10cc159420 0x7f10cc0ce2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40846/0 (socket says 172.21.15.6:40846) 2024-08-17T02:26:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.949+0000 7f10cb400640 1 -- 172.21.15.6:0/1746407560 learned_addr learned my addr 172.21.15.6:0/1746407560 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.949+0000 7f10ca000640 1 --2- 172.21.15.6:0/1746407560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10cc159030 0x7f10cc0cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.949+0000 7f10caa00640 1 --2- 172.21.15.6:0/1746407560 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f10cc158c60 0x7f10cc0cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.949+0000 7f10cb400640 1 -- 172.21.15.6:0/1746407560 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f10cc158c60 msgr2=0x7f10cc0cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.949+0000 7f10cb400640 1 --2- 172.21.15.6:0/1746407560 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f10cc158c60 0x7f10cc0cffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.949+0000 7f10cb400640 1 -- 172.21.15.6:0/1746407560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10cc159030 msgr2=0x7f10cc0cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.949+0000 7f10cb400640 1 --2- 172.21.15.6:0/1746407560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10cc159030 0x7f10cc0cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.949+0000 7f10cb400640 1 -- 172.21.15.6:0/1746407560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b8009450 con 0x7f10cc159420 2024-08-17T02:26:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.950+0000 7f10cb400640 1 --2- 172.21.15.6:0/1746407560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10cc159420 0x7f10cc0ce2c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f10c4007f50 tx=0x7f10c4009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.950+0000 7f10c2000640 1 -- 172.21.15.6:0/1746407560 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c400eea0 con 0x7f10cc159420 2024-08-17T02:26:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.950+0000 7f10c2000640 1 -- 172.21.15.6:0/1746407560 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c4014420 con 0x7f10cc159420 2024-08-17T02:26:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.950+0000 7f10c2000640 1 -- 172.21.15.6:0/1746407560 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c40147c0 con 0x7f10cc159420 2024-08-17T02:26:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.950+0000 7f10cbe00640 1 -- 172.21.15.6:0/1746407560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10cc0c70e0 con 0x7f10cc159420 2024-08-17T02:26:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.950+0000 7f10cbe00640 1 -- 172.21.15.6:0/1746407560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10cc0c76a0 con 0x7f10cc159420 2024-08-17T02:26:58.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.951+0000 7f10cbe00640 1 -- 172.21.15.6:0/1746407560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10cc0c67e0 con 0x7f10cc159420 2024-08-17T02:26:58.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.952+0000 7f10c2000640 1 -- 172.21.15.6:0/1746407560 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f10c4014b30 con 0x7f10cc159420 2024-08-17T02:26:58.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.953+0000 7f10c2000640 1 --2- 172.21.15.6:0/1746407560 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f10ac065150 0x7f10ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.953+0000 7f10c2000640 1 -- 172.21.15.6:0/1746407560 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f10c4082b90 con 0x7f10cc159420 2024-08-17T02:26:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.953+0000 7f10caa00640 1 --2- 172.21.15.6:0/1746407560 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f10ac065150 0x7f10ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.954+0000 7f10caa00640 1 --2- 172.21.15.6:0/1746407560 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f10ac065150 0x7f10ac067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f10bc007ba0 tx=0x7f10bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:58.957+0000 7f10c2000640 1 -- 172.21.15.6:0/1746407560 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f10cc0c67e0 con 0x7f10cc159420 2024-08-17T02:26:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.139+0000 7f10cbe00640 1 -- 172.21.15.6:0/1746407560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10cc0b2140 con 0x7f10cc159420 2024-08-17T02:26:59.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.140+0000 7f10c2000640 1 -- 172.21.15.6:0/1746407560 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f10cc0b2140 con 0x7f10cc159420 2024-08-17T02:26:59.140 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:26:59.140 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:33.190571+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:29.257601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:30.596556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:59.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.142+0000 7f10cbe00640 1 -- 172.21.15.6:0/1746407560 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f10ac065150 msgr2=0x7f10ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.142+0000 7f10cbe00640 1 --2- 172.21.15.6:0/1746407560 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f10ac065150 0x7f10ac067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f10bc007ba0 tx=0x7f10bc008040 comp rx=0 tx=0).stop 2024-08-17T02:26:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.142+0000 7f10cbe00640 1 -- 172.21.15.6:0/1746407560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10cc159420 msgr2=0x7f10cc0ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.142+0000 7f10cbe00640 1 --2- 172.21.15.6:0/1746407560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10cc159420 0x7f10cc0ce2c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f10c4007f50 tx=0x7f10c4009860 comp rx=0 tx=0).stop 2024-08-17T02:26:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.142+0000 7f10cbe00640 1 -- 172.21.15.6:0/1746407560 shutdown_connections 2024-08-17T02:26:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.142+0000 7f10cbe00640 1 --2- 172.21.15.6:0/1746407560 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f10ac065150 0x7f10ac067600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.142+0000 7f10cbe00640 1 --2- 172.21.15.6:0/1746407560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10cc159420 0x7f10cc0ce2c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.142+0000 7f10cbe00640 1 --2- 172.21.15.6:0/1746407560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10cc159030 0x7f10cc0cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.142+0000 7f10cbe00640 1 --2- 172.21.15.6:0/1746407560 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f10cc158c60 0x7f10cc0cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.142+0000 7f10cbe00640 1 -- 172.21.15.6:0/1746407560 >> 172.21.15.6:0/1746407560 conn(0x7f10cc06e590 msgr2=0x7f10cc0b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.142+0000 7f10cbe00640 1 -- 172.21.15.6:0/1746407560 shutdown_connections 2024-08-17T02:26:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.142+0000 7f10cbe00640 1 -- 172.21.15.6:0/1746407560 wait complete. 2024-08-17T02:26:59.157 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:25.463503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:29.257601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:30.596556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:59.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:59.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.311+0000 7fa2dce00640 1 Processor -- start 2024-08-17T02:26:59.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.311+0000 7fa2dce00640 1 -- start start 2024-08-17T02:26:59.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.312+0000 7fa2dce00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa2d8158e60 0x7fa2d80aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.312+0000 7fa2dce00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2d80ae200 0x7fa2d80af170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.312+0000 7fa2dce00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d8069270 con 0x7fa2d8067f70 2024-08-17T02:26:59.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.312+0000 7fa2dce00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d8069550 con 0x7fa2d8158e60 2024-08-17T02:26:59.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.312+0000 7fa2dce00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8069830 con 0x7fa2d80ae200 2024-08-17T02:26:59.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.312+0000 7fa2cfe00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa2d8067f70 0x7fa2d80a7b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40188/0 (socket says 172.21.15.6:40188) 2024-08-17T02:26:59.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.312+0000 7fa2cfe00640 1 -- 172.21.15.6:0/2727952213 learned_addr learned my addr 172.21.15.6:0/2727952213 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:26:59.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.312+0000 7fa2d7400640 1 --2- 172.21.15.6:0/2727952213 >> v2:172.21.15.136:3300/0 conn(0x7fa2d8158e60 0x7fa2d80aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.312+0000 7fa2d7e00640 1 --2- 172.21.15.6:0/2727952213 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2d80ae200 0x7fa2d80af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.313+0000 7fa2d6a00640 1 -- 172.21.15.6:0/2727952213 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765519435 0 0) 0x7fa2d8069270 con 0x7fa2d8067f70 2024-08-17T02:26:59.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.313+0000 7fa2d6a00640 1 -- 172.21.15.6:0/2727952213 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2bc0034e0 con 0x7fa2d8067f70 2024-08-17T02:26:59.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.313+0000 7fa2d7400640 1 -- 172.21.15.6:0/2727952213 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2d80ae200 msgr2=0x7fa2d80af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.313+0000 7fa2d7400640 1 --2- 172.21.15.6:0/2727952213 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2d80ae200 0x7fa2d80af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.313+0000 7fa2d7400640 1 -- 172.21.15.6:0/2727952213 >> v1:172.21.15.6:6789/0 conn(0x7fa2d8067f70 legacy=0x7fa2d80a7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.313+0000 7fa2d7400640 1 -- 172.21.15.6:0/2727952213 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d8069b10 con 0x7fa2d8158e60 2024-08-17T02:26:59.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.314+0000 7fa2d7400640 1 --2- 172.21.15.6:0/2727952213 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2d8158e60 0x7fa2d80aec30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009850 tx=0x7fa2c80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41d2b22458113485 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.314+0000 7fa2d6a00640 1 -- 172.21.15.6:0/2727952213 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c802ae10 con 0x7fa2d8158e60 2024-08-17T02:26:59.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.314+0000 7fa2d6a00640 1 -- 172.21.15.6:0/2727952213 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c8032440 con 0x7fa2d8158e60 2024-08-17T02:26:59.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.314+0000 7fa2d6a00640 1 -- 172.21.15.6:0/2727952213 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8032800 con 0x7fa2d8158e60 2024-08-17T02:26:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.315+0000 7fa2dce00640 1 -- 172.21.15.6:0/2727952213 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2d8158e60 msgr2=0x7fa2d80aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.315+0000 7fa2dce00640 1 --2- 172.21.15.6:0/2727952213 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2d8158e60 0x7fa2d80aec30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009850 tx=0x7fa2c80090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.315+0000 7fa2dce00640 1 -- 172.21.15.6:0/2727952213 shutdown_connections 2024-08-17T02:26:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.315+0000 7fa2dce00640 1 --2- 172.21.15.6:0/2727952213 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2d80ae200 0x7fa2d80af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.315+0000 7fa2dce00640 1 --2- 172.21.15.6:0/2727952213 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2d8158e60 0x7fa2d80aec30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.315+0000 7fa2dce00640 1 -- 172.21.15.6:0/2727952213 >> 172.21.15.6:0/2727952213 conn(0x7fa2d80ce480 msgr2=0x7fa2d8095c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.315+0000 7fa2dce00640 1 -- 172.21.15.6:0/2727952213 shutdown_connections 2024-08-17T02:26:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.315+0000 7fa2dce00640 1 -- 172.21.15.6:0/2727952213 wait complete. 2024-08-17T02:26:59.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.316+0000 7fa2dce00640 1 Processor -- start 2024-08-17T02:26:59.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.316+0000 7fa2dce00640 1 -- start start 2024-08-17T02:26:59.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.317+0000 7fa2dce00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2d8067f70 0x7fa2d80a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.317+0000 7fa2dce00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2d80ae200 0x7fa2d806caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.317+0000 7fa2dce00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2d8158e60 0x7fa2d806d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.317+0000 7fa2dce00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d815d950 con 0x7fa2d8158e60 2024-08-17T02:26:59.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.317+0000 7fa2dce00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d815cdd0 con 0x7fa2d8067f70 2024-08-17T02:26:59.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.317+0000 7fa2dce00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d815d0b0 con 0x7fa2d80ae200 2024-08-17T02:26:59.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.318+0000 7fa2d7e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2d8158e60 0x7fa2d806d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.318+0000 7fa2d7e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2d8158e60 0x7fa2d806d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40860/0 (socket says 172.21.15.6:40860) 2024-08-17T02:26:59.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.318+0000 7fa2d7e00640 1 -- 172.21.15.6:0/3274612713 learned_addr learned my addr 172.21.15.6:0/3274612713 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:59.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.318+0000 7fa2d7400640 1 --2- 172.21.15.6:0/3274612713 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2d8067f70 0x7fa2d80a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.318+0000 7fa2cfe00640 1 --2- 172.21.15.6:0/3274612713 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2d80ae200 0x7fa2d806caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.318+0000 7fa2d7e00640 1 -- 172.21.15.6:0/3274612713 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2d80ae200 msgr2=0x7fa2d806caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.318+0000 7fa2d7e00640 1 --2- 172.21.15.6:0/3274612713 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2d80ae200 0x7fa2d806caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.318+0000 7fa2d7e00640 1 -- 172.21.15.6:0/3274612713 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2d8067f70 msgr2=0x7fa2d80a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.318+0000 7fa2d7e00640 1 --2- 172.21.15.6:0/3274612713 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2d8067f70 0x7fa2d80a7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.318+0000 7fa2d7e00640 1 -- 172.21.15.6:0/3274612713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c8009390 con 0x7fa2d8158e60 2024-08-17T02:26:59.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.318+0000 7fa2cfe00640 1 --2- 172.21.15.6:0/3274612713 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2d80ae200 0x7fa2d806caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:59.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.318+0000 7fa2d7e00640 1 --2- 172.21.15.6:0/3274612713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2d8158e60 0x7fa2d806d030 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0009ec0 tx=0x7fa2d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.319+0000 7fa2cea00640 1 -- 172.21.15.6:0/3274612713 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000ce10 con 0x7fa2d8158e60 2024-08-17T02:26:59.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.319+0000 7fa2cea00640 1 -- 172.21.15.6:0/3274612713 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d000f040 con 0x7fa2d8158e60 2024-08-17T02:26:59.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.319+0000 7fa2cea00640 1 -- 172.21.15.6:0/3274612713 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00146d0 con 0x7fa2d8158e60 2024-08-17T02:26:59.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.319+0000 7fa2dce00640 1 -- 172.21.15.6:0/3274612713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d815d390 con 0x7fa2d8158e60 2024-08-17T02:26:59.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.319+0000 7fa2dce00640 1 -- 172.21.15.6:0/3274612713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d80a8500 con 0x7fa2d8158e60 2024-08-17T02:26:59.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.320+0000 7fa2dce00640 1 -- 172.21.15.6:0/3274612713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d8070720 con 0x7fa2d8158e60 2024-08-17T02:26:59.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.321+0000 7fa2cea00640 1 -- 172.21.15.6:0/3274612713 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa2d0014a40 con 0x7fa2d8158e60 2024-08-17T02:26:59.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.322+0000 7fa2cea00640 1 --2- 172.21.15.6:0/3274612713 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa2b4065150 0x7fa2b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.322+0000 7fa2cea00640 1 -- 172.21.15.6:0/3274612713 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa2d0083350 con 0x7fa2d8158e60 2024-08-17T02:26:59.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.322+0000 7fa2d7400640 1 --2- 172.21.15.6:0/3274612713 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa2b4065150 0x7fa2b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.323+0000 7fa2d7400640 1 --2- 172.21.15.6:0/3274612713 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa2b4065150 0x7fa2b4067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8034000 tx=0x7fa2c8032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.326+0000 7fa2cea00640 1 -- 172.21.15.6:0/3274612713 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa2d0051370 con 0x7fa2d8158e60 2024-08-17T02:26:59.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.508+0000 7fa2dce00640 1 -- 172.21.15.6:0/3274612713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2d80b02e0 con 0x7fa2d8158e60 2024-08-17T02:26:59.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.508+0000 7fa2cea00640 1 -- 172.21.15.6:0/3274612713 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2d0054990 con 0x7fa2d8158e60 2024-08-17T02:26:59.509 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-08-17T02:26:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.510+0000 7fa2dce00640 1 -- 172.21.15.6:0/3274612713 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa2b4065150 msgr2=0x7fa2b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.510+0000 7fa2dce00640 1 --2- 172.21.15.6:0/3274612713 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa2b4065150 0x7fa2b4067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8034000 tx=0x7fa2c8032000 comp rx=0 tx=0).stop 2024-08-17T02:26:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.510+0000 7fa2dce00640 1 -- 172.21.15.6:0/3274612713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2d8158e60 msgr2=0x7fa2d806d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.510+0000 7fa2dce00640 1 --2- 172.21.15.6:0/3274612713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2d8158e60 0x7fa2d806d030 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0009ec0 tx=0x7fa2d000b040 comp rx=0 tx=0).stop 2024-08-17T02:26:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.510+0000 7fa2dce00640 1 -- 172.21.15.6:0/3274612713 shutdown_connections 2024-08-17T02:26:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.510+0000 7fa2dce00640 1 --2- 172.21.15.6:0/3274612713 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa2b4065150 0x7fa2b4067600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.510+0000 7fa2dce00640 1 --2- 172.21.15.6:0/3274612713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2d8158e60 0x7fa2d806d030 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.510+0000 7fa2dce00640 1 --2- 172.21.15.6:0/3274612713 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2d80ae200 0x7fa2d806caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.510+0000 7fa2dce00640 1 --2- 172.21.15.6:0/3274612713 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2d8067f70 0x7fa2d80a7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.510+0000 7fa2dce00640 1 -- 172.21.15.6:0/3274612713 >> 172.21.15.6:0/3274612713 conn(0x7fa2d80ce480 msgr2=0x7fa2d80b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.510+0000 7fa2dce00640 1 -- 172.21.15.6:0/3274612713 shutdown_connections 2024-08-17T02:26:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.510+0000 7fa2dce00640 1 -- 172.21.15.6:0/3274612713 wait complete. 2024-08-17T02:26:59.526 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:59.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.678+0000 7fde1e400640 1 Processor -- start 2024-08-17T02:26:59.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.678+0000 7fde1e400640 1 -- start start 2024-08-17T02:26:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.680+0000 7fde1e400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fde180afca0 0x7fde180b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.680+0000 7fde1e400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde181590b0 0x7fde18159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.680+0000 7fde1e400640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde1815a4e0 con 0x7fde180acf10 2024-08-17T02:26:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.680+0000 7fde1e400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde180b0980 con 0x7fde180afca0 2024-08-17T02:26:59.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.680+0000 7fde1e400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde180c92b0 con 0x7fde181590b0 2024-08-17T02:26:59.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.680+0000 7fde17e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde181590b0 0x7fde18159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.680+0000 7fde17400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fde180afca0 0x7fde180b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.680+0000 7fde0ea00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fde180acf10 0x7fde181589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:36294/0 (socket says 172.21.15.6:36294) 2024-08-17T02:26:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.680+0000 7fde17e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde181590b0 0x7fde18159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:39350/0 (socket says 172.21.15.6:39350) 2024-08-17T02:26:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.680+0000 7fde17400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fde180afca0 0x7fde180b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:53194/0 (socket says 172.21.15.6:53194) 2024-08-17T02:26:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.680+0000 7fde17e00640 1 -- 172.21.15.6:0/1158349625 learned_addr learned my addr 172.21.15.6:0/1158349625 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.681+0000 7fde17400640 1 -- 172.21.15.6:0/1158349625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde181590b0 msgr2=0x7fde18159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.681+0000 7fde17400640 1 --2- 172.21.15.6:0/1158349625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde181590b0 0x7fde18159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.681+0000 7fde17400640 1 -- 172.21.15.6:0/1158349625 >> v1:172.21.15.136:6789/0 conn(0x7fde180acf10 legacy=0x7fde181589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.681+0000 7fde17400640 1 -- 172.21.15.6:0/1158349625 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde180ad480 con 0x7fde180afca0 2024-08-17T02:26:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.682+0000 7fde17400640 1 --2- 172.21.15.6:0/1158349625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde180afca0 0x7fde180b0070 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fde0800b900 tx=0x7fde080090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ab851c90b23e959 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.683+0000 7fde16a00640 1 -- 172.21.15.6:0/1158349625 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0802f510 con 0x7fde180afca0 2024-08-17T02:26:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.683+0000 7fde16a00640 1 -- 172.21.15.6:0/1158349625 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0802d050 con 0x7fde180afca0 2024-08-17T02:26:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.683+0000 7fde16a00640 1 -- 172.21.15.6:0/1158349625 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0802f8a0 con 0x7fde180afca0 2024-08-17T02:26:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.683+0000 7fde1e400640 1 -- 172.21.15.6:0/1158349625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde180afca0 msgr2=0x7fde180b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.683+0000 7fde1e400640 1 --2- 172.21.15.6:0/1158349625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde180afca0 0x7fde180b0070 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fde0800b900 tx=0x7fde080090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.683+0000 7fde1e400640 1 -- 172.21.15.6:0/1158349625 shutdown_connections 2024-08-17T02:26:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.683+0000 7fde1e400640 1 --2- 172.21.15.6:0/1158349625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde181590b0 0x7fde18159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.683+0000 7fde1e400640 1 --2- 172.21.15.6:0/1158349625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde180afca0 0x7fde180b0070 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.683+0000 7fde1e400640 1 -- 172.21.15.6:0/1158349625 >> 172.21.15.6:0/1158349625 conn(0x7fde18066e60 msgr2=0x7fde18067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.683+0000 7fde1e400640 1 -- 172.21.15.6:0/1158349625 shutdown_connections 2024-08-17T02:26:59.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.683+0000 7fde1e400640 1 -- 172.21.15.6:0/1158349625 wait complete. 2024-08-17T02:26:59.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.685+0000 7fde1e400640 1 Processor -- start 2024-08-17T02:26:59.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.685+0000 7fde1e400640 1 -- start start 2024-08-17T02:26:59.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.686+0000 7fde1e400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde180acf10 0x7fde1813a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.686+0000 7fde1e400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde180afca0 0x7fde18148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.686+0000 7fde1e400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde181590b0 0x7fde180c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.686+0000 7fde1e400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde181497f0 con 0x7fde180afca0 2024-08-17T02:26:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.686+0000 7fde1e400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde18149ad0 con 0x7fde181590b0 2024-08-17T02:26:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.686+0000 7fde1e400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde18149db0 con 0x7fde180acf10 2024-08-17T02:26:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.686+0000 7fde0ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde180afca0 0x7fde18148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.686+0000 7fde0ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde180afca0 0x7fde18148d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40870/0 (socket says 172.21.15.6:40870) 2024-08-17T02:26:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.686+0000 7fde0ea00640 1 -- 172.21.15.6:0/2841944783 learned_addr learned my addr 172.21.15.6:0/2841944783 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:26:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.686+0000 7fde17400640 1 --2- 172.21.15.6:0/2841944783 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde180acf10 0x7fde1813a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.686+0000 7fde17e00640 1 --2- 172.21.15.6:0/2841944783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde181590b0 0x7fde180c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.686+0000 7fde0ea00640 1 -- 172.21.15.6:0/2841944783 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde180acf10 msgr2=0x7fde1813a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.686+0000 7fde0ea00640 1 --2- 172.21.15.6:0/2841944783 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde180acf10 0x7fde1813a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.686+0000 7fde0ea00640 1 -- 172.21.15.6:0/2841944783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde181590b0 msgr2=0x7fde180c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.686+0000 7fde0ea00640 1 --2- 172.21.15.6:0/2841944783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde181590b0 0x7fde180c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.686+0000 7fde0ea00640 1 -- 172.21.15.6:0/2841944783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0800b440 con 0x7fde180afca0 2024-08-17T02:26:59.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.687+0000 7fde0ea00640 1 --2- 172.21.15.6:0/2841944783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde180afca0 0x7fde18148d50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fde0000c960 tx=0x7fde00007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.687+0000 7fde0f400640 1 -- 172.21.15.6:0/2841944783 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00007300 con 0x7fde180afca0 2024-08-17T02:26:59.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.687+0000 7fde0f400640 1 -- 172.21.15.6:0/2841944783 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde00007480 con 0x7fde180afca0 2024-08-17T02:26:59.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.687+0000 7fde1e400640 1 -- 172.21.15.6:0/2841944783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde1814a090 con 0x7fde180afca0 2024-08-17T02:26:59.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.687+0000 7fde0f400640 1 -- 172.21.15.6:0/2841944783 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde000047a0 con 0x7fde180afca0 2024-08-17T02:26:59.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.687+0000 7fde1e400640 1 -- 172.21.15.6:0/2841944783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde181479c0 con 0x7fde180afca0 2024-08-17T02:26:59.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.688+0000 7fde1e400640 1 -- 172.21.15.6:0/2841944783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde18063fb0 con 0x7fde180afca0 2024-08-17T02:26:59.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.689+0000 7fde0f400640 1 -- 172.21.15.6:0/2841944783 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fde00004bd0 con 0x7fde180afca0 2024-08-17T02:26:59.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.689+0000 7fde0f400640 1 --2- 172.21.15.6:0/2841944783 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fddf4065150 0x7fddf4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.690+0000 7fde0f400640 1 -- 172.21.15.6:0/2841944783 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde00081b40 con 0x7fde180afca0 2024-08-17T02:26:59.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.690+0000 7fde17400640 1 --2- 172.21.15.6:0/2841944783 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fddf4065150 0x7fddf4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.691+0000 7fde17400640 1 --2- 172.21.15.6:0/2841944783 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fddf4065150 0x7fddf4067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fde08034000 tx=0x7fde08037000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.693+0000 7fde0f400640 1 -- 172.21.15.6:0/2841944783 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fde0004fbe0 con 0x7fde180afca0 2024-08-17T02:26:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.874+0000 7fde1e400640 1 -- 172.21.15.6:0/2841944783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde1815a4e0 con 0x7fde180afca0 2024-08-17T02:26:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.875+0000 7fde0f400640 1 -- 172.21.15.6:0/2841944783 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fde1815a4e0 con 0x7fde180afca0 2024-08-17T02:26:59.876 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-08-17T02:26:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.877+0000 7fde1e400640 1 -- 172.21.15.6:0/2841944783 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fddf4065150 msgr2=0x7fddf4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.877+0000 7fde1e400640 1 --2- 172.21.15.6:0/2841944783 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fddf4065150 0x7fddf4067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fde08034000 tx=0x7fde08037000 comp rx=0 tx=0).stop 2024-08-17T02:26:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.877+0000 7fde1e400640 1 -- 172.21.15.6:0/2841944783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde180afca0 msgr2=0x7fde18148d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.877+0000 7fde1e400640 1 --2- 172.21.15.6:0/2841944783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde180afca0 0x7fde18148d50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fde0000c960 tx=0x7fde00007ec0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.877+0000 7fde1e400640 1 -- 172.21.15.6:0/2841944783 shutdown_connections 2024-08-17T02:26:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.877+0000 7fde1e400640 1 --2- 172.21.15.6:0/2841944783 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fddf4065150 0x7fddf4067600 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.877+0000 7fde1e400640 1 --2- 172.21.15.6:0/2841944783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde181590b0 0x7fde180c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.877+0000 7fde1e400640 1 --2- 172.21.15.6:0/2841944783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde180afca0 0x7fde18148d50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.877+0000 7fde1e400640 1 --2- 172.21.15.6:0/2841944783 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde180acf10 0x7fde1813a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.877+0000 7fde1e400640 1 -- 172.21.15.6:0/2841944783 >> 172.21.15.6:0/2841944783 conn(0x7fde18066e60 msgr2=0x7fde1806e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.877+0000 7fde1e400640 1 -- 172.21.15.6:0/2841944783 shutdown_connections 2024-08-17T02:26:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:26:59.877+0000 7fde1e400640 1 -- 172.21.15.6:0/2841944783 wait complete. 2024-08-17T02:26:59.892 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.045+0000 7f2e8a000640 1 Processor -- start 2024-08-17T02:27:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.045+0000 7f2e8a000640 1 -- start start 2024-08-17T02:27:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.046+0000 7f2e8a000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e84158c60 0x7f2e840b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.046+0000 7f2e8a000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e84159030 0x7f2e840b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.046+0000 7f2e8a000640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e840b2ae0 con 0x7f2e840cbd40 2024-08-17T02:27:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.046+0000 7f2e8a000640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e840b2dc0 con 0x7f2e84159030 2024-08-17T02:27:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.046+0000 7f2e8a000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e840b25f0 con 0x7f2e84158c60 2024-08-17T02:27:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.046+0000 7f2e82a00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e84159030 0x7f2e840b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.046+0000 7f2e82a00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e84159030 0x7f2e840b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40886/0 (socket says 172.21.15.6:40886) 2024-08-17T02:27:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.046+0000 7f2e82a00640 1 -- 172.21.15.6:0/2331097023 learned_addr learned my addr 172.21.15.6:0/2331097023 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.047+0000 7f2e83400640 1 --2- 172.21.15.6:0/2331097023 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e84158c60 0x7f2e840b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.047+0000 7f2e82a00640 1 -- 172.21.15.6:0/2331097023 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e84158c60 msgr2=0x7f2e840b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.047+0000 7f2e82a00640 1 --2- 172.21.15.6:0/2331097023 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e84158c60 0x7f2e840b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.047+0000 7f2e82a00640 1 -- 172.21.15.6:0/2331097023 >> v1:172.21.15.6:6789/0 conn(0x7f2e840cbd40 legacy=0x7f2e840cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.047+0000 7f2e82a00640 1 -- 172.21.15.6:0/2331097023 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e840cca80 con 0x7f2e84159030 2024-08-17T02:27:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.048+0000 7f2e82a00640 1 --2- 172.21.15.6:0/2331097023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e84159030 0x7f2e840b20b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009910 tx=0x7f2e700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf309567c0ac582 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.048+0000 7f2e82000640 1 -- 172.21.15.6:0/2331097023 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7002adb0 con 0x7f2e84159030 2024-08-17T02:27:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.048+0000 7f2e82000640 1 -- 172.21.15.6:0/2331097023 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e70032440 con 0x7f2e84159030 2024-08-17T02:27:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.048+0000 7f2e82000640 1 -- 172.21.15.6:0/2331097023 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e70032820 con 0x7f2e84159030 2024-08-17T02:27:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.049+0000 7f2e8a000640 1 -- 172.21.15.6:0/2331097023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e84159030 msgr2=0x7f2e840b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.049+0000 7f2e8a000640 1 --2- 172.21.15.6:0/2331097023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e84159030 0x7f2e840b20b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009910 tx=0x7f2e700091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.049+0000 7f2e8a000640 1 -- 172.21.15.6:0/2331097023 shutdown_connections 2024-08-17T02:27:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.049+0000 7f2e8a000640 1 --2- 172.21.15.6:0/2331097023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e84159030 0x7f2e840b20b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.049+0000 7f2e8a000640 1 --2- 172.21.15.6:0/2331097023 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e84158c60 0x7f2e840b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.049+0000 7f2e8a000640 1 -- 172.21.15.6:0/2331097023 >> 172.21.15.6:0/2331097023 conn(0x7f2e8406e590 msgr2=0x7f2e8406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.049+0000 7f2e8a000640 1 -- 172.21.15.6:0/2331097023 shutdown_connections 2024-08-17T02:27:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.049+0000 7f2e8a000640 1 -- 172.21.15.6:0/2331097023 wait complete. 2024-08-17T02:27:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.050+0000 7f2e8a000640 1 Processor -- start 2024-08-17T02:27:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.050+0000 7f2e8a000640 1 -- start start 2024-08-17T02:27:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.051+0000 7f2e8a000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e840cbd40 0x7f2e84168980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.051+0000 7f2e8a000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e84158c60 0x7f2e840c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.051+0000 7f2e8a000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e84159030 0x7f2e840c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.051+0000 7f2e8a000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e840c4890 con 0x7f2e84159030 2024-08-17T02:27:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.051+0000 7f2e8a000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e840c4e50 con 0x7f2e84158c60 2024-08-17T02:27:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.051+0000 7f2e8a000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e840c9cd0 con 0x7f2e840cbd40 2024-08-17T02:27:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.051+0000 7f2e83e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e84159030 0x7f2e840c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.051+0000 7f2e83e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e84159030 0x7f2e840c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40902/0 (socket says 172.21.15.6:40902) 2024-08-17T02:27:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.052+0000 7f2e83e00640 1 -- 172.21.15.6:0/1761235601 learned_addr learned my addr 172.21.15.6:0/1761235601 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.052+0000 7f2e83400640 1 --2- 172.21.15.6:0/1761235601 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e840cbd40 0x7f2e84168980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.052+0000 7f2e82a00640 1 --2- 172.21.15.6:0/1761235601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e84158c60 0x7f2e840c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.052+0000 7f2e83e00640 1 -- 172.21.15.6:0/1761235601 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e840cbd40 msgr2=0x7f2e84168980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.052+0000 7f2e83e00640 1 --2- 172.21.15.6:0/1761235601 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e840cbd40 0x7f2e84168980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.052+0000 7f2e83e00640 1 -- 172.21.15.6:0/1761235601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e84158c60 msgr2=0x7f2e840c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.052+0000 7f2e83e00640 1 --2- 172.21.15.6:0/1761235601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e84158c60 0x7f2e840c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.052+0000 7f2e83e00640 1 -- 172.21.15.6:0/1761235601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e70009450 con 0x7f2e84159030 2024-08-17T02:27:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.052+0000 7f2e83400640 1 --2- 172.21.15.6:0/1761235601 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e840cbd40 0x7f2e84168980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.052+0000 7f2e83e00640 1 --2- 172.21.15.6:0/1761235601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e84159030 0x7f2e840c7260 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c00c7f0 tx=0x7f2e7c0015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.052+0000 7f2e7aa00640 1 -- 172.21.15.6:0/1761235601 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c00a640 con 0x7f2e84159030 2024-08-17T02:27:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.053+0000 7f2e7aa00640 1 -- 172.21.15.6:0/1761235601 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7c00a7c0 con 0x7f2e84159030 2024-08-17T02:27:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.053+0000 7f2e8a000640 1 -- 172.21.15.6:0/1761235601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e840c9fb0 con 0x7f2e84159030 2024-08-17T02:27:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.053+0000 7f2e7aa00640 1 -- 172.21.15.6:0/1761235601 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c00ab80 con 0x7f2e84159030 2024-08-17T02:27:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.053+0000 7f2e8a000640 1 -- 172.21.15.6:0/1761235601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8416a3a0 con 0x7f2e84159030 2024-08-17T02:27:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.054+0000 7f2e8a000640 1 -- 172.21.15.6:0/1761235601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e840c4fe0 con 0x7f2e84159030 2024-08-17T02:27:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.054+0000 7f2e7aa00640 1 -- 172.21.15.6:0/1761235601 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2e7c003030 con 0x7f2e84159030 2024-08-17T02:27:00.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.055+0000 7f2e7aa00640 1 --2- 172.21.15.6:0/1761235601 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2e64065150 0x7f2e64067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.055+0000 7f2e7aa00640 1 -- 172.21.15.6:0/1761235601 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2e7c082500 con 0x7f2e84159030 2024-08-17T02:27:00.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.056+0000 7f2e83400640 1 --2- 172.21.15.6:0/1761235601 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2e64065150 0x7f2e64067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.057+0000 7f2e83400640 1 --2- 172.21.15.6:0/1761235601 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2e64065150 0x7f2e64067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2e74010450 tx=0x7f2e74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.059+0000 7f2e7aa00640 1 -- 172.21.15.6:0/1761235601 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2e7c0505d0 con 0x7f2e84159030 2024-08-17T02:27:00.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.247+0000 7f2e8a000640 1 -- 172.21.15.6:0/1761235601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e84063fb0 con 0x7f2e84159030 2024-08-17T02:27:00.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.247+0000 7f2e7aa00640 1 -- 172.21.15.6:0/1761235601 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2e7c059030 con 0x7f2e84159030 2024-08-17T02:27:00.248 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-08-17T02:27:00.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.249+0000 7f2e8a000640 1 -- 172.21.15.6:0/1761235601 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2e64065150 msgr2=0x7f2e64067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.250+0000 7f2e8a000640 1 --2- 172.21.15.6:0/1761235601 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2e64065150 0x7f2e64067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2e74010450 tx=0x7f2e74008040 comp rx=0 tx=0).stop 2024-08-17T02:27:00.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.250+0000 7f2e8a000640 1 -- 172.21.15.6:0/1761235601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e84159030 msgr2=0x7f2e840c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.250+0000 7f2e8a000640 1 --2- 172.21.15.6:0/1761235601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e84159030 0x7f2e840c7260 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c00c7f0 tx=0x7f2e7c0015f0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.250+0000 7f2e8a000640 1 -- 172.21.15.6:0/1761235601 shutdown_connections 2024-08-17T02:27:00.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.250+0000 7f2e8a000640 1 --2- 172.21.15.6:0/1761235601 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2e64065150 0x7f2e64067600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.250+0000 7f2e8a000640 1 --2- 172.21.15.6:0/1761235601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e84159030 0x7f2e840c7260 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.250+0000 7f2e8a000640 1 --2- 172.21.15.6:0/1761235601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e84158c60 0x7f2e840c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.250+0000 7f2e8a000640 1 --2- 172.21.15.6:0/1761235601 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e840cbd40 0x7f2e84168980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.250+0000 7f2e8a000640 1 -- 172.21.15.6:0/1761235601 >> 172.21.15.6:0/1761235601 conn(0x7f2e8406e590 msgr2=0x7f2e84154f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.250+0000 7f2e8a000640 1 -- 172.21.15.6:0/1761235601 shutdown_connections 2024-08-17T02:27:00.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.250+0000 7f2e8a000640 1 -- 172.21.15.6:0/1761235601 wait complete. 2024-08-17T02:27:00.266 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.415+0000 7f7426000640 1 Processor -- start 2024-08-17T02:27:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.415+0000 7f7426000640 1 -- start start 2024-08-17T02:27:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.416+0000 7f7426000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74201590b0 0x7f74200b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.416+0000 7f7426000640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74200c92b0 con 0x7f74200acf10 2024-08-17T02:27:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.416+0000 7f7426000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74200ad480 con 0x7f74200afca0 2024-08-17T02:27:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.416+0000 7f7426000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74200b0980 con 0x7f74201590b0 2024-08-17T02:27:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.417+0000 7f741fe00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f74200acf10 0x7f74200c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40212/0 (socket says 172.21.15.6:40212) 2024-08-17T02:27:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.417+0000 7f741f400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f74200afca0 0x7f74201589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:36306/0 (socket says 172.21.15.6:36306) 2024-08-17T02:27:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.417+0000 7f741fe00640 1 -- 172.21.15.6:0/3347637359 learned_addr learned my addr 172.21.15.6:0/3347637359 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.417+0000 7f7417e00640 1 --2- 172.21.15.6:0/3347637359 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74201590b0 0x7f74200b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.417+0000 7f741ea00640 1 -- 172.21.15.6:0/3347637359 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459134645 0 0) 0x7f74200c92b0 con 0x7f74200acf10 2024-08-17T02:27:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.417+0000 7f741ea00640 1 -- 172.21.15.6:0/3347637359 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74040034e0 con 0x7f74200acf10 2024-08-17T02:27:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.417+0000 7f741ea00640 1 -- 172.21.15.6:0/3347637359 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130584311 0 0) 0x7f74200ad480 con 0x7f74200afca0 2024-08-17T02:27:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.417+0000 7f741ea00640 1 -- 172.21.15.6:0/3347637359 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74200c92b0 con 0x7f74200afca0 2024-08-17T02:27:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.417+0000 7f7417e00640 1 -- 172.21.15.6:0/3347637359 >> v1:172.21.15.136:6789/0 conn(0x7f74200afca0 legacy=0x7f74201589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.417+0000 7f7417e00640 1 -- 172.21.15.6:0/3347637359 >> v1:172.21.15.6:6789/0 conn(0x7f74200acf10 legacy=0x7f74200c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.417+0000 7f7417e00640 1 -- 172.21.15.6:0/3347637359 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74200ad760 con 0x7f74201590b0 2024-08-17T02:27:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.418+0000 7f7417e00640 1 --2- 172.21.15.6:0/3347637359 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74201590b0 0x7f74200b0070 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7408009880 tx=0x7f74080090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72f569bed00f0c60 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.419+0000 7f741ea00640 1 -- 172.21.15.6:0/3347637359 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740802ae10 con 0x7f74201590b0 2024-08-17T02:27:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.419+0000 7f741ea00640 1 -- 172.21.15.6:0/3347637359 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7408032440 con 0x7f74201590b0 2024-08-17T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.419+0000 7f741ea00640 1 -- 172.21.15.6:0/3347637359 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74080327e0 con 0x7f74201590b0 2024-08-17T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.419+0000 7f7426000640 1 -- 172.21.15.6:0/3347637359 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74201590b0 msgr2=0x7f74200b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.419+0000 7f7426000640 1 --2- 172.21.15.6:0/3347637359 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74201590b0 0x7f74200b0070 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7408009880 tx=0x7f74080090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.419+0000 7f7426000640 1 -- 172.21.15.6:0/3347637359 shutdown_connections 2024-08-17T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.419+0000 7f7426000640 1 --2- 172.21.15.6:0/3347637359 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74201590b0 0x7f74200b0070 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.419+0000 7f7426000640 1 -- 172.21.15.6:0/3347637359 >> 172.21.15.6:0/3347637359 conn(0x7f7420066e60 msgr2=0x7f7420067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.420+0000 7f7426000640 1 -- 172.21.15.6:0/3347637359 shutdown_connections 2024-08-17T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.420+0000 7f7426000640 1 -- 172.21.15.6:0/3347637359 wait complete. 2024-08-17T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.421+0000 7f7426000640 1 Processor -- start 2024-08-17T02:27:00.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.421+0000 7f7426000640 1 -- start start 2024-08-17T02:27:00.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.422+0000 7f7426000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74200acf10 0x7f742015e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.422+0000 7f7426000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74200afca0 0x7f7420153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.422+0000 7f7426000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74201590b0 0x7f742015a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.422+0000 7f7426000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742015b3b0 con 0x7f74200acf10 2024-08-17T02:27:00.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.422+0000 7f7426000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74201559c0 con 0x7f74201590b0 2024-08-17T02:27:00.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.422+0000 7f7426000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7420155090 con 0x7f74200afca0 2024-08-17T02:27:00.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.422+0000 7f741f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74200acf10 0x7f742015e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.422+0000 7f741f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74200acf10 0x7f742015e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40918/0 (socket says 172.21.15.6:40918) 2024-08-17T02:27:00.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.422+0000 7f741f400640 1 -- 172.21.15.6:0/3662948224 learned_addr learned my addr 172.21.15.6:0/3662948224 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:00.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.422+0000 7f7417e00640 1 --2- 172.21.15.6:0/3662948224 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74200afca0 0x7f7420153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.422+0000 7f741fe00640 1 --2- 172.21.15.6:0/3662948224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74201590b0 0x7f742015a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.423+0000 7f741f400640 1 -- 172.21.15.6:0/3662948224 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74200afca0 msgr2=0x7f7420153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.423+0000 7f741f400640 1 --2- 172.21.15.6:0/3662948224 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74200afca0 0x7f7420153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.423+0000 7f741f400640 1 -- 172.21.15.6:0/3662948224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74201590b0 msgr2=0x7f742015a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.423+0000 7f741f400640 1 --2- 172.21.15.6:0/3662948224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74201590b0 0x7f742015a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.423+0000 7f741f400640 1 -- 172.21.15.6:0/3662948224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7408009390 con 0x7f74200acf10 2024-08-17T02:27:00.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.423+0000 7f741f400640 1 --2- 172.21.15.6:0/3662948224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74200acf10 0x7f742015e120 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f741000c5b0 tx=0x7f7410007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.423+0000 7f7416a00640 1 -- 172.21.15.6:0/3662948224 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7410007300 con 0x7f74200acf10 2024-08-17T02:27:00.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.423+0000 7f7416a00640 1 -- 172.21.15.6:0/3662948224 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7410007480 con 0x7f74200acf10 2024-08-17T02:27:00.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.423+0000 7f7426000640 1 -- 172.21.15.6:0/3662948224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7420155370 con 0x7f74200acf10 2024-08-17T02:27:00.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.423+0000 7f7416a00640 1 -- 172.21.15.6:0/3662948224 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74100049f0 con 0x7f74200acf10 2024-08-17T02:27:00.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.423+0000 7f7426000640 1 -- 172.21.15.6:0/3662948224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742015e660 con 0x7f74200acf10 2024-08-17T02:27:00.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.424+0000 7f7426000640 1 -- 172.21.15.6:0/3662948224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74200c8400 con 0x7f74200acf10 2024-08-17T02:27:00.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.425+0000 7f7416a00640 1 -- 172.21.15.6:0/3662948224 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f741001c3b0 con 0x7f74200acf10 2024-08-17T02:27:00.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.426+0000 7f7416a00640 1 --2- 172.21.15.6:0/3662948224 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f73fc065150 0x7f73fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.426+0000 7f7416a00640 1 -- 172.21.15.6:0/3662948224 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f74100819a0 con 0x7f74200acf10 2024-08-17T02:27:00.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.427+0000 7f7417e00640 1 --2- 172.21.15.6:0/3662948224 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f73fc065150 0x7f73fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.427+0000 7f7417e00640 1 --2- 172.21.15.6:0/3662948224 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f73fc065150 0x7f73fc067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7408034000 tx=0x7f7408032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.430+0000 7f7416a00640 1 -- 172.21.15.6:0/3662948224 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f74200c8400 con 0x7f74200acf10 2024-08-17T02:27:00.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.613+0000 7f7426000640 1 -- 172.21.15.6:0/3662948224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74200c8400 con 0x7f74200acf10 2024-08-17T02:27:00.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.614+0000 7f7416a00640 1 -- 172.21.15.6:0/3662948224 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f74200c8400 con 0x7f74200acf10 2024-08-17T02:27:00.614 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:00.615 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:33.190571+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:29.257601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:30.596556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.616+0000 7f7426000640 1 -- 172.21.15.6:0/3662948224 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f73fc065150 msgr2=0x7f73fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.616+0000 7f7426000640 1 --2- 172.21.15.6:0/3662948224 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f73fc065150 0x7f73fc067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7408034000 tx=0x7f7408032000 comp rx=0 tx=0).stop 2024-08-17T02:27:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.616+0000 7f7426000640 1 -- 172.21.15.6:0/3662948224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74200acf10 msgr2=0x7f742015e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.616+0000 7f7426000640 1 --2- 172.21.15.6:0/3662948224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74200acf10 0x7f742015e120 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f741000c5b0 tx=0x7f7410007d70 comp rx=0 tx=0).stop 2024-08-17T02:27:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.616+0000 7f7426000640 1 -- 172.21.15.6:0/3662948224 shutdown_connections 2024-08-17T02:27:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.616+0000 7f7426000640 1 --2- 172.21.15.6:0/3662948224 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f73fc065150 0x7f73fc067600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.616+0000 7f7426000640 1 --2- 172.21.15.6:0/3662948224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74201590b0 0x7f742015a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.616+0000 7f7426000640 1 --2- 172.21.15.6:0/3662948224 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74200afca0 0x7f7420153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.616+0000 7f7426000640 1 --2- 172.21.15.6:0/3662948224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74200acf10 0x7f742015e120 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.616+0000 7f7426000640 1 -- 172.21.15.6:0/3662948224 >> 172.21.15.6:0/3662948224 conn(0x7f7420066e60 msgr2=0x7f74200c9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.616+0000 7f7426000640 1 -- 172.21.15.6:0/3662948224 shutdown_connections 2024-08-17T02:27:00.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.616+0000 7f7426000640 1 -- 172.21.15.6:0/3662948224 wait complete. 2024-08-17T02:27:00.631 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:25.463503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:29.257601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:30.596556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:00.632 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:00.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.784+0000 7f6c82000640 1 Processor -- start 2024-08-17T02:27:00.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.784+0000 7f6c82000640 1 -- start start 2024-08-17T02:27:00.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.786+0000 7f6c82000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c7c0adf90 0x7f6c7c0ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.786+0000 7f6c82000640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7c0ac040 con 0x7f6c7c156bd0 2024-08-17T02:27:00.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.786+0000 7f6c82000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7c0ab150 con 0x7f6c7c0b1280 2024-08-17T02:27:00.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.786+0000 7f6c82000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c067810 con 0x7f6c7c0adf90 2024-08-17T02:27:00.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.786+0000 7f6c7b400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6c7c156bd0 0x7f6c7c0b0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40228/0 (socket says 172.21.15.6:40228) 2024-08-17T02:27:00.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.786+0000 7f6c7b400640 1 -- 172.21.15.6:0/848235854 learned_addr learned my addr 172.21.15.6:0/848235854 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:00.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.786+0000 7f6c7aa00640 1 -- 172.21.15.6:0/848235854 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431169881 0 0) 0x7f6c7c0ac040 con 0x7f6c7c156bd0 2024-08-17T02:27:00.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.786+0000 7f6c7aa00640 1 -- 172.21.15.6:0/848235854 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c600034e0 con 0x7f6c7c156bd0 2024-08-17T02:27:00.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.786+0000 7f6c7be00640 1 --2- 172.21.15.6:0/848235854 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c7c0adf90 0x7f6c7c0ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7aa00640 1 -- 172.21.15.6:0/848235854 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4018149609 0 0) 0x7f6c600034e0 con 0x7f6c7c156bd0 2024-08-17T02:27:00.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7aa00640 1 -- 172.21.15.6:0/848235854 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c7c0adf90 msgr2=0x7f6c7c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7aa00640 1 --2- 172.21.15.6:0/848235854 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c7c0adf90 0x7f6c7c0ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7aa00640 1 -- 172.21.15.6:0/848235854 >> v1:172.21.15.136:6789/0 conn(0x7f6c7c0b1280 legacy=0x7f6c7c0c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7aa00640 1 -- 172.21.15.6:0/848235854 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0ab430 con 0x7f6c7c156bd0 2024-08-17T02:27:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7aa00640 1 -- 172.21.15.6:0/848235854 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f6c6c001470 con 0x7f6c7c156bd0 2024-08-17T02:27:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7aa00640 1 -- 172.21.15.6:0/848235854 >> v1:172.21.15.6:6789/0 conn(0x7f6c7c156bd0 legacy=0x7f6c7c0b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7aa00640 1 --2- 172.21.15.6:0/848235854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c60003a00 0x7f6c60003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7aa00640 1 --2- 172.21.15.6:0/848235854 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c60004780 0x7f6c60004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7aa00640 1 --2- 172.21.15.6:0/848235854 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c7c0adf90 0x7f6c60005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7aa00640 1 -- 172.21.15.6:0/848235854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c067810 con 0x7f6c60003a00 2024-08-17T02:27:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7aa00640 1 -- 172.21.15.6:0/848235854 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6000bb00 con 0x7f6c60004780 2024-08-17T02:27:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7aa00640 1 -- 172.21.15.6:0/848235854 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6000bcc0 con 0x7f6c7c0adf90 2024-08-17T02:27:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7b400640 1 --2- 172.21.15.6:0/848235854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c60003a00 0x7f6c60003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c73e00640 1 --2- 172.21.15.6:0/848235854 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c60004780 0x7f6c60004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7be00640 1 --2- 172.21.15.6:0/848235854 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c7c0adf90 0x7f6c60005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7b400640 1 -- 172.21.15.6:0/848235854 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c7c0adf90 msgr2=0x7f6c60005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:00.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7b400640 1 --2- 172.21.15.6:0/848235854 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c7c0adf90 0x7f6c60005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7b400640 1 -- 172.21.15.6:0/848235854 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c60004780 msgr2=0x7f6c60004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:00.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7b400640 1 --2- 172.21.15.6:0/848235854 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c60004780 0x7f6c60004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.787+0000 7f6c7b400640 1 -- 172.21.15.6:0/848235854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c600034e0 con 0x7f6c60003a00 2024-08-17T02:27:00.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.788+0000 7f6c7b400640 1 --2- 172.21.15.6:0/848235854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c60003a00 0x7f6c60003e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00c2d0 tx=0x7f6c6c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd947cb248fbbe6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.789+0000 7f6c7aa00640 1 -- 172.21.15.6:0/848235854 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c005890 con 0x7f6c60003a00 2024-08-17T02:27:00.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.789+0000 7f6c7aa00640 1 -- 172.21.15.6:0/848235854 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c02e070 con 0x7f6c60003a00 2024-08-17T02:27:00.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.789+0000 7f6c7aa00640 1 -- 172.21.15.6:0/848235854 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c005a70 con 0x7f6c60003a00 2024-08-17T02:27:00.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.789+0000 7f6c82000640 1 -- 172.21.15.6:0/848235854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c60003a00 msgr2=0x7f6c60003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.789+0000 7f6c82000640 1 --2- 172.21.15.6:0/848235854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c60003a00 0x7f6c60003e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00c2d0 tx=0x7f6c6c001e50 comp rx=0 tx=0).stop 2024-08-17T02:27:00.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.789+0000 7f6c7be00640 1 -- 172.21.15.6:0/848235854 reap_dead start 2024-08-17T02:27:00.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.789+0000 7f6c82000640 1 -- 172.21.15.6:0/848235854 shutdown_connections 2024-08-17T02:27:00.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.789+0000 7f6c82000640 1 -- 172.21.15.6:0/848235854 >> 172.21.15.6:0/848235854 conn(0x7f6c7c0cc390 msgr2=0x7f6c7c066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.789+0000 7f6c82000640 1 -- 172.21.15.6:0/848235854 shutdown_connections 2024-08-17T02:27:00.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.789+0000 7f6c82000640 1 -- 172.21.15.6:0/848235854 wait complete. 2024-08-17T02:27:00.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.791+0000 7f6c82000640 1 Processor -- start 2024-08-17T02:27:00.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.791+0000 7f6c82000640 1 -- start start 2024-08-17T02:27:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.792+0000 7f6c82000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c60003a00 0x7f6c7c16c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.792+0000 7f6c82000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c159690 0x7f6c7c14a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.792+0000 7f6c82000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c7c0a88e0 0x7f6c7c0a8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.792+0000 7f6c82000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0aed70 con 0x7f6c7c159690 2024-08-17T02:27:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.792+0000 7f6c82000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c16cf90 con 0x7f6c60003a00 2024-08-17T02:27:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.792+0000 7f6c82000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c16d270 con 0x7f6c7c0a88e0 2024-08-17T02:27:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.792+0000 7f6c73e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c159690 0x7f6c7c14a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.792+0000 7f6c73e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c159690 0x7f6c7c14a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40946/0 (socket says 172.21.15.6:40946) 2024-08-17T02:27:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.792+0000 7f6c73e00640 1 -- 172.21.15.6:0/2535264770 learned_addr learned my addr 172.21.15.6:0/2535264770 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.792+0000 7f6c7b400640 1 --2- 172.21.15.6:0/2535264770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c60003a00 0x7f6c7c16c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.792+0000 7f6c7be00640 1 --2- 172.21.15.6:0/2535264770 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c7c0a88e0 0x7f6c7c0a8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.792+0000 7f6c73e00640 1 -- 172.21.15.6:0/2535264770 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c7c0a88e0 msgr2=0x7f6c7c0a8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.792+0000 7f6c73e00640 1 --2- 172.21.15.6:0/2535264770 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c7c0a88e0 0x7f6c7c0a8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.792+0000 7f6c73e00640 1 -- 172.21.15.6:0/2535264770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c60003a00 msgr2=0x7f6c7c16c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.792+0000 7f6c73e00640 1 --2- 172.21.15.6:0/2535264770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c60003a00 0x7f6c7c16c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.792+0000 7f6c73e00640 1 -- 172.21.15.6:0/2535264770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0aea00 con 0x7f6c7c159690 2024-08-17T02:27:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.792+0000 7f6c7b400640 1 --2- 172.21.15.6:0/2535264770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c60003a00 0x7f6c7c16c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.793+0000 7f6c73e00640 1 --2- 172.21.15.6:0/2535264770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c159690 0x7f6c7c14a6a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400e600 tx=0x7f6c64009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.793+0000 7f6c72a00640 1 -- 172.21.15.6:0/2535264770 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64013630 con 0x7f6c7c159690 2024-08-17T02:27:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.793+0000 7f6c72a00640 1 -- 172.21.15.6:0/2535264770 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c64013790 con 0x7f6c7c159690 2024-08-17T02:27:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.793+0000 7f6c72a00640 1 -- 172.21.15.6:0/2535264770 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64013b30 con 0x7f6c7c159690 2024-08-17T02:27:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.793+0000 7f6c82000640 1 -- 172.21.15.6:0/2535264770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c16d550 con 0x7f6c7c159690 2024-08-17T02:27:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.793+0000 7f6c82000640 1 -- 172.21.15.6:0/2535264770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c14abe0 con 0x7f6c7c159690 2024-08-17T02:27:00.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.794+0000 7f6c82000640 1 -- 172.21.15.6:0/2535264770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7c0aeee0 con 0x7f6c7c159690 2024-08-17T02:27:00.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.795+0000 7f6c72a00640 1 -- 172.21.15.6:0/2535264770 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6c6401c400 con 0x7f6c7c159690 2024-08-17T02:27:00.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.795+0000 7f6c72a00640 1 --2- 172.21.15.6:0/2535264770 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6c58065150 0x7f6c58067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.796+0000 7f6c72a00640 1 -- 172.21.15.6:0/2535264770 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6c64082610 con 0x7f6c7c159690 2024-08-17T02:27:00.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.796+0000 7f6c7b400640 1 --2- 172.21.15.6:0/2535264770 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6c58065150 0x7f6c58067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.797+0000 7f6c7b400640 1 --2- 172.21.15.6:0/2535264770 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6c58065150 0x7f6c58067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c033000 tx=0x7f6c6c034000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.800+0000 7f6c72a00640 1 -- 172.21.15.6:0/2535264770 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6c64050630 con 0x7f6c7c159690 2024-08-17T02:27:00.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.982+0000 7f6c82000640 1 -- 172.21.15.6:0/2535264770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c7c063fb0 con 0x7f6c7c159690 2024-08-17T02:27:00.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.982+0000 7f6c72a00640 1 -- 172.21.15.6:0/2535264770 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c64053c50 con 0x7f6c7c159690 2024-08-17T02:27:00.983 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-08-17T02:27:00.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.984+0000 7f6c82000640 1 -- 172.21.15.6:0/2535264770 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6c58065150 msgr2=0x7f6c58067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.984+0000 7f6c82000640 1 --2- 172.21.15.6:0/2535264770 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6c58065150 0x7f6c58067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c033000 tx=0x7f6c6c034000 comp rx=0 tx=0).stop 2024-08-17T02:27:00.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.985+0000 7f6c82000640 1 -- 172.21.15.6:0/2535264770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c159690 msgr2=0x7f6c7c14a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.985+0000 7f6c82000640 1 --2- 172.21.15.6:0/2535264770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c159690 0x7f6c7c14a6a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400e600 tx=0x7f6c64009040 comp rx=0 tx=0).stop 2024-08-17T02:27:00.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.985+0000 7f6c82000640 1 -- 172.21.15.6:0/2535264770 shutdown_connections 2024-08-17T02:27:00.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.985+0000 7f6c82000640 1 --2- 172.21.15.6:0/2535264770 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6c58065150 0x7f6c58067600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.985+0000 7f6c82000640 1 --2- 172.21.15.6:0/2535264770 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c7c0a88e0 0x7f6c7c0a8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.985+0000 7f6c82000640 1 --2- 172.21.15.6:0/2535264770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c159690 0x7f6c7c14a6a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.985+0000 7f6c82000640 1 --2- 172.21.15.6:0/2535264770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c60003a00 0x7f6c7c16c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.985+0000 7f6c82000640 1 -- 172.21.15.6:0/2535264770 >> 172.21.15.6:0/2535264770 conn(0x7f6c7c0cc390 msgr2=0x7f6c7c154050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.985+0000 7f6c82000640 1 -- 172.21.15.6:0/2535264770 shutdown_connections 2024-08-17T02:27:00.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:00.985+0000 7f6c82000640 1 -- 172.21.15.6:0/2535264770 wait complete. 2024-08-17T02:27:01.000 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.153+0000 7f9d84e00640 1 Processor -- start 2024-08-17T02:27:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.154+0000 7f9d84e00640 1 -- start start 2024-08-17T02:27:01.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.155+0000 7f9d84e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d80158a00 0x7f9d80158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.155+0000 7f9d84e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d800cb190 0x7f9d800cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.155+0000 7f9d84e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d800cbc50 con 0x7f9d8006e590 2024-08-17T02:27:01.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.155+0000 7f9d84e00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d800cbf30 con 0x7f9d80158a00 2024-08-17T02:27:01.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.155+0000 7f9d84e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800cc210 con 0x7f9d800cb190 2024-08-17T02:27:01.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.155+0000 7f9d7f400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d80158a00 0x7f9d80158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.155+0000 7f9d7f400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d80158a00 0x7f9d80158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40958/0 (socket says 172.21.15.6:40958) 2024-08-17T02:27:01.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.155+0000 7f9d7f400640 1 -- 172.21.15.6:0/1360564624 learned_addr learned my addr 172.21.15.6:0/1360564624 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.155+0000 7f9d7f400640 1 -- 172.21.15.6:0/1360564624 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d800cb190 msgr2=0x7f9d800cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.155+0000 7f9d76a00640 1 --2- 172.21.15.6:0/1360564624 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d800cb190 0x7f9d800cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.155+0000 7f9d7f400640 1 --2- 172.21.15.6:0/1360564624 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d800cb190 0x7f9d800cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.155+0000 7f9d7f400640 1 -- 172.21.15.6:0/1360564624 >> v1:172.21.15.136:6789/0 conn(0x7f9d8006e590 legacy=0x7f9d800683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.155+0000 7f9d7f400640 1 -- 172.21.15.6:0/1360564624 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d800b2930 con 0x7f9d80158a00 2024-08-17T02:27:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.155+0000 7f9d76a00640 1 --2- 172.21.15.6:0/1360564624 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d800cb190 0x7f9d800cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.156+0000 7f9d7f400640 1 --2- 172.21.15.6:0/1360564624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d80158a00 0x7f9d80158dd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009910 tx=0x7f9d700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb689c8f345d7d68 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.157+0000 7f9d7ea00640 1 -- 172.21.15.6:0/1360564624 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7002adb0 con 0x7f9d80158a00 2024-08-17T02:27:01.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.157+0000 7f9d7ea00640 1 -- 172.21.15.6:0/1360564624 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d70032440 con 0x7f9d80158a00 2024-08-17T02:27:01.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.157+0000 7f9d7ea00640 1 -- 172.21.15.6:0/1360564624 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70032820 con 0x7f9d80158a00 2024-08-17T02:27:01.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.157+0000 7f9d84e00640 1 -- 172.21.15.6:0/1360564624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d80158a00 msgr2=0x7f9d80158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.157+0000 7f9d84e00640 1 --2- 172.21.15.6:0/1360564624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d80158a00 0x7f9d80158dd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009910 tx=0x7f9d700091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.157+0000 7f9d84e00640 1 -- 172.21.15.6:0/1360564624 shutdown_connections 2024-08-17T02:27:01.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.157+0000 7f9d84e00640 1 --2- 172.21.15.6:0/1360564624 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d800cb190 0x7f9d800cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.157+0000 7f9d84e00640 1 --2- 172.21.15.6:0/1360564624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d80158a00 0x7f9d80158dd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.157+0000 7f9d84e00640 1 -- 172.21.15.6:0/1360564624 >> 172.21.15.6:0/1360564624 conn(0x7f9d800cfb80 msgr2=0x7f9d800cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.157+0000 7f9d84e00640 1 -- 172.21.15.6:0/1360564624 shutdown_connections 2024-08-17T02:27:01.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.157+0000 7f9d84e00640 1 -- 172.21.15.6:0/1360564624 wait complete. 2024-08-17T02:27:01.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.159+0000 7f9d84e00640 1 Processor -- start 2024-08-17T02:27:01.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.159+0000 7f9d84e00640 1 -- start start 2024-08-17T02:27:01.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.160+0000 7f9d84e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d8006e590 0x7f9d80151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.160+0000 7f9d84e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800cb190 0x7f9d800c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.160+0000 7f9d84e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d80158a00 0x7f9d800c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.160+0000 7f9d84e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d801552e0 con 0x7f9d800cb190 2024-08-17T02:27:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.160+0000 7f9d84e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800c9b60 con 0x7f9d8006e590 2024-08-17T02:27:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.160+0000 7f9d84e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d80151550 con 0x7f9d80158a00 2024-08-17T02:27:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.160+0000 7f9d76a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800cb190 0x7f9d800c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.160+0000 7f9d76a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800cb190 0x7f9d800c90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40972/0 (socket says 172.21.15.6:40972) 2024-08-17T02:27:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.160+0000 7f9d76a00640 1 -- 172.21.15.6:0/3807543689 learned_addr learned my addr 172.21.15.6:0/3807543689 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.160+0000 7f9d7fe00640 1 --2- 172.21.15.6:0/3807543689 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d80158a00 0x7f9d800c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.160+0000 7f9d7f400640 1 --2- 172.21.15.6:0/3807543689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d8006e590 0x7f9d80151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.160+0000 7f9d76a00640 1 -- 172.21.15.6:0/3807543689 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d80158a00 msgr2=0x7f9d800c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.160+0000 7f9d76a00640 1 --2- 172.21.15.6:0/3807543689 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d80158a00 0x7f9d800c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.160+0000 7f9d76a00640 1 -- 172.21.15.6:0/3807543689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d8006e590 msgr2=0x7f9d80151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.160+0000 7f9d76a00640 1 --2- 172.21.15.6:0/3807543689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d8006e590 0x7f9d80151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.160+0000 7f9d76a00640 1 -- 172.21.15.6:0/3807543689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d70009450 con 0x7f9d800cb190 2024-08-17T02:27:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.161+0000 7f9d76a00640 1 --2- 172.21.15.6:0/3807543689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800cb190 0x7f9d800c90e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800c880 tx=0x7f9d68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.161+0000 7f9d77400640 1 -- 172.21.15.6:0/3807543689 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6800ce10 con 0x7f9d800cb190 2024-08-17T02:27:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.161+0000 7f9d77400640 1 -- 172.21.15.6:0/3807543689 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d68007890 con 0x7f9d800cb190 2024-08-17T02:27:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.161+0000 7f9d77400640 1 -- 172.21.15.6:0/3807543689 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d68007c10 con 0x7f9d800cb190 2024-08-17T02:27:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.161+0000 7f9d84e00640 1 -- 172.21.15.6:0/3807543689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d800c7230 con 0x7f9d800cb190 2024-08-17T02:27:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.161+0000 7f9d84e00640 1 -- 172.21.15.6:0/3807543689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d800c77f0 con 0x7f9d800cb190 2024-08-17T02:27:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.162+0000 7f9d84e00640 1 -- 172.21.15.6:0/3807543689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d80155450 con 0x7f9d800cb190 2024-08-17T02:27:01.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.163+0000 7f9d77400640 1 -- 172.21.15.6:0/3807543689 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9d680113f0 con 0x7f9d800cb190 2024-08-17T02:27:01.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.164+0000 7f9d77400640 1 --2- 172.21.15.6:0/3807543689 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9d5c065150 0x7f9d5c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.164+0000 7f9d77400640 1 -- 172.21.15.6:0/3807543689 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d68082460 con 0x7f9d800cb190 2024-08-17T02:27:01.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.165+0000 7f9d7f400640 1 --2- 172.21.15.6:0/3807543689 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9d5c065150 0x7f9d5c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.166+0000 7f9d7f400640 1 --2- 172.21.15.6:0/3807543689 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9d5c065150 0x7f9d5c067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9d70034000 tx=0x7f9d70032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.168+0000 7f9d77400640 1 -- 172.21.15.6:0/3807543689 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9d68053fc0 con 0x7f9d800cb190 2024-08-17T02:27:01.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.352+0000 7f9d84e00640 1 -- 172.21.15.6:0/3807543689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d80070720 con 0x7f9d800cb190 2024-08-17T02:27:01.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.353+0000 7f9d77400640 1 -- 172.21.15.6:0/3807543689 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9d68053b50 con 0x7f9d800cb190 2024-08-17T02:27:01.353 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-08-17T02:27:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.355+0000 7f9d84e00640 1 -- 172.21.15.6:0/3807543689 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9d5c065150 msgr2=0x7f9d5c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.355+0000 7f9d84e00640 1 --2- 172.21.15.6:0/3807543689 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9d5c065150 0x7f9d5c067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9d70034000 tx=0x7f9d70032000 comp rx=0 tx=0).stop 2024-08-17T02:27:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.355+0000 7f9d84e00640 1 -- 172.21.15.6:0/3807543689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800cb190 msgr2=0x7f9d800c90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.355+0000 7f9d84e00640 1 --2- 172.21.15.6:0/3807543689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800cb190 0x7f9d800c90e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800c880 tx=0x7f9d68008040 comp rx=0 tx=0).stop 2024-08-17T02:27:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.355+0000 7f9d84e00640 1 -- 172.21.15.6:0/3807543689 shutdown_connections 2024-08-17T02:27:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.355+0000 7f9d84e00640 1 --2- 172.21.15.6:0/3807543689 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9d5c065150 0x7f9d5c067600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.355+0000 7f9d84e00640 1 --2- 172.21.15.6:0/3807543689 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d80158a00 0x7f9d800c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.355+0000 7f9d84e00640 1 --2- 172.21.15.6:0/3807543689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800cb190 0x7f9d800c90e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.355+0000 7f9d84e00640 1 --2- 172.21.15.6:0/3807543689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d8006e590 0x7f9d80151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.355+0000 7f9d84e00640 1 -- 172.21.15.6:0/3807543689 >> 172.21.15.6:0/3807543689 conn(0x7f9d800cfb80 msgr2=0x7f9d8006e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.355+0000 7f9d84e00640 1 -- 172.21.15.6:0/3807543689 shutdown_connections 2024-08-17T02:27:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.355+0000 7f9d84e00640 1 -- 172.21.15.6:0/3807543689 wait complete. 2024-08-17T02:27:01.371 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:01.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.524+0000 7f6f0c000640 1 Processor -- start 2024-08-17T02:27:01.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.525+0000 7f6f0c000640 1 -- start start 2024-08-17T02:27:01.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.526+0000 7f6f0c000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f040ca050 0x7f6f04156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.526+0000 7f6f0c000640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f040cb160 con 0x7f6f040add30 2024-08-17T02:27:01.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.526+0000 7f6f0c000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f040b0d10 con 0x7f6f040ad960 2024-08-17T02:27:01.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.526+0000 7f6f0c000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040ca550 con 0x7f6f040ca050 2024-08-17T02:27:01.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.526+0000 7f6f0a000640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6f040add30 0x7f6f040aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40232/0 (socket says 172.21.15.6:40232) 2024-08-17T02:27:01.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.526+0000 7f6f0a000640 1 -- 172.21.15.6:0/2896254114 learned_addr learned my addr 172.21.15.6:0/2896254114 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:01.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.526+0000 7f6f03e00640 1 -- 172.21.15.6:0/2896254114 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814786578 0 0) 0x7f6f040cb160 con 0x7f6f040add30 2024-08-17T02:27:01.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.526+0000 7f6f08c00640 1 --2- 172.21.15.6:0/2896254114 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f040ca050 0x7f6f04156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.526+0000 7f6f03e00640 1 -- 172.21.15.6:0/2896254114 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eec0034e0 con 0x7f6f040add30 2024-08-17T02:27:01.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.527+0000 7f6f03e00640 1 -- 172.21.15.6:0/2896254114 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 764778402 0 0) 0x7f6eec0034e0 con 0x7f6f040add30 2024-08-17T02:27:01.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.527+0000 7f6f03e00640 1 -- 172.21.15.6:0/2896254114 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f040ca050 msgr2=0x7f6f04156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.527+0000 7f6f03e00640 1 --2- 172.21.15.6:0/2896254114 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f040ca050 0x7f6f04156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.527+0000 7f6f03e00640 1 -- 172.21.15.6:0/2896254114 >> v1:172.21.15.136:6789/0 conn(0x7f6f040ad960 legacy=0x7f6f04156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.527+0000 7f6f03e00640 1 -- 172.21.15.6:0/2896254114 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f040ca830 con 0x7f6f040add30 2024-08-17T02:27:01.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.527+0000 7f6f03e00640 1 -- 172.21.15.6:0/2896254114 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f6efc0017f0 con 0x7f6f040add30 2024-08-17T02:27:01.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.527+0000 7f6f03e00640 1 -- 172.21.15.6:0/2896254114 >> v1:172.21.15.6:6789/0 conn(0x7f6f040add30 legacy=0x7f6f040aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.527+0000 7f6f03e00640 1 --2- 172.21.15.6:0/2896254114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec003a00 0x7f6eec003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.527+0000 7f6f03e00640 1 --2- 172.21.15.6:0/2896254114 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f040ca050 0x7f6eec004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.527+0000 7f6f03e00640 1 --2- 172.21.15.6:0/2896254114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6eec004cc0 0x7f6eec005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.527+0000 7f6f03e00640 1 -- 172.21.15.6:0/2896254114 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040ca550 con 0x7f6eec003a00 2024-08-17T02:27:01.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.527+0000 7f6f03e00640 1 -- 172.21.15.6:0/2896254114 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec00bb60 con 0x7f6eec004cc0 2024-08-17T02:27:01.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.527+0000 7f6f03e00640 1 -- 172.21.15.6:0/2896254114 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec00bcf0 con 0x7f6f040ca050 2024-08-17T02:27:01.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.527+0000 7f6f09600640 1 --2- 172.21.15.6:0/2896254114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec003a00 0x7f6eec003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.527+0000 7f6f08c00640 1 --2- 172.21.15.6:0/2896254114 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f040ca050 0x7f6eec004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.527+0000 7f6f0a000640 1 --2- 172.21.15.6:0/2896254114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6eec004cc0 0x7f6eec005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.528+0000 7f6f09600640 1 -- 172.21.15.6:0/2896254114 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f040ca050 msgr2=0x7f6eec004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.528+0000 7f6f09600640 1 --2- 172.21.15.6:0/2896254114 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f040ca050 0x7f6eec004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.528+0000 7f6f09600640 1 -- 172.21.15.6:0/2896254114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6eec004cc0 msgr2=0x7f6eec005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.528+0000 7f6f09600640 1 --2- 172.21.15.6:0/2896254114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6eec004cc0 0x7f6eec005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.528+0000 7f6f09600640 1 -- 172.21.15.6:0/2896254114 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec0034e0 con 0x7f6eec003a00 2024-08-17T02:27:01.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.528+0000 7f6f0a000640 1 --2- 172.21.15.6:0/2896254114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6eec004cc0 0x7f6eec005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.529+0000 7f6f09600640 1 --2- 172.21.15.6:0/2896254114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec003a00 0x7f6eec003e10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8001800 tx=0x7f6ef8007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fb100121c3d8d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.529+0000 7f6f03e00640 1 -- 172.21.15.6:0/2896254114 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef802a900 con 0x7f6eec003a00 2024-08-17T02:27:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.529+0000 7f6f03e00640 1 -- 172.21.15.6:0/2896254114 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef802aa80 con 0x7f6eec003a00 2024-08-17T02:27:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.529+0000 7f6f03e00640 1 -- 172.21.15.6:0/2896254114 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef802ae40 con 0x7f6eec003a00 2024-08-17T02:27:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.529+0000 7f6f0c000640 1 -- 172.21.15.6:0/2896254114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec003a00 msgr2=0x7f6eec003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.529+0000 7f6f0c000640 1 --2- 172.21.15.6:0/2896254114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec003a00 0x7f6eec003e10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8001800 tx=0x7f6ef8007ca0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.529+0000 7f6f0a000640 1 -- 172.21.15.6:0/2896254114 reap_dead start 2024-08-17T02:27:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.530+0000 7f6f0c000640 1 -- 172.21.15.6:0/2896254114 shutdown_connections 2024-08-17T02:27:01.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.530+0000 7f6f0c000640 1 -- 172.21.15.6:0/2896254114 >> 172.21.15.6:0/2896254114 conn(0x7f6f04066e60 msgr2=0x7f6f04067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.530+0000 7f6f0c000640 1 -- 172.21.15.6:0/2896254114 shutdown_connections 2024-08-17T02:27:01.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.530+0000 7f6f0c000640 1 -- 172.21.15.6:0/2896254114 wait complete. 2024-08-17T02:27:01.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.531+0000 7f6f0c000640 1 Processor -- start 2024-08-17T02:27:01.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.531+0000 7f6f0c000640 1 -- start start 2024-08-17T02:27:01.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.532+0000 7f6f0c000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6eec003a00 0x7f6f0414a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.532+0000 7f6f0c000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f040abed0 0x7f6f041521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.532+0000 7f6f0c000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f041526e0 0x7f6f040a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.532+0000 7f6f0c000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f04152b50 con 0x7f6f040abed0 2024-08-17T02:27:01.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.532+0000 7f6f0c000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040aa9f0 con 0x7f6f041526e0 2024-08-17T02:27:01.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.532+0000 7f6f0c000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040a9b00 con 0x7f6eec003a00 2024-08-17T02:27:01.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.532+0000 7f6f08c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f040abed0 0x7f6f041521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.533+0000 7f6f09600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6eec003a00 0x7f6f0414a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.533+0000 7f6f08c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f040abed0 0x7f6f041521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41000/0 (socket says 172.21.15.6:41000) 2024-08-17T02:27:01.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.533+0000 7f6f08c00640 1 -- 172.21.15.6:0/3604386470 learned_addr learned my addr 172.21.15.6:0/3604386470 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:01.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.533+0000 7f6f0a000640 1 --2- 172.21.15.6:0/3604386470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f041526e0 0x7f6f040a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.533+0000 7f6f08c00640 1 -- 172.21.15.6:0/3604386470 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6eec003a00 msgr2=0x7f6f0414a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.533+0000 7f6f08c00640 1 --2- 172.21.15.6:0/3604386470 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6eec003a00 0x7f6f0414a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.533+0000 7f6f08c00640 1 -- 172.21.15.6:0/3604386470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f041526e0 msgr2=0x7f6f040a88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.533+0000 7f6f08c00640 1 --2- 172.21.15.6:0/3604386470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f041526e0 0x7f6f040a88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.533+0000 7f6f08c00640 1 -- 172.21.15.6:0/3604386470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f040a9de0 con 0x7f6f040abed0 2024-08-17T02:27:01.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.533+0000 7f6f08c00640 1 --2- 172.21.15.6:0/3604386470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f040abed0 0x7f6f041521a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0011b40 tx=0x7f6ef00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.533+0000 7f6f00c00640 1 -- 172.21.15.6:0/3604386470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef000fb00 con 0x7f6f040abed0 2024-08-17T02:27:01.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.533+0000 7f6f00c00640 1 -- 172.21.15.6:0/3604386470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef000fc60 con 0x7f6f040abed0 2024-08-17T02:27:01.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.534+0000 7f6f00c00640 1 -- 172.21.15.6:0/3604386470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef001d480 con 0x7f6f040abed0 2024-08-17T02:27:01.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.534+0000 7f6f0c000640 1 -- 172.21.15.6:0/3604386470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f040aa0c0 con 0x7f6f040abed0 2024-08-17T02:27:01.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.534+0000 7f6f0c000640 1 -- 172.21.15.6:0/3604386470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f040aa680 con 0x7f6f040abed0 2024-08-17T02:27:01.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.535+0000 7f6f0c000640 1 -- 172.21.15.6:0/3604386470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f04063fb0 con 0x7f6f040abed0 2024-08-17T02:27:01.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.535+0000 7f6f00c00640 1 -- 172.21.15.6:0/3604386470 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6ef001d7f0 con 0x7f6f040abed0 2024-08-17T02:27:01.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.536+0000 7f6f00c00640 1 --2- 172.21.15.6:0/3604386470 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6ee4065180 0x7f6ee4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.536+0000 7f6f00c00640 1 -- 172.21.15.6:0/3604386470 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ef0018070 con 0x7f6f040abed0 2024-08-17T02:27:01.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.537+0000 7f6f09600640 1 --2- 172.21.15.6:0/3604386470 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6ee4065180 0x7f6ee4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.537+0000 7f6f09600640 1 --2- 172.21.15.6:0/3604386470 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6ee4065180 0x7f6ee4067630 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8032000 tx=0x7f6ef8003000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.540+0000 7f6f00c00640 1 -- 172.21.15.6:0/3604386470 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6ef0051100 con 0x7f6f040abed0 2024-08-17T02:27:01.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.724+0000 7f6f0c000640 1 -- 172.21.15.6:0/3604386470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f040aab30 con 0x7f6f040abed0 2024-08-17T02:27:01.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.724+0000 7f6f00c00640 1 -- 172.21.15.6:0/3604386470 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ef00220a0 con 0x7f6f040abed0 2024-08-17T02:27:01.725 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-08-17T02:27:01.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.727+0000 7f6f0c000640 1 -- 172.21.15.6:0/3604386470 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6ee4065180 msgr2=0x7f6ee4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.727+0000 7f6f0c000640 1 --2- 172.21.15.6:0/3604386470 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6ee4065180 0x7f6ee4067630 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8032000 tx=0x7f6ef8003000 comp rx=0 tx=0).stop 2024-08-17T02:27:01.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.727+0000 7f6f0c000640 1 -- 172.21.15.6:0/3604386470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f040abed0 msgr2=0x7f6f041521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.727+0000 7f6f0c000640 1 --2- 172.21.15.6:0/3604386470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f040abed0 0x7f6f041521a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0011b40 tx=0x7f6ef00090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.727+0000 7f6f0c000640 1 -- 172.21.15.6:0/3604386470 shutdown_connections 2024-08-17T02:27:01.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.727+0000 7f6f0c000640 1 --2- 172.21.15.6:0/3604386470 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6ee4065180 0x7f6ee4067630 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.727+0000 7f6f0c000640 1 --2- 172.21.15.6:0/3604386470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f041526e0 0x7f6f040a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.727+0000 7f6f0c000640 1 --2- 172.21.15.6:0/3604386470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f040abed0 0x7f6f041521a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.727+0000 7f6f0c000640 1 --2- 172.21.15.6:0/3604386470 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6eec003a00 0x7f6f0414a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.727+0000 7f6f0c000640 1 -- 172.21.15.6:0/3604386470 >> 172.21.15.6:0/3604386470 conn(0x7f6f04066e60 msgr2=0x7f6f04153fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.727+0000 7f6f0c000640 1 -- 172.21.15.6:0/3604386470 shutdown_connections 2024-08-17T02:27:01.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.727+0000 7f6f0c000640 1 -- 172.21.15.6:0/3604386470 wait complete. 2024-08-17T02:27:01.742 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:01.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.893+0000 7f8ff3000640 1 Processor -- start 2024-08-17T02:27:01.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.893+0000 7f8ff3000640 1 -- start start 2024-08-17T02:27:01.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.894+0000 7f8ff3000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8fec0add30 0x7f8fec156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.894+0000 7f8ff3000640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fec0cb160 con 0x7f8fec0ca050 2024-08-17T02:27:01.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.894+0000 7f8ff3000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fec0b0d10 con 0x7f8fec0ad960 2024-08-17T02:27:01.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.894+0000 7f8ff3000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fec0ca550 con 0x7f8fec0add30 2024-08-17T02:27:01.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.894+0000 7f8fe3e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8fec0ca050 0x7f8fec0aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40238/0 (socket says 172.21.15.6:40238) 2024-08-17T02:27:01.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.894+0000 7f8fe3e00640 1 -- 172.21.15.6:0/1145918386 learned_addr learned my addr 172.21.15.6:0/1145918386 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:01.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.895+0000 7f8ff1000640 1 --2- 172.21.15.6:0/1145918386 >> v2:172.21.15.136:3300/0 conn(0x7f8fec0add30 0x7f8fec156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.895+0000 7f8feb400640 1 -- 172.21.15.6:0/1145918386 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846630325 0 0) 0x7f8fec0cb160 con 0x7f8fec0ca050 2024-08-17T02:27:01.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.895+0000 7f8feb400640 1 -- 172.21.15.6:0/1145918386 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fd00034e0 con 0x7f8fec0ca050 2024-08-17T02:27:01.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.895+0000 7f8feb400640 1 -- 172.21.15.6:0/1145918386 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2040387167 0 0) 0x7f8fd00034e0 con 0x7f8fec0ca050 2024-08-17T02:27:01.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.895+0000 7f8feb400640 1 -- 172.21.15.6:0/1145918386 >> v2:172.21.15.136:3300/0 conn(0x7f8fec0add30 msgr2=0x7f8fec156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.895+0000 7f8feb400640 1 --2- 172.21.15.6:0/1145918386 >> v2:172.21.15.136:3300/0 conn(0x7f8fec0add30 0x7f8fec156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.895+0000 7f8feb400640 1 -- 172.21.15.6:0/1145918386 >> v1:172.21.15.136:6789/0 conn(0x7f8fec0ad960 legacy=0x7f8fec156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.895+0000 7f8feb400640 1 -- 172.21.15.6:0/1145918386 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec0ca830 con 0x7f8fec0ca050 2024-08-17T02:27:01.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.895+0000 7f8feb400640 1 -- 172.21.15.6:0/1145918386 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f8fd4001470 con 0x7f8fec0ca050 2024-08-17T02:27:01.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.895+0000 7f8feb400640 1 -- 172.21.15.6:0/1145918386 >> v1:172.21.15.6:6789/0 conn(0x7f8fec0ca050 legacy=0x7f8fec0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.895+0000 7f8feb400640 1 --2- 172.21.15.6:0/1145918386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fd00039d0 0x7f8fd0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.895+0000 7f8feb400640 1 --2- 172.21.15.6:0/1145918386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fd0004780 0x7f8fd0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.895+0000 7f8feb400640 1 --2- 172.21.15.6:0/1145918386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8fd0005130 0x7f8fd000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.895+0000 7f8feb400640 1 -- 172.21.15.6:0/1145918386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0ca550 con 0x7f8fd0004780 2024-08-17T02:27:01.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.895+0000 7f8feb400640 1 -- 172.21.15.6:0/1145918386 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd000c040 con 0x7f8fd00039d0 2024-08-17T02:27:01.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.895+0000 7f8feb400640 1 -- 172.21.15.6:0/1145918386 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd000c200 con 0x7f8fd0005130 2024-08-17T02:27:01.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.896+0000 7f8fe3e00640 1 --2- 172.21.15.6:0/1145918386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fd0004780 0x7f8fd0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.896+0000 7f8febe00640 1 --2- 172.21.15.6:0/1145918386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fd00039d0 0x7f8fd0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.896+0000 7f8ff1000640 1 --2- 172.21.15.6:0/1145918386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8fd0005130 0x7f8fd000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.896+0000 7f8fe3e00640 1 -- 172.21.15.6:0/1145918386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8fd0005130 msgr2=0x7f8fd000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.896+0000 7f8fe3e00640 1 --2- 172.21.15.6:0/1145918386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8fd0005130 0x7f8fd000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.896+0000 7f8fe3e00640 1 -- 172.21.15.6:0/1145918386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fd00039d0 msgr2=0x7f8fd0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.896+0000 7f8fe3e00640 1 --2- 172.21.15.6:0/1145918386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fd00039d0 0x7f8fd0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.896+0000 7f8fe3e00640 1 -- 172.21.15.6:0/1145918386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd00034e0 con 0x7f8fd0004780 2024-08-17T02:27:01.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.896+0000 7f8ff1000640 1 -- 172.21.15.6:0/1145918386 reap_dead start 2024-08-17T02:27:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.897+0000 7f8fe3e00640 1 --2- 172.21.15.6:0/1145918386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fd0004780 0x7f8fd0004bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400c2d0 tx=0x7f8fd4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655fb2ccc62a04d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.897+0000 7f8feb400640 1 -- 172.21.15.6:0/1145918386 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4005890 con 0x7f8fd0004780 2024-08-17T02:27:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.897+0000 7f8feb400640 1 -- 172.21.15.6:0/1145918386 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd402d070 con 0x7f8fd0004780 2024-08-17T02:27:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.897+0000 7f8feb400640 1 -- 172.21.15.6:0/1145918386 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4005a50 con 0x7f8fd0004780 2024-08-17T02:27:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.898+0000 7f8ff3000640 1 -- 172.21.15.6:0/1145918386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fd0004780 msgr2=0x7f8fd0004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.898+0000 7f8ff3000640 1 --2- 172.21.15.6:0/1145918386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fd0004780 0x7f8fd0004bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400c2d0 tx=0x7f8fd4001e50 comp rx=0 tx=0).stop 2024-08-17T02:27:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.898+0000 7f8ff3000640 1 -- 172.21.15.6:0/1145918386 shutdown_connections 2024-08-17T02:27:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.898+0000 7f8ff3000640 1 --2- 172.21.15.6:0/1145918386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fd0004780 0x7f8fd0004bf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.898+0000 7f8ff3000640 1 -- 172.21.15.6:0/1145918386 >> 172.21.15.6:0/1145918386 conn(0x7f8fec066e60 msgr2=0x7f8fec067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.898+0000 7f8ff3000640 1 -- 172.21.15.6:0/1145918386 shutdown_connections 2024-08-17T02:27:01.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.898+0000 7f8ff3000640 1 -- 172.21.15.6:0/1145918386 wait complete. 2024-08-17T02:27:01.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.899+0000 7f8ff3000640 1 Processor -- start 2024-08-17T02:27:01.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.899+0000 7f8ff3000640 1 -- start start 2024-08-17T02:27:01.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.900+0000 7f8ff3000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fd0004780 0x7f8fec148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.900+0000 7f8ff3000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fec16a510 0x7f8fec0acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.900+0000 7f8ff3000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8fec0ad240 0x7f8fec0a9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.900+0000 7f8ff3000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0a8980 con 0x7f8fec16a510 2024-08-17T02:27:01.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.900+0000 7f8ff3000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0a8c60 con 0x7f8fd0004780 2024-08-17T02:27:01.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.900+0000 7f8ff3000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0a8f40 con 0x7f8fec0ad240 2024-08-17T02:27:01.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.901+0000 7f8fe3e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fec16a510 0x7f8fec0acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.901+0000 7f8fe3e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fec16a510 0x7f8fec0acd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41018/0 (socket says 172.21.15.6:41018) 2024-08-17T02:27:01.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.901+0000 7f8fe3e00640 1 -- 172.21.15.6:0/992770006 learned_addr learned my addr 172.21.15.6:0/992770006 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:01.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.901+0000 7f8febe00640 1 --2- 172.21.15.6:0/992770006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fd0004780 0x7f8fec148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.901+0000 7f8ff1000640 1 --2- 172.21.15.6:0/992770006 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8fec0ad240 0x7f8fec0a9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.901+0000 7f8fe3e00640 1 -- 172.21.15.6:0/992770006 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8fec0ad240 msgr2=0x7f8fec0a9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.901+0000 7f8fe3e00640 1 --2- 172.21.15.6:0/992770006 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8fec0ad240 0x7f8fec0a9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.901+0000 7f8fe3e00640 1 -- 172.21.15.6:0/992770006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fd0004780 msgr2=0x7f8fec148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.901+0000 7f8fe3e00640 1 --2- 172.21.15.6:0/992770006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fd0004780 0x7f8fec148770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.901+0000 7f8fe3e00640 1 -- 172.21.15.6:0/992770006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec0a9220 con 0x7f8fec16a510 2024-08-17T02:27:01.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.902+0000 7f8fe3e00640 1 --2- 172.21.15.6:0/992770006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fec16a510 0x7f8fec0acd00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8fd402acb0 tx=0x7f8fd4033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.902+0000 7f8fe3400640 1 -- 172.21.15.6:0/992770006 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4041070 con 0x7f8fec16a510 2024-08-17T02:27:01.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.902+0000 7f8fe3400640 1 -- 172.21.15.6:0/992770006 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd4005e40 con 0x7f8fec16a510 2024-08-17T02:27:01.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.902+0000 7f8fe3400640 1 -- 172.21.15.6:0/992770006 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd40049d0 con 0x7f8fec16a510 2024-08-17T02:27:01.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.902+0000 7f8ff3000640 1 -- 172.21.15.6:0/992770006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fec0a9500 con 0x7f8fec16a510 2024-08-17T02:27:01.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.902+0000 7f8ff3000640 1 -- 172.21.15.6:0/992770006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fec0ac820 con 0x7f8fec16a510 2024-08-17T02:27:01.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.903+0000 7f8ff3000640 1 -- 172.21.15.6:0/992770006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fec06e2c0 con 0x7f8fec16a510 2024-08-17T02:27:01.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.904+0000 7f8fe3400640 1 -- 172.21.15.6:0/992770006 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8fd402f030 con 0x7f8fec16a510 2024-08-17T02:27:01.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.904+0000 7f8fe3400640 1 --2- 172.21.15.6:0/992770006 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8fc8065180 0x7f8fc8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.905+0000 7f8fe3400640 1 -- 172.21.15.6:0/992770006 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8fd40a2250 con 0x7f8fec16a510 2024-08-17T02:27:01.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.905+0000 7f8febe00640 1 --2- 172.21.15.6:0/992770006 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8fc8065180 0x7f8fc8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.906+0000 7f8febe00640 1 --2- 172.21.15.6:0/992770006 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8fc8065180 0x7f8fc8067630 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8fec16a4c0 tx=0x7f8fdc007ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:01.909+0000 7f8fe3400640 1 -- 172.21.15.6:0/992770006 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8fec06e2c0 con 0x7f8fec16a510 2024-08-17T02:27:02.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.090+0000 7f8ff3000640 1 -- 172.21.15.6:0/992770006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fec06e2c0 con 0x7f8fec16a510 2024-08-17T02:27:02.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.091+0000 7f8fe3400640 1 -- 172.21.15.6:0/992770006 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f8fec06e2c0 con 0x7f8fec16a510 2024-08-17T02:27:02.092 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:02.092 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:33.190571+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:29.257601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:30.596556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:02.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.093+0000 7f8ff3000640 1 -- 172.21.15.6:0/992770006 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8fc8065180 msgr2=0x7f8fc8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.093+0000 7f8ff3000640 1 --2- 172.21.15.6:0/992770006 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8fc8065180 0x7f8fc8067630 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8fec16a4c0 tx=0x7f8fdc007ca0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.093+0000 7f8ff3000640 1 -- 172.21.15.6:0/992770006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fec16a510 msgr2=0x7f8fec0acd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.093+0000 7f8ff3000640 1 --2- 172.21.15.6:0/992770006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fec16a510 0x7f8fec0acd00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8fd402acb0 tx=0x7f8fd4033000 comp rx=0 tx=0).stop 2024-08-17T02:27:02.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.093+0000 7f8ff3000640 1 -- 172.21.15.6:0/992770006 shutdown_connections 2024-08-17T02:27:02.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.093+0000 7f8ff3000640 1 --2- 172.21.15.6:0/992770006 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8fc8065180 0x7f8fc8067630 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.093+0000 7f8ff3000640 1 --2- 172.21.15.6:0/992770006 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8fec0ad240 0x7f8fec0a9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.093+0000 7f8ff3000640 1 --2- 172.21.15.6:0/992770006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fec16a510 0x7f8fec0acd00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.093+0000 7f8ff3000640 1 --2- 172.21.15.6:0/992770006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fd0004780 0x7f8fec148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.093+0000 7f8ff3000640 1 -- 172.21.15.6:0/992770006 >> 172.21.15.6:0/992770006 conn(0x7f8fec066e60 msgr2=0x7f8fec069890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.093+0000 7f8ff3000640 1 -- 172.21.15.6:0/992770006 shutdown_connections 2024-08-17T02:27:02.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.093+0000 7f8ff3000640 1 -- 172.21.15.6:0/992770006 wait complete. 2024-08-17T02:27:02.109 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:25.463503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:29.257601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:30.596556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:02.109 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.262+0000 7f5837200640 1 Processor -- start 2024-08-17T02:27:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.263+0000 7f5837200640 1 -- start start 2024-08-17T02:27:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.264+0000 7f5837200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f58380ae200 0x7f58380af230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.264+0000 7f5837200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5838067f70 0x7f5838158f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.264+0000 7f5837200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5838069270 con 0x7f58380aee60 2024-08-17T02:27:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.264+0000 7f5837200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5838069550 con 0x7f58380ae200 2024-08-17T02:27:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.264+0000 7f5837200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5838069830 con 0x7f5838067f70 2024-08-17T02:27:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.264+0000 7f5835400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f58380ae200 0x7f58380af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.264+0000 7f5836800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5838067f70 0x7f5838158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.264+0000 7f5835400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f58380ae200 0x7f58380af230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:53346/0 (socket says 172.21.15.6:53346) 2024-08-17T02:27:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.264+0000 7f5835400640 1 -- 172.21.15.6:0/2559017200 learned_addr learned my addr 172.21.15.6:0/2559017200 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.264+0000 7f5835e00640 1 --1- 172.21.15.6:0/2559017200 >> v1:172.21.15.136:6789/0 conn(0x7f58380aee60 0x7f5838158860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:36350/0 (socket says 172.21.15.6:36350) 2024-08-17T02:27:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.265+0000 7f5835400640 1 -- 172.21.15.6:0/2559017200 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5838067f70 msgr2=0x7f5838158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.265+0000 7f5835400640 1 --2- 172.21.15.6:0/2559017200 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5838067f70 0x7f5838158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.265+0000 7f5835400640 1 -- 172.21.15.6:0/2559017200 >> v1:172.21.15.136:6789/0 conn(0x7f58380aee60 legacy=0x7f5838158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.265+0000 7f5835400640 1 -- 172.21.15.6:0/2559017200 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5838069b10 con 0x7f58380ae200 2024-08-17T02:27:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.265+0000 7f5834a00640 1 -- 172.21.15.6:0/2559017200 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212845095 0 0) 0x7f5838069270 con 0x7f58380aee60 2024-08-17T02:27:02.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.266+0000 7f5835400640 1 --2- 172.21.15.6:0/2559017200 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58380ae200 0x7f58380af230 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5824009910 tx=0x7f58240091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37bcb18d2b6777e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.266+0000 7f5834a00640 1 -- 172.21.15.6:0/2559017200 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582402ae40 con 0x7f58380ae200 2024-08-17T02:27:02.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.266+0000 7f5834a00640 1 -- 172.21.15.6:0/2559017200 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5824032440 con 0x7f58380ae200 2024-08-17T02:27:02.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.266+0000 7f5834a00640 1 -- 172.21.15.6:0/2559017200 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58240327e0 con 0x7f58380ae200 2024-08-17T02:27:02.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.267+0000 7f5837200640 1 -- 172.21.15.6:0/2559017200 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58380ae200 msgr2=0x7f58380af230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.267+0000 7f5837200640 1 --2- 172.21.15.6:0/2559017200 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58380ae200 0x7f58380af230 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5824009910 tx=0x7f58240091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.267+0000 7f5837200640 1 -- 172.21.15.6:0/2559017200 shutdown_connections 2024-08-17T02:27:02.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.267+0000 7f5837200640 1 --2- 172.21.15.6:0/2559017200 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5838067f70 0x7f5838158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.267+0000 7f5837200640 1 --2- 172.21.15.6:0/2559017200 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58380ae200 0x7f58380af230 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.267+0000 7f5837200640 1 -- 172.21.15.6:0/2559017200 >> 172.21.15.6:0/2559017200 conn(0x7f58380ce450 msgr2=0x7f5838095c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.267+0000 7f5837200640 1 -- 172.21.15.6:0/2559017200 shutdown_connections 2024-08-17T02:27:02.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.267+0000 7f5837200640 1 -- 172.21.15.6:0/2559017200 wait complete. 2024-08-17T02:27:02.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.268+0000 7f5837200640 1 Processor -- start 2024-08-17T02:27:02.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.269+0000 7f5837200640 1 -- start start 2024-08-17T02:27:02.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.270+0000 7f5837200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5838067f70 0x7f5838168930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.270+0000 7f5837200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58380ae200 0x7f5838169970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.270+0000 7f5837200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f58380aee60 0x7f583809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.270+0000 7f5837200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58380c72c0 con 0x7f5838067f70 2024-08-17T02:27:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.270+0000 7f5837200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5838168e70 con 0x7f58380ae200 2024-08-17T02:27:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.270+0000 7f5837200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5838169eb0 con 0x7f58380aee60 2024-08-17T02:27:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.270+0000 7f5835e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5838067f70 0x7f5838168930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.270+0000 7f5835e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5838067f70 0x7f5838168930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41022/0 (socket says 172.21.15.6:41022) 2024-08-17T02:27:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.270+0000 7f5835e00640 1 -- 172.21.15.6:0/2916910962 learned_addr learned my addr 172.21.15.6:0/2916910962 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.270+0000 7f5835e00640 1 -- 172.21.15.6:0/2916910962 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f58380aee60 msgr2=0x7f583809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.270+0000 7f5835e00640 1 --2- 172.21.15.6:0/2916910962 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f58380aee60 0x7f583809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.270+0000 7f5835e00640 1 -- 172.21.15.6:0/2916910962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58380ae200 msgr2=0x7f5838169970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.270+0000 7f5835400640 1 --2- 172.21.15.6:0/2916910962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58380ae200 0x7f5838169970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.270+0000 7f5835e00640 1 --2- 172.21.15.6:0/2916910962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58380ae200 0x7f5838169970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.270+0000 7f5835e00640 1 -- 172.21.15.6:0/2916910962 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5824009450 con 0x7f5838067f70 2024-08-17T02:27:02.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.270+0000 7f5835400640 1 --2- 172.21.15.6:0/2916910962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58380ae200 0x7f5838169970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:02.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.271+0000 7f5835e00640 1 --2- 172.21.15.6:0/2916910962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5838067f70 0x7f5838168930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f582800c5b0 tx=0x7f5828007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.271+0000 7f582d600640 1 -- 172.21.15.6:0/2916910962 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5828007300 con 0x7f5838067f70 2024-08-17T02:27:02.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.271+0000 7f582d600640 1 -- 172.21.15.6:0/2916910962 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58280074a0 con 0x7f5838067f70 2024-08-17T02:27:02.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.271+0000 7f582d600640 1 -- 172.21.15.6:0/2916910962 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58280049f0 con 0x7f5838067f70 2024-08-17T02:27:02.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.271+0000 7f5837200640 1 -- 172.21.15.6:0/2916910962 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58380c6640 con 0x7f5838067f70 2024-08-17T02:27:02.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.271+0000 7f5837200640 1 -- 172.21.15.6:0/2916910962 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58380c6c00 con 0x7f5838067f70 2024-08-17T02:27:02.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.272+0000 7f5837200640 1 -- 172.21.15.6:0/2916910962 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5838070720 con 0x7f5838067f70 2024-08-17T02:27:02.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.273+0000 7f582d600640 1 -- 172.21.15.6:0/2916910962 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f582801c3b0 con 0x7f5838067f70 2024-08-17T02:27:02.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.274+0000 7f582d600640 1 --2- 172.21.15.6:0/2916910962 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5818065150 0x7f5818067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.274+0000 7f582d600640 1 -- 172.21.15.6:0/2916910962 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5828081780 con 0x7f5838067f70 2024-08-17T02:27:02.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.274+0000 7f5835400640 1 --2- 172.21.15.6:0/2916910962 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5818065150 0x7f5818067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.275+0000 7f5835400640 1 --2- 172.21.15.6:0/2916910962 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5818065150 0x7f5818067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5824034000 tx=0x7f5824032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.277+0000 7f582d600640 1 -- 172.21.15.6:0/2916910962 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f582804ce40 con 0x7f5838067f70 2024-08-17T02:27:02.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.458+0000 7f5837200640 1 -- 172.21.15.6:0/2916910962 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5838097360 con 0x7f5838067f70 2024-08-17T02:27:02.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.459+0000 7f582d600640 1 -- 172.21.15.6:0/2916910962 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f582804f8f0 con 0x7f5838067f70 2024-08-17T02:27:02.460 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-08-17T02:27:02.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.461+0000 7f5837200640 1 -- 172.21.15.6:0/2916910962 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5818065150 msgr2=0x7f5818067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.461+0000 7f5837200640 1 --2- 172.21.15.6:0/2916910962 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5818065150 0x7f5818067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5824034000 tx=0x7f5824032000 comp rx=0 tx=0).stop 2024-08-17T02:27:02.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.461+0000 7f5837200640 1 -- 172.21.15.6:0/2916910962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5838067f70 msgr2=0x7f5838168930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.461+0000 7f5837200640 1 --2- 172.21.15.6:0/2916910962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5838067f70 0x7f5838168930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f582800c5b0 tx=0x7f5828007f20 comp rx=0 tx=0).stop 2024-08-17T02:27:02.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.461+0000 7f5837200640 1 -- 172.21.15.6:0/2916910962 shutdown_connections 2024-08-17T02:27:02.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.461+0000 7f5837200640 1 --2- 172.21.15.6:0/2916910962 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5818065150 0x7f5818067600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.461+0000 7f5837200640 1 --2- 172.21.15.6:0/2916910962 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f58380aee60 0x7f583809aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.461+0000 7f5837200640 1 --2- 172.21.15.6:0/2916910962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58380ae200 0x7f5838169970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.461+0000 7f5837200640 1 --2- 172.21.15.6:0/2916910962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5838067f70 0x7f5838168930 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.461+0000 7f5837200640 1 -- 172.21.15.6:0/2916910962 >> 172.21.15.6:0/2916910962 conn(0x7f58380ce450 msgr2=0x7f58380964c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.461+0000 7f5837200640 1 -- 172.21.15.6:0/2916910962 shutdown_connections 2024-08-17T02:27:02.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.461+0000 7f5837200640 1 -- 172.21.15.6:0/2916910962 wait complete. 2024-08-17T02:27:02.476 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.629+0000 7f8c2a600640 1 Processor -- start 2024-08-17T02:27:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.629+0000 7f8c2a600640 1 -- start start 2024-08-17T02:27:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.630+0000 7f8c2a600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c240afca0 0x7f8c240b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.631+0000 7f8c2a600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c240acf10 0x7f8c24159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.631+0000 7f8c2a600640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2415a4e0 con 0x7f8c241589a0 2024-08-17T02:27:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.631+0000 7f8c2a600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c240b0980 con 0x7f8c240acf10 2024-08-17T02:27:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.631+0000 7f8c2a600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240c92b0 con 0x7f8c240afca0 2024-08-17T02:27:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.631+0000 7f8c1be00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c240acf10 0x7f8c24159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.631+0000 7f8c1be00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c240acf10 0x7f8c24159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41034/0 (socket says 172.21.15.6:41034) 2024-08-17T02:27:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.631+0000 7f8c23e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8c241589a0 0x7f8c2406d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40242/0 (socket says 172.21.15.6:40242) 2024-08-17T02:27:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.631+0000 7f8c1be00640 1 -- 172.21.15.6:0/3216685255 learned_addr learned my addr 172.21.15.6:0/3216685255 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.631+0000 7f8c23400640 1 --2- 172.21.15.6:0/3216685255 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c240afca0 0x7f8c240b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.631+0000 7f8c1be00640 1 -- 172.21.15.6:0/3216685255 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c240afca0 msgr2=0x7f8c240b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.631+0000 7f8c1be00640 1 --2- 172.21.15.6:0/3216685255 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c240afca0 0x7f8c240b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.631+0000 7f8c1be00640 1 -- 172.21.15.6:0/3216685255 >> v1:172.21.15.6:6789/0 conn(0x7f8c241589a0 legacy=0x7f8c2406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.631+0000 7f8c1be00640 1 -- 172.21.15.6:0/3216685255 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c240ad480 con 0x7f8c240acf10 2024-08-17T02:27:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.632+0000 7f8c1be00640 1 --2- 172.21.15.6:0/3216685255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240acf10 0x7f8c24159fa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009940 tx=0x7f8c0c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31db4b5ba0f45163 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.633+0000 7f8c22a00640 1 -- 172.21.15.6:0/3216685255 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c031510 con 0x7f8c240acf10 2024-08-17T02:27:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.633+0000 7f8c22a00640 1 -- 172.21.15.6:0/3216685255 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c02f050 con 0x7f8c240acf10 2024-08-17T02:27:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.633+0000 7f8c22a00640 1 -- 172.21.15.6:0/3216685255 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c0318e0 con 0x7f8c240acf10 2024-08-17T02:27:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.633+0000 7f8c2a600640 1 -- 172.21.15.6:0/3216685255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240acf10 msgr2=0x7f8c24159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.633+0000 7f8c2a600640 1 --2- 172.21.15.6:0/3216685255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240acf10 0x7f8c24159fa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009940 tx=0x7f8c0c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.633+0000 7f8c2a600640 1 -- 172.21.15.6:0/3216685255 shutdown_connections 2024-08-17T02:27:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.633+0000 7f8c2a600640 1 --2- 172.21.15.6:0/3216685255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240acf10 0x7f8c24159fa0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.633+0000 7f8c2a600640 1 --2- 172.21.15.6:0/3216685255 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c240afca0 0x7f8c240b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.633+0000 7f8c2a600640 1 -- 172.21.15.6:0/3216685255 >> 172.21.15.6:0/3216685255 conn(0x7f8c24066e60 msgr2=0x7f8c24067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.633+0000 7f8c2a600640 1 -- 172.21.15.6:0/3216685255 shutdown_connections 2024-08-17T02:27:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.633+0000 7f8c2a600640 1 -- 172.21.15.6:0/3216685255 wait complete. 2024-08-17T02:27:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.635+0000 7f8c2a600640 1 Processor -- start 2024-08-17T02:27:02.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.635+0000 7f8c2a600640 1 -- start start 2024-08-17T02:27:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.636+0000 7f8c2a600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c240acf10 0x7f8c240a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.636+0000 7f8c2a600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240afca0 0x7f8c24143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.636+0000 7f8c2a600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c241589a0 0x7f8c24157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.636+0000 7f8c2a600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2416a1c0 con 0x7f8c240afca0 2024-08-17T02:27:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.636+0000 7f8c2a600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240a4a10 con 0x7f8c240acf10 2024-08-17T02:27:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.636+0000 7f8c2a600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c241692f0 con 0x7f8c241589a0 2024-08-17T02:27:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.636+0000 7f8c1be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240afca0 0x7f8c24143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.636+0000 7f8c1be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240afca0 0x7f8c24143050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41044/0 (socket says 172.21.15.6:41044) 2024-08-17T02:27:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.636+0000 7f8c1be00640 1 -- 172.21.15.6:0/3085985010 learned_addr learned my addr 172.21.15.6:0/3085985010 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.636+0000 7f8c23400640 1 --2- 172.21.15.6:0/3085985010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c240acf10 0x7f8c240a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.636+0000 7f8c23e00640 1 --2- 172.21.15.6:0/3085985010 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c241589a0 0x7f8c24157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.636+0000 7f8c1be00640 1 -- 172.21.15.6:0/3085985010 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c241589a0 msgr2=0x7f8c24157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.636+0000 7f8c1be00640 1 --2- 172.21.15.6:0/3085985010 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c241589a0 0x7f8c24157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.636+0000 7f8c1be00640 1 -- 172.21.15.6:0/3085985010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c240acf10 msgr2=0x7f8c240a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.636+0000 7f8c1be00640 1 --2- 172.21.15.6:0/3085985010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c240acf10 0x7f8c240a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.636+0000 7f8c1be00640 1 -- 172.21.15.6:0/3085985010 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c009450 con 0x7f8c240afca0 2024-08-17T02:27:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.636+0000 7f8c23e00640 1 --2- 172.21.15.6:0/3085985010 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c241589a0 0x7f8c24157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.637+0000 7f8c1be00640 1 --2- 172.21.15.6:0/3085985010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240afca0 0x7f8c24143050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c006c70 tx=0x7f8c0c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.637+0000 7f8c1aa00640 1 -- 172.21.15.6:0/3085985010 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c0338e0 con 0x7f8c240afca0 2024-08-17T02:27:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.637+0000 7f8c1aa00640 1 -- 172.21.15.6:0/3085985010 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c033a40 con 0x7f8c240afca0 2024-08-17T02:27:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.637+0000 7f8c2a600640 1 -- 172.21.15.6:0/3085985010 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c241695b0 con 0x7f8c240afca0 2024-08-17T02:27:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.637+0000 7f8c1aa00640 1 -- 172.21.15.6:0/3085985010 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c033e00 con 0x7f8c240afca0 2024-08-17T02:27:02.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.637+0000 7f8c2a600640 1 -- 172.21.15.6:0/3085985010 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c24169b70 con 0x7f8c240afca0 2024-08-17T02:27:02.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.638+0000 7f8c2a600640 1 -- 172.21.15.6:0/3085985010 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2416a420 con 0x7f8c240afca0 2024-08-17T02:27:02.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.639+0000 7f8c1aa00640 1 -- 172.21.15.6:0/3085985010 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8c0c03d650 con 0x7f8c240afca0 2024-08-17T02:27:02.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.640+0000 7f8c1aa00640 1 --2- 172.21.15.6:0/3085985010 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8c00065150 0x7f8c00067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.640+0000 7f8c1aa00640 1 -- 172.21.15.6:0/3085985010 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8c0c0a38a0 con 0x7f8c240afca0 2024-08-17T02:27:02.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.640+0000 7f8c23400640 1 --2- 172.21.15.6:0/3085985010 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8c00065150 0x7f8c00067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.641+0000 7f8c23400640 1 --2- 172.21.15.6:0/3085985010 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8c00065150 0x7f8c00067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400bb40 tx=0x7f8c14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.644+0000 7f8c1aa00640 1 -- 172.21.15.6:0/3085985010 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8c2416a420 con 0x7f8c240afca0 2024-08-17T02:27:02.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.828+0000 7f8c2a600640 1 -- 172.21.15.6:0/3085985010 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c2416a400 con 0x7f8c240afca0 2024-08-17T02:27:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.828+0000 7f8c1aa00640 1 -- 172.21.15.6:0/3085985010 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8c0c04b020 con 0x7f8c240afca0 2024-08-17T02:27:02.829 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-08-17T02:27:02.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.831+0000 7f8c2a600640 1 -- 172.21.15.6:0/3085985010 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8c00065150 msgr2=0x7f8c00067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.831+0000 7f8c2a600640 1 --2- 172.21.15.6:0/3085985010 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8c00065150 0x7f8c00067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400bb40 tx=0x7f8c14008040 comp rx=0 tx=0).stop 2024-08-17T02:27:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.831+0000 7f8c2a600640 1 -- 172.21.15.6:0/3085985010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240afca0 msgr2=0x7f8c24143050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.831+0000 7f8c2a600640 1 --2- 172.21.15.6:0/3085985010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240afca0 0x7f8c24143050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c006c70 tx=0x7f8c0c037000 comp rx=0 tx=0).stop 2024-08-17T02:27:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.831+0000 7f8c2a600640 1 -- 172.21.15.6:0/3085985010 shutdown_connections 2024-08-17T02:27:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.831+0000 7f8c2a600640 1 --2- 172.21.15.6:0/3085985010 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8c00065150 0x7f8c00067600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.831+0000 7f8c2a600640 1 --2- 172.21.15.6:0/3085985010 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c241589a0 0x7f8c24157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.831+0000 7f8c2a600640 1 --2- 172.21.15.6:0/3085985010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240afca0 0x7f8c24143050 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.831+0000 7f8c2a600640 1 --2- 172.21.15.6:0/3085985010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c240acf10 0x7f8c240a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.831+0000 7f8c2a600640 1 -- 172.21.15.6:0/3085985010 >> 172.21.15.6:0/3085985010 conn(0x7f8c24066e60 msgr2=0x7f8c24159a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.831+0000 7f8c2a600640 1 -- 172.21.15.6:0/3085985010 shutdown_connections 2024-08-17T02:27:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:02.831+0000 7f8c2a600640 1 -- 172.21.15.6:0/3085985010 wait complete. 2024-08-17T02:27:02.847 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:03.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.000+0000 7fc3ec000640 1 Processor -- start 2024-08-17T02:27:03.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.001+0000 7fc3ec000640 1 -- start start 2024-08-17T02:27:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.002+0000 7fc3ec000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3e40aab40 0x7fc3e40a9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.002+0000 7fc3ec000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3e415a4d0 0x7fc3e415a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.002+0000 7fc3ec000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e40a88e0 con 0x7fc3e4158bf0 2024-08-17T02:27:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.002+0000 7fc3ec000640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e40a9180 con 0x7fc3e415a4d0 2024-08-17T02:27:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.002+0000 7fc3ec000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e415a0e0 con 0x7fc3e40aab40 2024-08-17T02:27:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.002+0000 7fc3ea000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3e415a4d0 0x7fc3e415a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.002+0000 7fc3ea000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3e415a4d0 0x7fc3e415a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41046/0 (socket says 172.21.15.6:41046) 2024-08-17T02:27:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.002+0000 7fc3ea000640 1 -- 172.21.15.6:0/2978020382 learned_addr learned my addr 172.21.15.6:0/2978020382 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.002+0000 7fc3e8c00640 1 --2- 172.21.15.6:0/2978020382 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3e40aab40 0x7fc3e40a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.003+0000 7fc3ea000640 1 -- 172.21.15.6:0/2978020382 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3e40aab40 msgr2=0x7fc3e40a9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.003+0000 7fc3ea000640 1 --2- 172.21.15.6:0/2978020382 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3e40aab40 0x7fc3e40a9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.003+0000 7fc3ea000640 1 -- 172.21.15.6:0/2978020382 >> v1:172.21.15.136:6789/0 conn(0x7fc3e4158bf0 legacy=0x7fc3e40aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.003+0000 7fc3ea000640 1 -- 172.21.15.6:0/2978020382 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e40a8b30 con 0x7fc3e415a4d0 2024-08-17T02:27:03.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.004+0000 7fc3ea000640 1 --2- 172.21.15.6:0/2978020382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e415a4d0 0x7fc3e415a970 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009f20 tx=0x7fc3dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d57f7e2bf48996f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.004+0000 7fc3e3e00640 1 -- 172.21.15.6:0/2978020382 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc031400 con 0x7fc3e415a4d0 2024-08-17T02:27:03.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.004+0000 7fc3e3e00640 1 -- 172.21.15.6:0/2978020382 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc02d050 con 0x7fc3e415a4d0 2024-08-17T02:27:03.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.004+0000 7fc3e3e00640 1 -- 172.21.15.6:0/2978020382 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc0317d0 con 0x7fc3e415a4d0 2024-08-17T02:27:03.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.004+0000 7fc3ec000640 1 -- 172.21.15.6:0/2978020382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e415a4d0 msgr2=0x7fc3e415a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.004+0000 7fc3ec000640 1 --2- 172.21.15.6:0/2978020382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e415a4d0 0x7fc3e415a970 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009f20 tx=0x7fc3dc009840 comp rx=0 tx=0).stop 2024-08-17T02:27:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.005+0000 7fc3ec000640 1 -- 172.21.15.6:0/2978020382 shutdown_connections 2024-08-17T02:27:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.005+0000 7fc3ec000640 1 --2- 172.21.15.6:0/2978020382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e415a4d0 0x7fc3e415a970 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.005+0000 7fc3ec000640 1 --2- 172.21.15.6:0/2978020382 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3e40aab40 0x7fc3e40a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.005+0000 7fc3ec000640 1 -- 172.21.15.6:0/2978020382 >> 172.21.15.6:0/2978020382 conn(0x7fc3e4066e60 msgr2=0x7fc3e4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.005+0000 7fc3ec000640 1 -- 172.21.15.6:0/2978020382 shutdown_connections 2024-08-17T02:27:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.005+0000 7fc3ec000640 1 -- 172.21.15.6:0/2978020382 wait complete. 2024-08-17T02:27:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.006+0000 7fc3ec000640 1 Processor -- start 2024-08-17T02:27:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.006+0000 7fc3ec000640 1 -- start start 2024-08-17T02:27:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.007+0000 7fc3ec000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3e40aab40 0x7fc3e40cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.007+0000 7fc3ec000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3e4158bf0 0x7fc3e41698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.007+0000 7fc3ec000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e415a4d0 0x7fc3e41538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.007+0000 7fc3ec000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40c8e10 con 0x7fc3e415a4d0 2024-08-17T02:27:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.007+0000 7fc3ec000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40cb330 con 0x7fc3e4158bf0 2024-08-17T02:27:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.007+0000 7fc3ec000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40cb610 con 0x7fc3e40aab40 2024-08-17T02:27:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.007+0000 7fc3ea000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e415a4d0 0x7fc3e41538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.007+0000 7fc3ea000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e415a4d0 0x7fc3e41538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41048/0 (socket says 172.21.15.6:41048) 2024-08-17T02:27:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.007+0000 7fc3ea000640 1 -- 172.21.15.6:0/3577732289 learned_addr learned my addr 172.21.15.6:0/3577732289 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.007+0000 7fc3e8c00640 1 --2- 172.21.15.6:0/3577732289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3e4158bf0 0x7fc3e41698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.007+0000 7fc3e9600640 1 --2- 172.21.15.6:0/3577732289 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3e40aab40 0x7fc3e40cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.008+0000 7fc3ea000640 1 -- 172.21.15.6:0/3577732289 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3e40aab40 msgr2=0x7fc3e40cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.008+0000 7fc3ea000640 1 --2- 172.21.15.6:0/3577732289 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3e40aab40 0x7fc3e40cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.008+0000 7fc3ea000640 1 -- 172.21.15.6:0/3577732289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3e4158bf0 msgr2=0x7fc3e41698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.008+0000 7fc3ea000640 1 --2- 172.21.15.6:0/3577732289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3e4158bf0 0x7fc3e41698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.008+0000 7fc3ea000640 1 -- 172.21.15.6:0/3577732289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc009ae0 con 0x7fc3e415a4d0 2024-08-17T02:27:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.008+0000 7fc3e9600640 1 --2- 172.21.15.6:0/3577732289 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3e40aab40 0x7fc3e40cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.008+0000 7fc3ea000640 1 --2- 172.21.15.6:0/3577732289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e415a4d0 0x7fc3e41538e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009f80 tx=0x7fc3dc036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.008+0000 7fc3e0c00640 1 -- 172.21.15.6:0/3577732289 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc007170 con 0x7fc3e415a4d0 2024-08-17T02:27:03.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.008+0000 7fc3e0c00640 1 -- 172.21.15.6:0/3577732289 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc008e50 con 0x7fc3e415a4d0 2024-08-17T02:27:03.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.008+0000 7fc3e0c00640 1 -- 172.21.15.6:0/3577732289 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc03b660 con 0x7fc3e415a4d0 2024-08-17T02:27:03.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.008+0000 7fc3ec000640 1 -- 172.21.15.6:0/3577732289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e40c9060 con 0x7fc3e415a4d0 2024-08-17T02:27:03.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.009+0000 7fc3ec000640 1 -- 172.21.15.6:0/3577732289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e4153e20 con 0x7fc3e415a4d0 2024-08-17T02:27:03.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.010+0000 7fc3ec000640 1 -- 172.21.15.6:0/3577732289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e4063fb0 con 0x7fc3e415a4d0 2024-08-17T02:27:03.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.011+0000 7fc3e0c00640 1 -- 172.21.15.6:0/3577732289 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc3dc038050 con 0x7fc3e415a4d0 2024-08-17T02:27:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.011+0000 7fc3e0c00640 1 --2- 172.21.15.6:0/3577732289 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc3c4065150 0x7fc3c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.011+0000 7fc3e0c00640 1 -- 172.21.15.6:0/3577732289 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc3dc0a3070 con 0x7fc3e415a4d0 2024-08-17T02:27:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.012+0000 7fc3e9600640 1 --2- 172.21.15.6:0/3577732289 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc3c4065150 0x7fc3c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.013+0000 7fc3e9600640 1 --2- 172.21.15.6:0/3577732289 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc3c4065150 0x7fc3c4067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8001820 tx=0x7fc3d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.016+0000 7fc3e0c00640 1 -- 172.21.15.6:0/3577732289 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc3dc0711e0 con 0x7fc3e415a4d0 2024-08-17T02:27:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.202+0000 7fc3ec000640 1 -- 172.21.15.6:0/3577732289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3e406a1d0 con 0x7fc3e415a4d0 2024-08-17T02:27:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.202+0000 7fc3e0c00640 1 -- 172.21.15.6:0/3577732289 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc3dc03c030 con 0x7fc3e415a4d0 2024-08-17T02:27:03.203 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-08-17T02:27:03.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.204+0000 7fc3ec000640 1 -- 172.21.15.6:0/3577732289 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc3c4065150 msgr2=0x7fc3c4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.204+0000 7fc3ec000640 1 --2- 172.21.15.6:0/3577732289 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc3c4065150 0x7fc3c4067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8001820 tx=0x7fc3d8009040 comp rx=0 tx=0).stop 2024-08-17T02:27:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.204+0000 7fc3ec000640 1 -- 172.21.15.6:0/3577732289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e415a4d0 msgr2=0x7fc3e41538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.204+0000 7fc3ec000640 1 --2- 172.21.15.6:0/3577732289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e415a4d0 0x7fc3e41538e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009f80 tx=0x7fc3dc036000 comp rx=0 tx=0).stop 2024-08-17T02:27:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.204+0000 7fc3ec000640 1 -- 172.21.15.6:0/3577732289 shutdown_connections 2024-08-17T02:27:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.204+0000 7fc3ec000640 1 --2- 172.21.15.6:0/3577732289 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fc3c4065150 0x7fc3c4067600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.204+0000 7fc3ec000640 1 --2- 172.21.15.6:0/3577732289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e415a4d0 0x7fc3e41538e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.204+0000 7fc3ec000640 1 --2- 172.21.15.6:0/3577732289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3e4158bf0 0x7fc3e41698b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.204+0000 7fc3ec000640 1 --2- 172.21.15.6:0/3577732289 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3e40aab40 0x7fc3e40cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.204+0000 7fc3ec000640 1 -- 172.21.15.6:0/3577732289 >> 172.21.15.6:0/3577732289 conn(0x7fc3e4066e60 msgr2=0x7fc3e406a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.205+0000 7fc3ec000640 1 -- 172.21.15.6:0/3577732289 shutdown_connections 2024-08-17T02:27:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.205+0000 7fc3ec000640 1 -- 172.21.15.6:0/3577732289 wait complete. 2024-08-17T02:27:03.284 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:27:03.284 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:27:03.284 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.436+0000 7f4cac600640 1 Processor -- start 2024-08-17T02:27:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.436+0000 7f4cac600640 1 -- start start 2024-08-17T02:27:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.437+0000 7f4cac600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4ca40afca0 0x7f4ca40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.437+0000 7f4cac600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ca40acf10 0x7f4ca4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.437+0000 7f4cac600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca415a4e0 con 0x7f4ca41589a0 2024-08-17T02:27:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.437+0000 7f4cac600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca40b0980 con 0x7f4ca40afca0 2024-08-17T02:27:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.437+0000 7f4cac600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca40c92b0 con 0x7f4ca40acf10 2024-08-17T02:27:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.438+0000 7f4ca9c00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4ca40afca0 0x7f4ca40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.438+0000 7f4ca9c00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4ca40afca0 0x7f4ca40b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41062/0 (socket says 172.21.15.6:41062) 2024-08-17T02:27:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.438+0000 7f4ca9c00640 1 -- 172.21.15.6:0/1708725804 learned_addr learned my addr 172.21.15.6:0/1708725804 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.438+0000 7f4ca9200640 1 --2- 172.21.15.6:0/1708725804 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ca40acf10 0x7f4ca4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.438+0000 7f4ca9c00640 1 -- 172.21.15.6:0/1708725804 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ca40acf10 msgr2=0x7f4ca4159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.438+0000 7f4ca9c00640 1 --2- 172.21.15.6:0/1708725804 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ca40acf10 0x7f4ca4159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.438+0000 7f4ca9c00640 1 -- 172.21.15.6:0/1708725804 >> v1:172.21.15.136:6789/0 conn(0x7f4ca41589a0 legacy=0x7f4ca406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.438+0000 7f4ca9c00640 1 -- 172.21.15.6:0/1708725804 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca40ad480 con 0x7f4ca40afca0 2024-08-17T02:27:03.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.439+0000 7f4ca9c00640 1 --2- 172.21.15.6:0/1708725804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca40afca0 0x7f4ca40b0070 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009940 tx=0x7f4c980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c0b7737b980c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.439+0000 7f4ca3e00640 1 -- 172.21.15.6:0/1708725804 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9802ae40 con 0x7f4ca40afca0 2024-08-17T02:27:03.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.440+0000 7f4ca3e00640 1 -- 172.21.15.6:0/1708725804 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c98032440 con 0x7f4ca40afca0 2024-08-17T02:27:03.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.440+0000 7f4ca3e00640 1 -- 172.21.15.6:0/1708725804 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98032820 con 0x7f4ca40afca0 2024-08-17T02:27:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.440+0000 7f4cac600640 1 -- 172.21.15.6:0/1708725804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca40afca0 msgr2=0x7f4ca40b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.440+0000 7f4cac600640 1 --2- 172.21.15.6:0/1708725804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca40afca0 0x7f4ca40b0070 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009940 tx=0x7f4c980091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.440+0000 7f4cac600640 1 -- 172.21.15.6:0/1708725804 shutdown_connections 2024-08-17T02:27:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.440+0000 7f4cac600640 1 --2- 172.21.15.6:0/1708725804 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ca40acf10 0x7f4ca4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.440+0000 7f4cac600640 1 --2- 172.21.15.6:0/1708725804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca40afca0 0x7f4ca40b0070 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.440+0000 7f4cac600640 1 -- 172.21.15.6:0/1708725804 >> 172.21.15.6:0/1708725804 conn(0x7f4ca4066e60 msgr2=0x7f4ca4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.440+0000 7f4cac600640 1 -- 172.21.15.6:0/1708725804 shutdown_connections 2024-08-17T02:27:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.440+0000 7f4cac600640 1 -- 172.21.15.6:0/1708725804 wait complete. 2024-08-17T02:27:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.442+0000 7f4cac600640 1 Processor -- start 2024-08-17T02:27:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.442+0000 7f4cac600640 1 -- start start 2024-08-17T02:27:03.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4cac600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ca40acf10 0x7f4ca4140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4cac600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ca40afca0 0x7f4ca40c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4cac600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca41589a0 0x7f4ca40c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4cac600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca40c6130 con 0x7f4ca41589a0 2024-08-17T02:27:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4cac600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca40c2190 con 0x7f4ca40afca0 2024-08-17T02:27:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4cac600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca40c3780 con 0x7f4ca40acf10 2024-08-17T02:27:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4caa600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca41589a0 0x7f4ca40c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4caa600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca41589a0 0x7f4ca40c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41070/0 (socket says 172.21.15.6:41070) 2024-08-17T02:27:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4caa600640 1 -- 172.21.15.6:0/254120287 learned_addr learned my addr 172.21.15.6:0/254120287 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4ca9c00640 1 --2- 172.21.15.6:0/254120287 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ca40acf10 0x7f4ca4140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4caa600640 1 -- 172.21.15.6:0/254120287 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ca40acf10 msgr2=0x7f4ca4140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4ca9200640 1 --2- 172.21.15.6:0/254120287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ca40afca0 0x7f4ca40c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4caa600640 1 --2- 172.21.15.6:0/254120287 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ca40acf10 0x7f4ca4140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4caa600640 1 -- 172.21.15.6:0/254120287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ca40afca0 msgr2=0x7f4ca40c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4caa600640 1 --2- 172.21.15.6:0/254120287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ca40afca0 0x7f4ca40c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4caa600640 1 -- 172.21.15.6:0/254120287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c98009450 con 0x7f4ca41589a0 2024-08-17T02:27:03.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4ca9c00640 1 --2- 172.21.15.6:0/254120287 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ca40acf10 0x7f4ca4140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:03.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.443+0000 7f4ca9200640 1 --2- 172.21.15.6:0/254120287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ca40afca0 0x7f4ca40c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:03.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.444+0000 7f4caa600640 1 --2- 172.21.15.6:0/254120287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca41589a0 0x7f4ca40c5bf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00c7c0 tx=0x7f4c9c0015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.444+0000 7f4ca0c00640 1 -- 172.21.15.6:0/254120287 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c00a640 con 0x7f4ca41589a0 2024-08-17T02:27:03.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.444+0000 7f4ca0c00640 1 -- 172.21.15.6:0/254120287 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c00a7c0 con 0x7f4ca41589a0 2024-08-17T02:27:03.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.444+0000 7f4ca0c00640 1 -- 172.21.15.6:0/254120287 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c00ab80 con 0x7f4ca41589a0 2024-08-17T02:27:03.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.444+0000 7f4cac600640 1 -- 172.21.15.6:0/254120287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca40c2e50 con 0x7f4ca41589a0 2024-08-17T02:27:03.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.444+0000 7f4cac600640 1 -- 172.21.15.6:0/254120287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca40c3490 con 0x7f4ca41589a0 2024-08-17T02:27:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.445+0000 7f4cac600640 1 -- 172.21.15.6:0/254120287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca40c3930 con 0x7f4ca41589a0 2024-08-17T02:27:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.446+0000 7f4ca0c00640 1 -- 172.21.15.6:0/254120287 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4c9c003030 con 0x7f4ca41589a0 2024-08-17T02:27:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.447+0000 7f4ca0c00640 1 --2- 172.21.15.6:0/254120287 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4c84065150 0x7f4c84067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.447+0000 7f4ca0c00640 1 -- 172.21.15.6:0/254120287 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c9c082240 con 0x7f4ca41589a0 2024-08-17T02:27:03.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.447+0000 7f4ca9c00640 1 --2- 172.21.15.6:0/254120287 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4c84065150 0x7f4c84067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.448+0000 7f4ca9c00640 1 --2- 172.21.15.6:0/254120287 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4c84065150 0x7f4c84067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4c98034000 tx=0x7f4c98032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.451+0000 7f4ca0c00640 1 -- 172.21.15.6:0/254120287 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4ca40c3930 con 0x7f4ca41589a0 2024-08-17T02:27:03.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.634+0000 7f4cac600640 1 -- 172.21.15.6:0/254120287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ca415a4e0 con 0x7f4ca41589a0 2024-08-17T02:27:03.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.635+0000 7f4ca0c00640 1 -- 172.21.15.6:0/254120287 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f4ca415a4e0 con 0x7f4ca41589a0 2024-08-17T02:27:03.635 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:03.636 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:33.190571+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:29.257601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:30.596556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:03.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.637+0000 7f4cac600640 1 -- 172.21.15.6:0/254120287 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4c84065150 msgr2=0x7f4c84067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.637+0000 7f4cac600640 1 --2- 172.21.15.6:0/254120287 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4c84065150 0x7f4c84067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4c98034000 tx=0x7f4c98032000 comp rx=0 tx=0).stop 2024-08-17T02:27:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.637+0000 7f4cac600640 1 -- 172.21.15.6:0/254120287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca41589a0 msgr2=0x7f4ca40c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.637+0000 7f4cac600640 1 --2- 172.21.15.6:0/254120287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca41589a0 0x7f4ca40c5bf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00c7c0 tx=0x7f4c9c0015f0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.637+0000 7f4cac600640 1 -- 172.21.15.6:0/254120287 shutdown_connections 2024-08-17T02:27:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.637+0000 7f4cac600640 1 --2- 172.21.15.6:0/254120287 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4c84065150 0x7f4c84067600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.637+0000 7f4cac600640 1 --2- 172.21.15.6:0/254120287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca41589a0 0x7f4ca40c5bf0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.637+0000 7f4cac600640 1 --2- 172.21.15.6:0/254120287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ca40afca0 0x7f4ca40c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.637+0000 7f4cac600640 1 --2- 172.21.15.6:0/254120287 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4ca40acf10 0x7f4ca4140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.637+0000 7f4cac600640 1 -- 172.21.15.6:0/254120287 >> 172.21.15.6:0/254120287 conn(0x7f4ca4066e60 msgr2=0x7f4ca41572c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.637+0000 7f4cac600640 1 -- 172.21.15.6:0/254120287 shutdown_connections 2024-08-17T02:27:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.637+0000 7f4cac600640 1 -- 172.21.15.6:0/254120287 wait complete. 2024-08-17T02:27:03.653 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:25.463503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:29.257601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:30.596556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:03.653 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:03.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.806+0000 7f0a89a00640 1 Processor -- start 2024-08-17T02:27:03.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.806+0000 7f0a89a00640 1 -- start start 2024-08-17T02:27:03.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.808+0000 7f0a89a00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a84155e70 0x7f0a840ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.808+0000 7f0a89a00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a840abfb0 con 0x7f0a84156240 2024-08-17T02:27:03.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.808+0000 7f0a89a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a840ab3a0 con 0x7f0a8406e670 2024-08-17T02:27:03.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.808+0000 7f0a89a00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a840ab680 con 0x7f0a84155e70 2024-08-17T02:27:03.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.808+0000 7f0a83e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a84155e70 0x7f0a840ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.808+0000 7f0a83e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a84155e70 0x7f0a840ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41076/0 (socket says 172.21.15.6:41076) 2024-08-17T02:27:03.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.808+0000 7f0a83e00640 1 -- 172.21.15.6:0/565919543 learned_addr learned my addr 172.21.15.6:0/565919543 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:03.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.808+0000 7f0a83e00640 1 -- 172.21.15.6:0/565919543 >> v1:172.21.15.136:6789/0 conn(0x7f0a8406e670 legacy=0x7f0a840ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:03.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.808+0000 7f0a83e00640 1 -- 172.21.15.6:0/565919543 >> v1:172.21.15.6:6789/0 conn(0x7f0a84156240 legacy=0x7f0a8406df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.808+0000 7f0a83e00640 1 -- 172.21.15.6:0/565919543 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a840ab960 con 0x7f0a84155e70 2024-08-17T02:27:03.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.808+0000 7f0a83400640 1 -- 172.21.15.6:0/565919543 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988666073 0 0) 0x7f0a840abfb0 con 0x7f0a84156240 2024-08-17T02:27:03.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.809+0000 7f0a83e00640 1 --2- 172.21.15.6:0/565919543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a84155e70 0x7f0a840ad9b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009910 tx=0x7f0a740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5c20597730ddc4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.810+0000 7f0a83400640 1 -- 172.21.15.6:0/565919543 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7402ae60 con 0x7f0a84155e70 2024-08-17T02:27:03.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.810+0000 7f0a83400640 1 -- 172.21.15.6:0/565919543 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a74032440 con 0x7f0a84155e70 2024-08-17T02:27:03.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.810+0000 7f0a83400640 1 -- 172.21.15.6:0/565919543 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a740327e0 con 0x7f0a84155e70 2024-08-17T02:27:03.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.810+0000 7f0a89a00640 1 -- 172.21.15.6:0/565919543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a84155e70 msgr2=0x7f0a840ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.810+0000 7f0a89a00640 1 --2- 172.21.15.6:0/565919543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a84155e70 0x7f0a840ad9b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009910 tx=0x7f0a740091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.810+0000 7f0a89a00640 1 -- 172.21.15.6:0/565919543 shutdown_connections 2024-08-17T02:27:03.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.810+0000 7f0a89a00640 1 --2- 172.21.15.6:0/565919543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a84155e70 0x7f0a840ad9b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.810+0000 7f0a89a00640 1 -- 172.21.15.6:0/565919543 >> 172.21.15.6:0/565919543 conn(0x7f0a840cb770 msgr2=0x7f0a840cbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:03.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.810+0000 7f0a89a00640 1 -- 172.21.15.6:0/565919543 shutdown_connections 2024-08-17T02:27:03.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.810+0000 7f0a89a00640 1 -- 172.21.15.6:0/565919543 wait complete. 2024-08-17T02:27:03.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.812+0000 7f0a89a00640 1 Processor -- start 2024-08-17T02:27:03.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.812+0000 7f0a89a00640 1 -- start start 2024-08-17T02:27:03.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.813+0000 7f0a89a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a8406e670 0x7f0a84166260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.813+0000 7f0a89a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a84155e70 0x7f0a84146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.813+0000 7f0a89a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a84156240 0x7f0a841451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.813+0000 7f0a89a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a840c9c80 con 0x7f0a84155e70 2024-08-17T02:27:03.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.813+0000 7f0a89a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a84147430 con 0x7f0a8406e670 2024-08-17T02:27:03.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.813+0000 7f0a89a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a84147690 con 0x7f0a84156240 2024-08-17T02:27:03.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.813+0000 7f0a7b400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a84155e70 0x7f0a84146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.813+0000 7f0a7b400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a84155e70 0x7f0a84146ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41078/0 (socket says 172.21.15.6:41078) 2024-08-17T02:27:03.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.813+0000 7f0a7b400640 1 -- 172.21.15.6:0/244319904 learned_addr learned my addr 172.21.15.6:0/244319904 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:03.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.813+0000 7f0a83e00640 1 --2- 172.21.15.6:0/244319904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a8406e670 0x7f0a84166260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.813+0000 7f0a89000640 1 --2- 172.21.15.6:0/244319904 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a84156240 0x7f0a841451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.813+0000 7f0a7b400640 1 -- 172.21.15.6:0/244319904 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a84156240 msgr2=0x7f0a841451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.813+0000 7f0a7b400640 1 --2- 172.21.15.6:0/244319904 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a84156240 0x7f0a841451a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.813+0000 7f0a7b400640 1 -- 172.21.15.6:0/244319904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a8406e670 msgr2=0x7f0a84166260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.813+0000 7f0a7b400640 1 --2- 172.21.15.6:0/244319904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a8406e670 0x7f0a84166260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.813+0000 7f0a7b400640 1 -- 172.21.15.6:0/244319904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a74009450 con 0x7f0a84155e70 2024-08-17T02:27:03.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.814+0000 7f0a7b400640 1 --2- 172.21.15.6:0/244319904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a84155e70 0x7f0a84146ef0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00c4e0 tx=0x7f0a6c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.814+0000 7f0a7be00640 1 -- 172.21.15.6:0/244319904 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c011590 con 0x7f0a84155e70 2024-08-17T02:27:03.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.814+0000 7f0a7be00640 1 -- 172.21.15.6:0/244319904 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c0116f0 con 0x7f0a84155e70 2024-08-17T02:27:03.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.814+0000 7f0a7be00640 1 -- 172.21.15.6:0/244319904 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c011af0 con 0x7f0a84155e70 2024-08-17T02:27:03.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.814+0000 7f0a89a00640 1 -- 172.21.15.6:0/244319904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a84147970 con 0x7f0a84155e70 2024-08-17T02:27:03.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.814+0000 7f0a89a00640 1 -- 172.21.15.6:0/244319904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a840c9e90 con 0x7f0a84155e70 2024-08-17T02:27:03.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.815+0000 7f0a89a00640 1 -- 172.21.15.6:0/244319904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a840ca0e0 con 0x7f0a84155e70 2024-08-17T02:27:03.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.816+0000 7f0a7be00640 1 -- 172.21.15.6:0/244319904 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0a6c01b3b0 con 0x7f0a84155e70 2024-08-17T02:27:03.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.817+0000 7f0a7be00640 1 --2- 172.21.15.6:0/244319904 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0a60065150 0x7f0a60067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.817+0000 7f0a7be00640 1 -- 172.21.15.6:0/244319904 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a6c0818b0 con 0x7f0a84155e70 2024-08-17T02:27:03.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.817+0000 7f0a83e00640 1 --2- 172.21.15.6:0/244319904 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0a60065150 0x7f0a60067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.818+0000 7f0a83e00640 1 --2- 172.21.15.6:0/244319904 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0a60065150 0x7f0a60067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0a74034000 tx=0x7f0a74032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.820+0000 7f0a7be00640 1 -- 172.21.15.6:0/244319904 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0a6c04fa20 con 0x7f0a84155e70 2024-08-17T02:27:04.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:03.999+0000 7f0a89a00640 1 -- 172.21.15.6:0/244319904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a84070720 con 0x7f0a84155e70 2024-08-17T02:27:04.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.000+0000 7f0a7be00640 1 -- 172.21.15.6:0/244319904 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a6c017070 con 0x7f0a84155e70 2024-08-17T02:27:04.000 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-08-17T02:27:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.002+0000 7f0a89a00640 1 -- 172.21.15.6:0/244319904 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0a60065150 msgr2=0x7f0a60067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.002+0000 7f0a89a00640 1 --2- 172.21.15.6:0/244319904 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0a60065150 0x7f0a60067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0a74034000 tx=0x7f0a74032000 comp rx=0 tx=0).stop 2024-08-17T02:27:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.002+0000 7f0a89a00640 1 -- 172.21.15.6:0/244319904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a84155e70 msgr2=0x7f0a84146ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.002+0000 7f0a89a00640 1 --2- 172.21.15.6:0/244319904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a84155e70 0x7f0a84146ef0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00c4e0 tx=0x7f0a6c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.002+0000 7f0a89a00640 1 -- 172.21.15.6:0/244319904 shutdown_connections 2024-08-17T02:27:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.002+0000 7f0a89a00640 1 --2- 172.21.15.6:0/244319904 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0a60065150 0x7f0a60067600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.002+0000 7f0a89a00640 1 --2- 172.21.15.6:0/244319904 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a84156240 0x7f0a841451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.002+0000 7f0a89a00640 1 --2- 172.21.15.6:0/244319904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a84155e70 0x7f0a84146ef0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.002+0000 7f0a89a00640 1 --2- 172.21.15.6:0/244319904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a8406e670 0x7f0a84166260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.002+0000 7f0a89a00640 1 -- 172.21.15.6:0/244319904 >> 172.21.15.6:0/244319904 conn(0x7f0a840cb770 msgr2=0x7f0a8406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.002+0000 7f0a89a00640 1 -- 172.21.15.6:0/244319904 shutdown_connections 2024-08-17T02:27:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.002+0000 7f0a89a00640 1 -- 172.21.15.6:0/244319904 wait complete. 2024-08-17T02:27:04.017 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:04.077 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:04.081 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.172+0000 7f057ce00640 1 Processor -- start 2024-08-17T02:27:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.172+0000 7f057ce00640 1 -- start start 2024-08-17T02:27:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.173+0000 7f057ce00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05781589e0 0x7f0578158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.173+0000 7f057ce00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05780ca9c0 0x7f05780cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.173+0000 7f057ce00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05780af9a0 con 0x7f05780cda30 2024-08-17T02:27:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.173+0000 7f057ce00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05780af810 con 0x7f05781589e0 2024-08-17T02:27:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.173+0000 7f057ce00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05780cb310 con 0x7f05780ca9c0 2024-08-17T02:27:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.173+0000 7f0575e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05781589e0 0x7f0578158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.173+0000 7f0575e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05781589e0 0x7f0578158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41090/0 (socket says 172.21.15.6:41090) 2024-08-17T02:27:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.173+0000 7f0575e00640 1 -- 172.21.15.6:0/1256762447 learned_addr learned my addr 172.21.15.6:0/1256762447 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.174+0000 7f056fe00640 1 --2- 172.21.15.6:0/1256762447 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05780ca9c0 0x7f05780cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.174+0000 7f0575e00640 1 -- 172.21.15.6:0/1256762447 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05780ca9c0 msgr2=0x7f05780cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.174+0000 7f0575e00640 1 --2- 172.21.15.6:0/1256762447 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05780ca9c0 0x7f05780cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.174+0000 7f0575e00640 1 -- 172.21.15.6:0/1256762447 >> v1:172.21.15.136:6789/0 conn(0x7f05780cda30 legacy=0x7f05780cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.174+0000 7f0575e00640 1 -- 172.21.15.6:0/1256762447 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05780ce740 con 0x7f05781589e0 2024-08-17T02:27:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.174+0000 7f056fe00640 1 --2- 172.21.15.6:0/1256762447 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05780ca9c0 0x7f05780cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.175+0000 7f0575e00640 1 --2- 172.21.15.6:0/1256762447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05781589e0 0x7f0578158db0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0568009910 tx=0x7f05680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39b61626dc359fd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.175+0000 7f0575400640 1 -- 172.21.15.6:0/1256762447 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056802ae40 con 0x7f05781589e0 2024-08-17T02:27:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.175+0000 7f0575400640 1 -- 172.21.15.6:0/1256762447 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0568032440 con 0x7f05781589e0 2024-08-17T02:27:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.175+0000 7f0575400640 1 -- 172.21.15.6:0/1256762447 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568032820 con 0x7f05781589e0 2024-08-17T02:27:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.176+0000 7f057ce00640 1 -- 172.21.15.6:0/1256762447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05781589e0 msgr2=0x7f0578158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.176+0000 7f057ce00640 1 --2- 172.21.15.6:0/1256762447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05781589e0 0x7f0578158db0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0568009910 tx=0x7f05680091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.176+0000 7f057ce00640 1 -- 172.21.15.6:0/1256762447 shutdown_connections 2024-08-17T02:27:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.176+0000 7f057ce00640 1 --2- 172.21.15.6:0/1256762447 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05780ca9c0 0x7f05780cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.176+0000 7f057ce00640 1 --2- 172.21.15.6:0/1256762447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05781589e0 0x7f0578158db0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.176+0000 7f057ce00640 1 -- 172.21.15.6:0/1256762447 >> 172.21.15.6:0/1256762447 conn(0x7f057806e590 msgr2=0x7f057806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.176+0000 7f057ce00640 1 -- 172.21.15.6:0/1256762447 shutdown_connections 2024-08-17T02:27:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.176+0000 7f057ce00640 1 -- 172.21.15.6:0/1256762447 wait complete. 2024-08-17T02:27:04.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.177+0000 7f057ce00640 1 Processor -- start 2024-08-17T02:27:04.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.177+0000 7f057ce00640 1 -- start start 2024-08-17T02:27:04.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.178+0000 7f057ce00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05780ca9c0 0x7f05781488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.178+0000 7f057ce00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05780cda30 0x7f05780c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.178+0000 7f057ce00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05781589e0 0x7f05780c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.178+0000 7f057ce00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05780b2f70 con 0x7f05780cda30 2024-08-17T02:27:04.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.178+0000 7f057ce00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05780c8ec0 con 0x7f05780ca9c0 2024-08-17T02:27:04.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.178+0000 7f057ce00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057815b370 con 0x7f05781589e0 2024-08-17T02:27:04.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.178+0000 7f056fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05780cda30 0x7f05780c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.178+0000 7f056fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05780cda30 0x7f05780c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41102/0 (socket says 172.21.15.6:41102) 2024-08-17T02:27:04.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.178+0000 7f056fe00640 1 -- 172.21.15.6:0/4093132315 learned_addr learned my addr 172.21.15.6:0/4093132315 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:04.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.179+0000 7f0575e00640 1 --2- 172.21.15.6:0/4093132315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05780ca9c0 0x7f05781488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.179+0000 7f0576800640 1 --2- 172.21.15.6:0/4093132315 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05781589e0 0x7f05780c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.179+0000 7f056fe00640 1 -- 172.21.15.6:0/4093132315 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05781589e0 msgr2=0x7f05780c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.179+0000 7f056fe00640 1 --2- 172.21.15.6:0/4093132315 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05781589e0 0x7f05780c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.179+0000 7f056fe00640 1 -- 172.21.15.6:0/4093132315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05780ca9c0 msgr2=0x7f05781488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.179+0000 7f056fe00640 1 --2- 172.21.15.6:0/4093132315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05780ca9c0 0x7f05781488a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.179+0000 7f056fe00640 1 -- 172.21.15.6:0/4093132315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0568009450 con 0x7f05780cda30 2024-08-17T02:27:04.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.179+0000 7f0576800640 1 --2- 172.21.15.6:0/4093132315 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05781589e0 0x7f05780c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:04.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.179+0000 7f056fe00640 1 --2- 172.21.15.6:0/4093132315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05780cda30 0x7f05780c7780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f056000d860 tx=0x7f0560008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.179+0000 7f056d600640 1 -- 172.21.15.6:0/4093132315 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056000de50 con 0x7f05780cda30 2024-08-17T02:27:04.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.180+0000 7f056d600640 1 -- 172.21.15.6:0/4093132315 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056000b870 con 0x7f05780cda30 2024-08-17T02:27:04.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.180+0000 7f057ce00640 1 -- 172.21.15.6:0/4093132315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05780c8340 con 0x7f05780cda30 2024-08-17T02:27:04.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.180+0000 7f056d600640 1 -- 172.21.15.6:0/4093132315 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056000bc30 con 0x7f05780cda30 2024-08-17T02:27:04.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.180+0000 7f057ce00640 1 -- 172.21.15.6:0/4093132315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05780c8900 con 0x7f05780cda30 2024-08-17T02:27:04.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.181+0000 7f057ce00640 1 -- 172.21.15.6:0/4093132315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0578063fb0 con 0x7f05780cda30 2024-08-17T02:27:04.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.181+0000 7f056d600640 1 -- 172.21.15.6:0/4093132315 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f056001e460 con 0x7f05780cda30 2024-08-17T02:27:04.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.182+0000 7f056d600640 1 --2- 172.21.15.6:0/4093132315 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0554065150 0x7f0554067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.182+0000 7f056d600640 1 -- 172.21.15.6:0/4093132315 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0560082ae0 con 0x7f05780cda30 2024-08-17T02:27:04.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.183+0000 7f0575e00640 1 --2- 172.21.15.6:0/4093132315 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0554065150 0x7f0554067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.184+0000 7f0575e00640 1 --2- 172.21.15.6:0/4093132315 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0554065150 0x7f0554067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0568034000 tx=0x7f0568032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.187+0000 7f056d600640 1 -- 172.21.15.6:0/4093132315 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0560050b00 con 0x7f05780cda30 2024-08-17T02:27:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.373+0000 7f057ce00640 1 -- 172.21.15.6:0/4093132315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0578154f60 con 0x7f05780cda30 2024-08-17T02:27:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.374+0000 7f056d600640 1 -- 172.21.15.6:0/4093132315 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0560054120 con 0x7f05780cda30 2024-08-17T02:27:04.375 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-08-17T02:27:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.376+0000 7f057ce00640 1 -- 172.21.15.6:0/4093132315 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0554065150 msgr2=0x7f0554067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.376+0000 7f057ce00640 1 --2- 172.21.15.6:0/4093132315 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0554065150 0x7f0554067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0568034000 tx=0x7f0568032000 comp rx=0 tx=0).stop 2024-08-17T02:27:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.376+0000 7f057ce00640 1 -- 172.21.15.6:0/4093132315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05780cda30 msgr2=0x7f05780c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.376+0000 7f057ce00640 1 --2- 172.21.15.6:0/4093132315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05780cda30 0x7f05780c7780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f056000d860 tx=0x7f0560008040 comp rx=0 tx=0).stop 2024-08-17T02:27:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.376+0000 7f057ce00640 1 -- 172.21.15.6:0/4093132315 shutdown_connections 2024-08-17T02:27:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.376+0000 7f057ce00640 1 --2- 172.21.15.6:0/4093132315 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0554065150 0x7f0554067600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.376+0000 7f057ce00640 1 --2- 172.21.15.6:0/4093132315 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05781589e0 0x7f05780c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.376+0000 7f057ce00640 1 --2- 172.21.15.6:0/4093132315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05780cda30 0x7f05780c7780 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.376+0000 7f057ce00640 1 --2- 172.21.15.6:0/4093132315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05780ca9c0 0x7f05781488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.376+0000 7f057ce00640 1 -- 172.21.15.6:0/4093132315 >> 172.21.15.6:0/4093132315 conn(0x7f057806e590 msgr2=0x7f05781541e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.376+0000 7f057ce00640 1 -- 172.21.15.6:0/4093132315 shutdown_connections 2024-08-17T02:27:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.376+0000 7f057ce00640 1 -- 172.21.15.6:0/4093132315 wait complete. 2024-08-17T02:27:04.392 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:04.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.588+0000 7f65b1a00640 1 Processor -- start 2024-08-17T02:27:04.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.588+0000 7f65b1a00640 1 -- start start 2024-08-17T02:27:04.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.589+0000 7f65b1a00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f65ac0aea20 0x7f65ac0aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.589+0000 7f65b1a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65ac0ca8e0 0x7f65ac0cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.589+0000 7f65b1a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ac0af3a0 con 0x7f65ac158b90 2024-08-17T02:27:04.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.589+0000 7f65b1a00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ac0afd20 con 0x7f65ac0aea20 2024-08-17T02:27:04.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.589+0000 7f65b1a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac0affe0 con 0x7f65ac0ca8e0 2024-08-17T02:27:04.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.589+0000 7f65aa000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f65ac0aea20 0x7f65ac0aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.589+0000 7f65aa000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f65ac0aea20 0x7f65ac0aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41106/0 (socket says 172.21.15.6:41106) 2024-08-17T02:27:04.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.589+0000 7f65aa000640 1 -- 172.21.15.6:0/1909931504 learned_addr learned my addr 172.21.15.6:0/1909931504 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:04.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.589+0000 7f65ab400640 1 --2- 172.21.15.6:0/1909931504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65ac0ca8e0 0x7f65ac0cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.590+0000 7f65aa000640 1 -- 172.21.15.6:0/1909931504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65ac0ca8e0 msgr2=0x7f65ac0cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:04.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.590+0000 7f65a9600640 1 -- 172.21.15.6:0/1909931504 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169951313 0 0) 0x7f65ac0af3a0 con 0x7f65ac158b90 2024-08-17T02:27:04.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.590+0000 7f65aa000640 1 --2- 172.21.15.6:0/1909931504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65ac0ca8e0 0x7f65ac0cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.590+0000 7f65aa000640 1 -- 172.21.15.6:0/1909931504 >> v1:172.21.15.136:6789/0 conn(0x7f65ac158b90 legacy=0x7f65ac0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.590+0000 7f65aa000640 1 -- 172.21.15.6:0/1909931504 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac0b02c0 con 0x7f65ac0aea20 2024-08-17T02:27:04.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.591+0000 7f65aa000640 1 --2- 172.21.15.6:0/1909931504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ac0aea20 0x7f65ac0aee60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6598009910 tx=0x7f65980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4246892b41d265 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.591+0000 7f65a9600640 1 -- 172.21.15.6:0/1909931504 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659802ae40 con 0x7f65ac0aea20 2024-08-17T02:27:04.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.591+0000 7f65a9600640 1 -- 172.21.15.6:0/1909931504 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6598032440 con 0x7f65ac0aea20 2024-08-17T02:27:04.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.591+0000 7f65a9600640 1 -- 172.21.15.6:0/1909931504 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65980327e0 con 0x7f65ac0aea20 2024-08-17T02:27:04.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.592+0000 7f65b1a00640 1 -- 172.21.15.6:0/1909931504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ac0aea20 msgr2=0x7f65ac0aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.592+0000 7f65b1a00640 1 --2- 172.21.15.6:0/1909931504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ac0aea20 0x7f65ac0aee60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6598009910 tx=0x7f65980091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.592+0000 7f65b1a00640 1 -- 172.21.15.6:0/1909931504 shutdown_connections 2024-08-17T02:27:04.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.592+0000 7f65b1a00640 1 --2- 172.21.15.6:0/1909931504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65ac0ca8e0 0x7f65ac0cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.592+0000 7f65b1a00640 1 --2- 172.21.15.6:0/1909931504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ac0aea20 0x7f65ac0aee60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.592+0000 7f65b1a00640 1 -- 172.21.15.6:0/1909931504 >> 172.21.15.6:0/1909931504 conn(0x7f65ac06e590 msgr2=0x7f65ac06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:04.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.592+0000 7f65b1a00640 1 -- 172.21.15.6:0/1909931504 shutdown_connections 2024-08-17T02:27:04.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.592+0000 7f65b1a00640 1 -- 172.21.15.6:0/1909931504 wait complete. 2024-08-17T02:27:04.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.593+0000 7f65b1a00640 1 Processor -- start 2024-08-17T02:27:04.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.593+0000 7f65b1a00640 1 -- start start 2024-08-17T02:27:04.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.594+0000 7f65b1a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65ac0aea20 0x7f65ac158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.594+0000 7f65b1a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65ac0ca8e0 0x7f65ac159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.594+0000 7f65b1a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ac158b90 0x7f65ac169010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.594+0000 7f65b1a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac0c8e00 con 0x7f65ac158b90 2024-08-17T02:27:04.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.594+0000 7f65b1a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac0c8b20 con 0x7f65ac0ca8e0 2024-08-17T02:27:04.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.594+0000 7f65b1a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac159200 con 0x7f65ac0aea20 2024-08-17T02:27:04.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.594+0000 7f65ab400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ac158b90 0x7f65ac169010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.594+0000 7f65ab400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ac158b90 0x7f65ac169010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41116/0 (socket says 172.21.15.6:41116) 2024-08-17T02:27:04.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.594+0000 7f65ab400640 1 -- 172.21.15.6:0/1513711948 learned_addr learned my addr 172.21.15.6:0/1513711948 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:04.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.594+0000 7f65aaa00640 1 --2- 172.21.15.6:0/1513711948 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65ac0aea20 0x7f65ac158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.594+0000 7f65aa000640 1 --2- 172.21.15.6:0/1513711948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65ac0ca8e0 0x7f65ac159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.595+0000 7f65aaa00640 1 -- 172.21.15.6:0/1513711948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65ac0ca8e0 msgr2=0x7f65ac159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.595+0000 7f65aaa00640 1 --2- 172.21.15.6:0/1513711948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65ac0ca8e0 0x7f65ac159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.595+0000 7f65aaa00640 1 -- 172.21.15.6:0/1513711948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ac158b90 msgr2=0x7f65ac169010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.595+0000 7f65aaa00640 1 --2- 172.21.15.6:0/1513711948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ac158b90 0x7f65ac169010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.595+0000 7f65aaa00640 1 -- 172.21.15.6:0/1513711948 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6598009450 con 0x7f65ac0aea20 2024-08-17T02:27:04.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.595+0000 7f65ab400640 1 --2- 172.21.15.6:0/1513711948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ac158b90 0x7f65ac169010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:04.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.595+0000 7f65aaa00640 1 --2- 172.21.15.6:0/1513711948 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65ac0aea20 0x7f65ac158180 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f65ac066ff0 tx=0x7f659c007cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.595+0000 7f65a2000640 1 -- 172.21.15.6:0/1513711948 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c011590 con 0x7f65ac0aea20 2024-08-17T02:27:04.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.596+0000 7f65a2000640 1 -- 172.21.15.6:0/1513711948 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c0116f0 con 0x7f65ac0aea20 2024-08-17T02:27:04.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.596+0000 7f65a2000640 1 -- 172.21.15.6:0/1513711948 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c011ab0 con 0x7f65ac0aea20 2024-08-17T02:27:04.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.596+0000 7f65b1a00640 1 -- 172.21.15.6:0/1513711948 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ac1594e0 con 0x7f65ac0aea20 2024-08-17T02:27:04.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.596+0000 7f65b1a00640 1 -- 172.21.15.6:0/1513711948 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac1586c0 con 0x7f65ac0aea20 2024-08-17T02:27:04.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.597+0000 7f65b1a00640 1 -- 172.21.15.6:0/1513711948 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ac159060 con 0x7f65ac0aea20 2024-08-17T02:27:04.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.598+0000 7f65a2000640 1 -- 172.21.15.6:0/1513711948 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f659c01c460 con 0x7f65ac0aea20 2024-08-17T02:27:04.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.598+0000 7f65a2000640 1 --2- 172.21.15.6:0/1513711948 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f658c065150 0x7f658c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.599+0000 7f65a2000640 1 -- 172.21.15.6:0/1513711948 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f659c082090 con 0x7f65ac0aea20 2024-08-17T02:27:04.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.599+0000 7f65aa000640 1 --2- 172.21.15.6:0/1513711948 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f658c065150 0x7f658c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.600+0000 7f65aa000640 1 --2- 172.21.15.6:0/1513711948 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f658c065150 0x7f658c067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6598034000 tx=0x7f6598032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.603+0000 7f65a2000640 1 -- 172.21.15.6:0/1513711948 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f65ac159060 con 0x7f65ac0aea20 2024-08-17T02:27:04.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.784+0000 7f65b1a00640 1 -- 172.21.15.6:0/1513711948 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f65ac159060 con 0x7f65ac0aea20 2024-08-17T02:27:04.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.784+0000 7f65a2000640 1 -- 172.21.15.6:0/1513711948 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f65ac159060 con 0x7f65ac0aea20 2024-08-17T02:27:04.786 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-08-17T02:27:04.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.786+0000 7f65b1a00640 1 -- 172.21.15.6:0/1513711948 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f658c065150 msgr2=0x7f658c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.786+0000 7f65b1a00640 1 --2- 172.21.15.6:0/1513711948 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f658c065150 0x7f658c067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6598034000 tx=0x7f6598032000 comp rx=0 tx=0).stop 2024-08-17T02:27:04.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.787+0000 7f65b1a00640 1 -- 172.21.15.6:0/1513711948 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65ac0aea20 msgr2=0x7f65ac158180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.787+0000 7f65b1a00640 1 --2- 172.21.15.6:0/1513711948 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65ac0aea20 0x7f65ac158180 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f65ac066ff0 tx=0x7f659c007cc0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.787+0000 7f65b1a00640 1 -- 172.21.15.6:0/1513711948 shutdown_connections 2024-08-17T02:27:04.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.787+0000 7f65b1a00640 1 --2- 172.21.15.6:0/1513711948 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f658c065150 0x7f658c067600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.787+0000 7f65b1a00640 1 --2- 172.21.15.6:0/1513711948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ac158b90 0x7f65ac169010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.787+0000 7f65b1a00640 1 --2- 172.21.15.6:0/1513711948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65ac0ca8e0 0x7f65ac159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.787+0000 7f65b1a00640 1 --2- 172.21.15.6:0/1513711948 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65ac0aea20 0x7f65ac158180 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.787+0000 7f65b1a00640 1 -- 172.21.15.6:0/1513711948 >> 172.21.15.6:0/1513711948 conn(0x7f65ac06e590 msgr2=0x7f65ac0cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:04.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.787+0000 7f65b1a00640 1 -- 172.21.15.6:0/1513711948 shutdown_connections 2024-08-17T02:27:04.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.787+0000 7f65b1a00640 1 -- 172.21.15.6:0/1513711948 wait complete. 2024-08-17T02:27:04.803 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:27:04.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.954+0000 7f9eadc00640 1 Processor -- start 2024-08-17T02:27:04.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.954+0000 7f9eadc00640 1 -- start start 2024-08-17T02:27:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.956+0000 7f9eadc00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ea80afca0 0x7f9ea80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.956+0000 7f9eadc00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9ea80acf10 0x7f9ea8159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.956+0000 7f9eadc00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea815a4e0 con 0x7f9ea81589a0 2024-08-17T02:27:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.956+0000 7f9eadc00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea80b0980 con 0x7f9ea80acf10 2024-08-17T02:27:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.956+0000 7f9eadc00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80c92b0 con 0x7f9ea80afca0 2024-08-17T02:27:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.956+0000 7f9ea7400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9ea81589a0 0x7f9ea806d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47754/0 (socket says 172.21.15.6:47754) 2024-08-17T02:27:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.956+0000 7f9ea7400640 1 -- 172.21.15.6:0/3117620050 learned_addr learned my addr 172.21.15.6:0/3117620050 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.956+0000 7f9ea6a00640 1 --2- 172.21.15.6:0/3117620050 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ea80afca0 0x7f9ea80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.956+0000 7f9e9fe00640 1 --2- 172.21.15.6:0/3117620050 >> v2:172.21.15.136:3300/0 conn(0x7f9ea80acf10 0x7f9ea8159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.956+0000 7f9ea6000640 1 -- 172.21.15.6:0/3117620050 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520741402 0 0) 0x7f9ea0001490 con 0x7f9ea81589a0 2024-08-17T02:27:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.956+0000 7f9ea6000640 1 -- 172.21.15.6:0/3117620050 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e8c0034e0 con 0x7f9ea81589a0 2024-08-17T02:27:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.957+0000 7f9ea6a00640 1 -- 172.21.15.6:0/3117620050 >> v2:172.21.15.136:3300/0 conn(0x7f9ea80acf10 msgr2=0x7f9ea8159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.957+0000 7f9ea6a00640 1 --2- 172.21.15.6:0/3117620050 >> v2:172.21.15.136:3300/0 conn(0x7f9ea80acf10 0x7f9ea8159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.957+0000 7f9ea6000640 1 -- 172.21.15.6:0/3117620050 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 681646010 0 0) 0x7f9e8c0034e0 con 0x7f9ea81589a0 2024-08-17T02:27:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.957+0000 7f9ea6a00640 1 -- 172.21.15.6:0/3117620050 >> v1:172.21.15.6:6789/0 conn(0x7f9ea81589a0 legacy=0x7f9ea806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.957+0000 7f9ea6a00640 1 -- 172.21.15.6:0/3117620050 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea80ad480 con 0x7f9ea80afca0 2024-08-17T02:27:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.958+0000 7f9ea6a00640 1 --2- 172.21.15.6:0/3117620050 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ea80afca0 0x7f9ea80b0070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e9800bb20 tx=0x7f9e9800b3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dae2ae5744c9968 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.958+0000 7f9ea6000640 1 -- 172.21.15.6:0/3117620050 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0001980 con 0x7f9ea80afca0 2024-08-17T02:27:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.958+0000 7f9ea6000640 1 -- 172.21.15.6:0/3117620050 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e98035480 con 0x7f9ea80afca0 2024-08-17T02:27:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.958+0000 7f9ea6000640 1 -- 172.21.15.6:0/3117620050 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98035800 con 0x7f9ea80afca0 2024-08-17T02:27:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.959+0000 7f9eadc00640 1 -- 172.21.15.6:0/3117620050 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ea80afca0 msgr2=0x7f9ea80b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.959+0000 7f9eadc00640 1 --2- 172.21.15.6:0/3117620050 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ea80afca0 0x7f9ea80b0070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e9800bb20 tx=0x7f9e9800b3b0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.959+0000 7f9eadc00640 1 -- 172.21.15.6:0/3117620050 shutdown_connections 2024-08-17T02:27:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.959+0000 7f9eadc00640 1 --2- 172.21.15.6:0/3117620050 >> v2:172.21.15.136:3300/0 conn(0x7f9ea80acf10 0x7f9ea8159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.959+0000 7f9eadc00640 1 --2- 172.21.15.6:0/3117620050 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ea80afca0 0x7f9ea80b0070 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.959+0000 7f9eadc00640 1 -- 172.21.15.6:0/3117620050 >> 172.21.15.6:0/3117620050 conn(0x7f9ea8066e60 msgr2=0x7f9ea8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.959+0000 7f9eadc00640 1 -- 172.21.15.6:0/3117620050 shutdown_connections 2024-08-17T02:27:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.959+0000 7f9eadc00640 1 -- 172.21.15.6:0/3117620050 wait complete. 2024-08-17T02:27:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.960+0000 7f9eadc00640 1 Processor -- start 2024-08-17T02:27:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.961+0000 7f9eadc00640 1 -- start start 2024-08-17T02:27:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.961+0000 7f9eadc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ea80acf10 0x7f9ea8169b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.961+0000 7f9eadc00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ea80afca0 0x7f9ea8157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.961+0000 7f9eadc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ea81589a0 0x7f9ea80ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.961+0000 7f9eadc00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea8156730 con 0x7f9ea81589a0 2024-08-17T02:27:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.961+0000 7f9eadc00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80c6770 con 0x7f9ea80acf10 2024-08-17T02:27:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.961+0000 7f9eadc00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80c6a30 con 0x7f9ea80afca0 2024-08-17T02:27:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.962+0000 7f9ea7400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ea81589a0 0x7f9ea80ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.962+0000 7f9ea7400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ea81589a0 0x7f9ea80ca180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33504/0 (socket says 172.21.15.6:33504) 2024-08-17T02:27:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.962+0000 7f9e9fe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ea80afca0 0x7f9ea8157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.962+0000 7f9ea7400640 1 -- 172.21.15.6:0/1682491357 learned_addr learned my addr 172.21.15.6:0/1682491357 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.962+0000 7f9ea6a00640 1 --2- 172.21.15.6:0/1682491357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ea80acf10 0x7f9ea8169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.962+0000 7f9ea7400640 1 -- 172.21.15.6:0/1682491357 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ea80afca0 msgr2=0x7f9ea8157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.962+0000 7f9ea7400640 1 --2- 172.21.15.6:0/1682491357 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ea80afca0 0x7f9ea8157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.962+0000 7f9ea7400640 1 -- 172.21.15.6:0/1682491357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ea80acf10 msgr2=0x7f9ea8169b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.962+0000 7f9ea7400640 1 --2- 172.21.15.6:0/1682491357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ea80acf10 0x7f9ea8169b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.962+0000 7f9ea7400640 1 -- 172.21.15.6:0/1682491357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9800b630 con 0x7f9ea81589a0 2024-08-17T02:27:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.962+0000 7f9ea7400640 1 --2- 172.21.15.6:0/1682491357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ea81589a0 0x7f9ea80ca180 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000cb60 tx=0x7f9ea0007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.963+0000 7f9e9e000640 1 -- 172.21.15.6:0/1682491357 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0004d30 con 0x7f9ea81589a0 2024-08-17T02:27:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.963+0000 7f9e9e000640 1 -- 172.21.15.6:0/1682491357 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea0004e90 con 0x7f9ea81589a0 2024-08-17T02:27:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.963+0000 7f9eadc00640 1 -- 172.21.15.6:0/1682491357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea80c6d70 con 0x7f9ea81589a0 2024-08-17T02:27:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.963+0000 7f9e9e000640 1 -- 172.21.15.6:0/1682491357 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000a980 con 0x7f9ea81589a0 2024-08-17T02:27:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.963+0000 7f9eadc00640 1 -- 172.21.15.6:0/1682491357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea80c7340 con 0x7f9ea81589a0 2024-08-17T02:27:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.964+0000 7f9eadc00640 1 -- 172.21.15.6:0/1682491357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea80c6f50 con 0x7f9ea81589a0 2024-08-17T02:27:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.965+0000 7f9e9e000640 1 -- 172.21.15.6:0/1682491357 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9ea0007150 con 0x7f9ea81589a0 2024-08-17T02:27:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.965+0000 7f9e9e000640 1 --2- 172.21.15.6:0/1682491357 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9e84065150 0x7f9e84067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.966+0000 7f9e9e000640 1 -- 172.21.15.6:0/1682491357 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ea0081cb0 con 0x7f9ea81589a0 2024-08-17T02:27:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.966+0000 7f9ea6a00640 1 --2- 172.21.15.6:0/1682491357 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9e84065150 0x7f9e84067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.967+0000 7f9ea6a00640 1 --2- 172.21.15.6:0/1682491357 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9e84065150 0x7f9e84067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9e98037000 tx=0x7f9e9803a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:04.970+0000 7f9e9e000640 1 -- 172.21.15.6:0/1682491357 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9ea004ce40 con 0x7f9ea81589a0 2024-08-17T02:27:05.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.221+0000 7f9eadc00640 1 -- 172.21.15.6:0/1682491357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f9ea815a4e0 con 0x7f9ea81589a0 2024-08-17T02:27:05.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.505+0000 7f9e9e000640 1 -- 172.21.15.6:0/1682491357 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v51) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9ea815a4e0 con 0x7f9ea81589a0 2024-08-17T02:27:05.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.507+0000 7f9eadc00640 1 -- 172.21.15.6:0/1682491357 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9e84065150 msgr2=0x7f9e84067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.507+0000 7f9eadc00640 1 --2- 172.21.15.6:0/1682491357 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9e84065150 0x7f9e84067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9e98037000 tx=0x7f9e9803a000 comp rx=0 tx=0).stop 2024-08-17T02:27:05.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.507+0000 7f9eadc00640 1 -- 172.21.15.6:0/1682491357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ea81589a0 msgr2=0x7f9ea80ca180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.507+0000 7f9eadc00640 1 --2- 172.21.15.6:0/1682491357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ea81589a0 0x7f9ea80ca180 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000cb60 tx=0x7f9ea0007b50 comp rx=0 tx=0).stop 2024-08-17T02:27:05.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.507+0000 7f9eadc00640 1 -- 172.21.15.6:0/1682491357 shutdown_connections 2024-08-17T02:27:05.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.507+0000 7f9eadc00640 1 --2- 172.21.15.6:0/1682491357 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9e84065150 0x7f9e84067600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.507+0000 7f9eadc00640 1 --2- 172.21.15.6:0/1682491357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ea81589a0 0x7f9ea80ca180 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.507+0000 7f9eadc00640 1 --2- 172.21.15.6:0/1682491357 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ea80afca0 0x7f9ea8157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.507+0000 7f9eadc00640 1 --2- 172.21.15.6:0/1682491357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ea80acf10 0x7f9ea8169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.507+0000 7f9eadc00640 1 -- 172.21.15.6:0/1682491357 >> 172.21.15.6:0/1682491357 conn(0x7f9ea8066e60 msgr2=0x7f9ea8151080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:05.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.507+0000 7f9eadc00640 1 -- 172.21.15.6:0/1682491357 shutdown_connections 2024-08-17T02:27:05.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.507+0000 7f9eadc00640 1 -- 172.21.15.6:0/1682491357 wait complete. 2024-08-17T02:27:05.523 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:27:05.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.677+0000 7f1df8600640 1 Processor -- start 2024-08-17T02:27:05.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.677+0000 7f1df8600640 1 -- start start 2024-08-17T02:27:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.678+0000 7f1df8600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1df00ad960 0x7f1df015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.678+0000 7f1df8600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1df00add30 0x7f1df0156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.678+0000 7f1df8600640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df015b5e0 con 0x7f1df00ca050 2024-08-17T02:27:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.678+0000 7f1df8600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df00cb160 con 0x7f1df00ad960 2024-08-17T02:27:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.678+0000 7f1df8600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df00b0d10 con 0x7f1df00add30 2024-08-17T02:27:05.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.678+0000 7f1df5200640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1df00ca050 0x7f1df0156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47770/0 (socket says 172.21.15.6:47770) 2024-08-17T02:27:05.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.678+0000 7f1df5200640 1 -- 172.21.15.6:0/4220424360 learned_addr learned my addr 172.21.15.6:0/4220424360 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:05.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.679+0000 7f1df6600640 1 --2- 172.21.15.6:0/4220424360 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1df00add30 0x7f1df0156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.679+0000 7f1df5c00640 1 --2- 172.21.15.6:0/4220424360 >> v2:172.21.15.136:3300/0 conn(0x7f1df00ad960 0x7f1df015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.679+0000 7f1defe00640 1 -- 172.21.15.6:0/4220424360 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336902597 0 0) 0x7f1ddc001110 con 0x7f1df00ca050 2024-08-17T02:27:05.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.679+0000 7f1defe00640 1 -- 172.21.15.6:0/4220424360 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dd80034e0 con 0x7f1df00ca050 2024-08-17T02:27:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.679+0000 7f1defe00640 1 -- 172.21.15.6:0/4220424360 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3730957005 0 0) 0x7f1dd80034e0 con 0x7f1df00ca050 2024-08-17T02:27:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.679+0000 7f1df6600640 1 -- 172.21.15.6:0/4220424360 >> v2:172.21.15.136:3300/0 conn(0x7f1df00ad960 msgr2=0x7f1df015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.679+0000 7f1df6600640 1 --2- 172.21.15.6:0/4220424360 >> v2:172.21.15.136:3300/0 conn(0x7f1df00ad960 0x7f1df015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.679+0000 7f1df6600640 1 -- 172.21.15.6:0/4220424360 >> v1:172.21.15.6:6789/0 conn(0x7f1df00ca050 legacy=0x7f1df0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.679+0000 7f1df6600640 1 -- 172.21.15.6:0/4220424360 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df00ca550 con 0x7f1df00add30 2024-08-17T02:27:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.680+0000 7f1df6600640 1 --2- 172.21.15.6:0/4220424360 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1df00add30 0x7f1df0156b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1de8009e60 tx=0x7f1de8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc0689ee327bb880 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.680+0000 7f1defe00640 1 -- 172.21.15.6:0/4220424360 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc001600 con 0x7f1df00add30 2024-08-17T02:27:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.681+0000 7f1defe00640 1 -- 172.21.15.6:0/4220424360 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de802d050 con 0x7f1df00add30 2024-08-17T02:27:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.681+0000 7f1defe00640 1 -- 172.21.15.6:0/4220424360 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8031630 con 0x7f1df00add30 2024-08-17T02:27:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.681+0000 7f1df8600640 1 -- 172.21.15.6:0/4220424360 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1df00add30 msgr2=0x7f1df0156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.681+0000 7f1df8600640 1 --2- 172.21.15.6:0/4220424360 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1df00add30 0x7f1df0156b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1de8009e60 tx=0x7f1de8009780 comp rx=0 tx=0).stop 2024-08-17T02:27:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.681+0000 7f1df8600640 1 -- 172.21.15.6:0/4220424360 shutdown_connections 2024-08-17T02:27:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.681+0000 7f1df8600640 1 --2- 172.21.15.6:0/4220424360 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1df00add30 0x7f1df0156b30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.681+0000 7f1df8600640 1 --2- 172.21.15.6:0/4220424360 >> v2:172.21.15.136:3300/0 conn(0x7f1df00ad960 0x7f1df015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.681+0000 7f1df8600640 1 -- 172.21.15.6:0/4220424360 >> 172.21.15.6:0/4220424360 conn(0x7f1df0066e60 msgr2=0x7f1df0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.681+0000 7f1df8600640 1 -- 172.21.15.6:0/4220424360 shutdown_connections 2024-08-17T02:27:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.681+0000 7f1df8600640 1 -- 172.21.15.6:0/4220424360 wait complete. 2024-08-17T02:27:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.683+0000 7f1df8600640 1 Processor -- start 2024-08-17T02:27:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.683+0000 7f1df8600640 1 -- start start 2024-08-17T02:27:05.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.683+0000 7f1df8600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1df00ad960 0x7f1df00a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.684+0000 7f1df8600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1df00add30 0x7f1df00af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.684+0000 7f1df8600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1df00ca050 0x7f1df00af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.684+0000 7f1df8600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df006b850 con 0x7f1df00ca050 2024-08-17T02:27:05.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.684+0000 7f1df8600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df0157770 con 0x7f1df00add30 2024-08-17T02:27:05.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.684+0000 7f1df8600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df006afb0 con 0x7f1df00ad960 2024-08-17T02:27:05.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.684+0000 7f1df6600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1df00ca050 0x7f1df00af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.684+0000 7f1df6600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1df00ca050 0x7f1df00af9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33508/0 (socket says 172.21.15.6:33508) 2024-08-17T02:27:05.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.684+0000 7f1df6600640 1 -- 172.21.15.6:0/7488435 learned_addr learned my addr 172.21.15.6:0/7488435 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:05.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.684+0000 7f1df5c00640 1 --2- 172.21.15.6:0/7488435 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1df00ad960 0x7f1df00a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.684+0000 7f1df5200640 1 --2- 172.21.15.6:0/7488435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1df00add30 0x7f1df00af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.684+0000 7f1df6600640 1 -- 172.21.15.6:0/7488435 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1df00ad960 msgr2=0x7f1df00a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.684+0000 7f1df6600640 1 --2- 172.21.15.6:0/7488435 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1df00ad960 0x7f1df00a9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.684+0000 7f1df6600640 1 -- 172.21.15.6:0/7488435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1df00add30 msgr2=0x7f1df00af460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.684+0000 7f1df6600640 1 --2- 172.21.15.6:0/7488435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1df00add30 0x7f1df00af460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.684+0000 7f1df6600640 1 -- 172.21.15.6:0/7488435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de8009a20 con 0x7f1df00ca050 2024-08-17T02:27:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.684+0000 7f1df6600640 1 --2- 172.21.15.6:0/7488435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1df00ca050 0x7f1df00af9a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1de80099f0 tx=0x7f1de8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.685+0000 7f1decc00640 1 -- 172.21.15.6:0/7488435 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de803ba70 con 0x7f1df00ca050 2024-08-17T02:27:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.685+0000 7f1decc00640 1 -- 172.21.15.6:0/7488435 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de8040070 con 0x7f1df00ca050 2024-08-17T02:27:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.685+0000 7f1decc00640 1 -- 172.21.15.6:0/7488435 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de803be60 con 0x7f1df00ca050 2024-08-17T02:27:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.685+0000 7f1df8600640 1 -- 172.21.15.6:0/7488435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df006b290 con 0x7f1df00ca050 2024-08-17T02:27:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.685+0000 7f1df8600640 1 -- 172.21.15.6:0/7488435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df0157a10 con 0x7f1df00ca050 2024-08-17T02:27:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.686+0000 7f1df8600640 1 -- 172.21.15.6:0/7488435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df0157c00 con 0x7f1df00ca050 2024-08-17T02:27:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.687+0000 7f1decc00640 1 -- 172.21.15.6:0/7488435 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1de8046640 con 0x7f1df00ca050 2024-08-17T02:27:05.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.687+0000 7f1decc00640 1 --2- 172.21.15.6:0/7488435 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1dd0065150 0x7f1dd0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.688+0000 7f1decc00640 1 -- 172.21.15.6:0/7488435 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1de8042070 con 0x7f1df00ca050 2024-08-17T02:27:05.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.688+0000 7f1df5c00640 1 --2- 172.21.15.6:0/7488435 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1dd0065150 0x7f1dd0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.688+0000 7f1df5c00640 1 --2- 172.21.15.6:0/7488435 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1dd0065150 0x7f1dd0067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009cb0 tx=0x7f1de4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:05.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.692+0000 7f1decc00640 1 -- 172.21.15.6:0/7488435 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1de8071420 con 0x7f1df00ca050 2024-08-17T02:27:05.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.878+0000 7f1df8600640 1 -- 172.21.15.6:0/7488435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1df0063fb0 con 0x7f1df00ca050 2024-08-17T02:27:05.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.882+0000 7f1decc00640 1 -- 172.21.15.6:0/7488435 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1de8074a40 con 0x7f1df00ca050 2024-08-17T02:27:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.884+0000 7f1df8600640 1 -- 172.21.15.6:0/7488435 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1dd0065150 msgr2=0x7f1dd0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.884+0000 7f1df8600640 1 --2- 172.21.15.6:0/7488435 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1dd0065150 0x7f1dd0067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009cb0 tx=0x7f1de4008040 comp rx=0 tx=0).stop 2024-08-17T02:27:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.884+0000 7f1df8600640 1 -- 172.21.15.6:0/7488435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1df00ca050 msgr2=0x7f1df00af9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.884+0000 7f1df8600640 1 --2- 172.21.15.6:0/7488435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1df00ca050 0x7f1df00af9a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1de80099f0 tx=0x7f1de8037000 comp rx=0 tx=0).stop 2024-08-17T02:27:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.885+0000 7f1df8600640 1 -- 172.21.15.6:0/7488435 shutdown_connections 2024-08-17T02:27:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.885+0000 7f1df8600640 1 --2- 172.21.15.6:0/7488435 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1dd0065150 0x7f1dd0067600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.885+0000 7f1df8600640 1 --2- 172.21.15.6:0/7488435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1df00ca050 0x7f1df00af9a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.885+0000 7f1df8600640 1 --2- 172.21.15.6:0/7488435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1df00add30 0x7f1df00af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.885+0000 7f1df8600640 1 --2- 172.21.15.6:0/7488435 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1df00ad960 0x7f1df00a9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.885+0000 7f1df8600640 1 -- 172.21.15.6:0/7488435 >> 172.21.15.6:0/7488435 conn(0x7f1df0066e60 msgr2=0x7f1df01561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.885+0000 7f1df8600640 1 -- 172.21.15.6:0/7488435 shutdown_connections 2024-08-17T02:27:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:05.885+0000 7f1df8600640 1 -- 172.21.15.6:0/7488435 wait complete. 2024-08-17T02:27:05.900 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:27:05.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:27:05.992 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:27:06.090 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:27:06.090 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:27:06.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:06.091 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-17T02:27:06.153 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-08-17T02:27:06.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:06.153 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:27:06.207 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:27:06.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:06.208 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-08-17T02:27:06.269 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2024-08-17T02:27:06.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:06.270 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:27:06.324 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-08-17T02:27:06.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:06.324 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-08-17T02:27:06.383 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-08-17T02:27:06.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:06.384 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:27:06.419 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-08-17T02:27:06.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:06.420 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-08-17T02:27:06.479 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2024-08-17T02:27:06.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:06.479 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:27:06.515 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:27:06.515 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:06.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.666+0000 7fe73c000640 1 Processor -- start 2024-08-17T02:27:06.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.666+0000 7fe73c000640 1 -- start start 2024-08-17T02:27:06.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.667+0000 7fe73c000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe734158f20 0x7fe734062f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.667+0000 7fe73c000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe73415a950 0x7fe7340a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.667+0000 7fe73c000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7340a9a90 con 0x7fe7340a9630 2024-08-17T02:27:06.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.668+0000 7fe73c000640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe734067510 con 0x7fe73415a950 2024-08-17T02:27:06.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.668+0000 7fe73c000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe734066f00 con 0x7fe734158f20 2024-08-17T02:27:06.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.668+0000 7fe738c00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe73415a950 0x7fe7340a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.668+0000 7fe738c00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe73415a950 0x7fe7340a90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33512/0 (socket says 172.21.15.6:33512) 2024-08-17T02:27:06.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.668+0000 7fe738c00640 1 -- 172.21.15.6:0/3927653022 learned_addr learned my addr 172.21.15.6:0/3927653022 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:06.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.668+0000 7fe739600640 1 --2- 172.21.15.6:0/3927653022 >> v2:172.21.15.136:3300/0 conn(0x7fe734158f20 0x7fe734062f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.668+0000 7fe738c00640 1 -- 172.21.15.6:0/3927653022 >> v2:172.21.15.136:3300/0 conn(0x7fe734158f20 msgr2=0x7fe734062f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:06.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.668+0000 7fe738c00640 1 --2- 172.21.15.6:0/3927653022 >> v2:172.21.15.136:3300/0 conn(0x7fe734158f20 0x7fe734062f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.668+0000 7fe738c00640 1 -- 172.21.15.6:0/3927653022 >> v1:172.21.15.136:6789/0 conn(0x7fe7340a9630 legacy=0x7fe7340679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.668+0000 7fe738c00640 1 -- 172.21.15.6:0/3927653022 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7340ccda0 con 0x7fe73415a950 2024-08-17T02:27:06.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.669+0000 7fe738c00640 1 --2- 172.21.15.6:0/3927653022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe73415a950 0x7fe7340a90f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe734066dc0 tx=0x7fe7200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b889b2484e0b6cf0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.670+0000 7fe733e00640 1 -- 172.21.15.6:0/3927653022 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72002ae80 con 0x7fe73415a950 2024-08-17T02:27:06.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.670+0000 7fe733e00640 1 -- 172.21.15.6:0/3927653022 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe720032440 con 0x7fe73415a950 2024-08-17T02:27:06.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.670+0000 7fe733e00640 1 -- 172.21.15.6:0/3927653022 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe720032800 con 0x7fe73415a950 2024-08-17T02:27:06.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.670+0000 7fe73c000640 1 -- 172.21.15.6:0/3927653022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe73415a950 msgr2=0x7fe7340a90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.670+0000 7fe73c000640 1 --2- 172.21.15.6:0/3927653022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe73415a950 0x7fe7340a90f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe734066dc0 tx=0x7fe7200091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.670+0000 7fe73c000640 1 -- 172.21.15.6:0/3927653022 shutdown_connections 2024-08-17T02:27:06.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.670+0000 7fe73c000640 1 --2- 172.21.15.6:0/3927653022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe73415a950 0x7fe7340a90f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.670+0000 7fe73c000640 1 --2- 172.21.15.6:0/3927653022 >> v2:172.21.15.136:3300/0 conn(0x7fe734158f20 0x7fe734062f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.670+0000 7fe73c000640 1 -- 172.21.15.6:0/3927653022 >> 172.21.15.6:0/3927653022 conn(0x7fe73406e5b0 msgr2=0x7fe7340b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.670+0000 7fe73c000640 1 -- 172.21.15.6:0/3927653022 shutdown_connections 2024-08-17T02:27:06.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.670+0000 7fe73c000640 1 -- 172.21.15.6:0/3927653022 wait complete. 2024-08-17T02:27:06.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.672+0000 7fe73c000640 1 Processor -- start 2024-08-17T02:27:06.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.672+0000 7fe73c000640 1 -- start start 2024-08-17T02:27:06.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.673+0000 7fe73c000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe7340a9630 0x7fe7341560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.673+0000 7fe73c000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe734158f20 0x7fe7340ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.673+0000 7fe73c000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe73415a950 0x7fe7340ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.673+0000 7fe73c000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe734099820 con 0x7fe73415a950 2024-08-17T02:27:06.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.673+0000 7fe73c000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7341694b0 con 0x7fe734158f20 2024-08-17T02:27:06.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.673+0000 7fe73c000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe734098f80 con 0x7fe7340a9630 2024-08-17T02:27:06.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.673+0000 7fe73a000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe73415a950 0x7fe7340ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.673+0000 7fe739600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe7340a9630 0x7fe7341560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.673+0000 7fe73a000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe73415a950 0x7fe7340ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33526/0 (socket says 172.21.15.6:33526) 2024-08-17T02:27:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.673+0000 7fe738c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe734158f20 0x7fe7340ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.673+0000 7fe73a000640 1 -- 172.21.15.6:0/2439937944 learned_addr learned my addr 172.21.15.6:0/2439937944 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.673+0000 7fe73a000640 1 -- 172.21.15.6:0/2439937944 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe7340a9630 msgr2=0x7fe7341560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.673+0000 7fe73a000640 1 --2- 172.21.15.6:0/2439937944 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe7340a9630 0x7fe7341560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.674+0000 7fe73a000640 1 -- 172.21.15.6:0/2439937944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe734158f20 msgr2=0x7fe7340ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.674+0000 7fe73a000640 1 --2- 172.21.15.6:0/2439937944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe734158f20 0x7fe7340ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.674+0000 7fe73a000640 1 -- 172.21.15.6:0/2439937944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe720009450 con 0x7fe73415a950 2024-08-17T02:27:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.674+0000 7fe73a000640 1 --2- 172.21.15.6:0/2439937944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe73415a950 0x7fe7340ae8c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00c870 tx=0x7fe72c001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.674+0000 7fe730c00640 1 -- 172.21.15.6:0/2439937944 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c00ce60 con 0x7fe73415a950 2024-08-17T02:27:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.674+0000 7fe730c00640 1 -- 172.21.15.6:0/2439937944 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c006b10 con 0x7fe73415a950 2024-08-17T02:27:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.674+0000 7fe730c00640 1 -- 172.21.15.6:0/2439937944 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c00a850 con 0x7fe73415a950 2024-08-17T02:27:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.674+0000 7fe73c000640 1 -- 172.21.15.6:0/2439937944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe734099260 con 0x7fe73415a950 2024-08-17T02:27:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.674+0000 7fe73c000640 1 -- 172.21.15.6:0/2439937944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe734156630 con 0x7fe73415a950 2024-08-17T02:27:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.675+0000 7fe73c000640 1 -- 172.21.15.6:0/2439937944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe734169280 con 0x7fe73415a950 2024-08-17T02:27:06.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.676+0000 7fe730c00640 1 -- 172.21.15.6:0/2439937944 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe72c00ac80 con 0x7fe73415a950 2024-08-17T02:27:06.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.677+0000 7fe730c00640 1 --2- 172.21.15.6:0/2439937944 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe714065150 0x7fe714067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.677+0000 7fe730c00640 1 -- 172.21.15.6:0/2439937944 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe72c081ff0 con 0x7fe73415a950 2024-08-17T02:27:06.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.677+0000 7fe739600640 1 --2- 172.21.15.6:0/2439937944 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe714065150 0x7fe714067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.678+0000 7fe739600640 1 --2- 172.21.15.6:0/2439937944 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe714065150 0x7fe714067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe728009d20 tx=0x7fe7280090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.681+0000 7fe730c00640 1 -- 172.21.15.6:0/2439937944 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe734169280 con 0x7fe73415a950 2024-08-17T02:27:06.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.899+0000 7fe73c000640 1 -- 172.21.15.6:0/2439937944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7340a9a90 con 0x7fe73415a950 2024-08-17T02:27:06.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.900+0000 7fe730c00640 1 -- 172.21.15.6:0/2439937944 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4582 (secure 0 0 0) 0x7fe7340a9a90 con 0x7fe73415a950 2024-08-17T02:27:06.901 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:06.901 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/881817227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":881817227},{"type":"v1","addr":"172.21.15.6:6833","nonce":881817227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/546855411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":546855411},{"type":"v1","addr":"172.21.15.6:6835","nonce":546855411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/539185499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":539185499},{"type":"v1","addr":"172.21.15.136:6837","nonce":539185499}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:31.615645+0000","modified":"2024-08-17T02:26:35.207397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/2230598578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2230598578},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230598578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:06.901 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2024-08-17T02:27:06.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.902+0000 7fe73c000640 1 -- 172.21.15.6:0/2439937944 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe714065150 msgr2=0x7fe714067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.902+0000 7fe73c000640 1 --2- 172.21.15.6:0/2439937944 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe714065150 0x7fe714067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe728009d20 tx=0x7fe7280090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.902+0000 7fe73c000640 1 -- 172.21.15.6:0/2439937944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe73415a950 msgr2=0x7fe7340ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.902+0000 7fe73c000640 1 --2- 172.21.15.6:0/2439937944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe73415a950 0x7fe7340ae8c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00c870 tx=0x7fe72c001690 comp rx=0 tx=0).stop 2024-08-17T02:27:06.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.902+0000 7fe73c000640 1 -- 172.21.15.6:0/2439937944 shutdown_connections 2024-08-17T02:27:06.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.902+0000 7fe73c000640 1 --2- 172.21.15.6:0/2439937944 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe714065150 0x7fe714067600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.902+0000 7fe73c000640 1 --2- 172.21.15.6:0/2439937944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe73415a950 0x7fe7340ae8c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.902+0000 7fe73c000640 1 --2- 172.21.15.6:0/2439937944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe734158f20 0x7fe7340ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.902+0000 7fe73c000640 1 --2- 172.21.15.6:0/2439937944 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe7340a9630 0x7fe7341560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.902+0000 7fe73c000640 1 -- 172.21.15.6:0/2439937944 >> 172.21.15.6:0/2439937944 conn(0x7fe73406e5b0 msgr2=0x7fe7340676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.902+0000 7fe73c000640 1 -- 172.21.15.6:0/2439937944 shutdown_connections 2024-08-17T02:27:06.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:06.902+0000 7fe73c000640 1 -- 172.21.15.6:0/2439937944 wait complete. 2024-08-17T02:27:06.918 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:07.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.068+0000 7f4c1ce00640 1 Processor -- start 2024-08-17T02:27:07.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.068+0000 7f4c1ce00640 1 -- start start 2024-08-17T02:27:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.069+0000 7f4c1ce00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4c180acf10 0x7f4c180b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.069+0000 7f4c1ce00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c180c92b0 con 0x7f4c181590b0 2024-08-17T02:27:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.069+0000 7f4c1ce00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c180ad480 con 0x7f4c180afca0 2024-08-17T02:27:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.069+0000 7f4c1ce00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c180b0980 con 0x7f4c180acf10 2024-08-17T02:27:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.069+0000 7f4c15400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4c181590b0 0x7f4c180c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47772/0 (socket says 172.21.15.6:47772) 2024-08-17T02:27:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.069+0000 7f4c15400640 1 -- 172.21.15.6:0/2622355764 learned_addr learned my addr 172.21.15.6:0/2622355764 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.069+0000 7f4c16800640 1 --2- 172.21.15.6:0/2622355764 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4c180acf10 0x7f4c180b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.070+0000 7f4c14a00640 1 -- 172.21.15.6:0/2622355764 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348467758 0 0) 0x7f4c180c92b0 con 0x7f4c181590b0 2024-08-17T02:27:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.070+0000 7f4c16800640 1 -- 172.21.15.6:0/2622355764 >> v1:172.21.15.136:6789/0 conn(0x7f4c180afca0 legacy=0x7f4c181589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.070+0000 7f4c16800640 1 -- 172.21.15.6:0/2622355764 >> v1:172.21.15.6:6789/0 conn(0x7f4c181590b0 legacy=0x7f4c180c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.070+0000 7f4c16800640 1 -- 172.21.15.6:0/2622355764 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c180ad760 con 0x7f4c180acf10 2024-08-17T02:27:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.071+0000 7f4c16800640 1 --2- 172.21.15.6:0/2622355764 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4c180acf10 0x7f4c180b0070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009e10 tx=0x7f4c10009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=171cd053ecef8da4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.071+0000 7f4c14a00640 1 -- 172.21.15.6:0/2622355764 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10007550 con 0x7f4c180acf10 2024-08-17T02:27:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.071+0000 7f4c14a00640 1 -- 172.21.15.6:0/2622355764 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1002d050 con 0x7f4c180acf10 2024-08-17T02:27:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.071+0000 7f4c14a00640 1 -- 172.21.15.6:0/2622355764 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c100078e0 con 0x7f4c180acf10 2024-08-17T02:27:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.072+0000 7f4c1ce00640 1 -- 172.21.15.6:0/2622355764 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4c180acf10 msgr2=0x7f4c180b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.072+0000 7f4c1ce00640 1 --2- 172.21.15.6:0/2622355764 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4c180acf10 0x7f4c180b0070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009e10 tx=0x7f4c10009780 comp rx=0 tx=0).stop 2024-08-17T02:27:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.072+0000 7f4c1ce00640 1 -- 172.21.15.6:0/2622355764 shutdown_connections 2024-08-17T02:27:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.072+0000 7f4c1ce00640 1 --2- 172.21.15.6:0/2622355764 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4c180acf10 0x7f4c180b0070 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.072+0000 7f4c1ce00640 1 -- 172.21.15.6:0/2622355764 >> 172.21.15.6:0/2622355764 conn(0x7f4c18066e60 msgr2=0x7f4c18067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.072+0000 7f4c1ce00640 1 -- 172.21.15.6:0/2622355764 shutdown_connections 2024-08-17T02:27:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.072+0000 7f4c1ce00640 1 -- 172.21.15.6:0/2622355764 wait complete. 2024-08-17T02:27:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.074+0000 7f4c1ce00640 1 Processor -- start 2024-08-17T02:27:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.074+0000 7f4c1ce00640 1 -- start start 2024-08-17T02:27:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c1ce00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c180acf10 0x7f4c18168cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c1ce00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4c180afca0 0x7f4c180a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c1ce00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c181590b0 0x7f4c180a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c1ce00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c18155670 con 0x7f4c180acf10 2024-08-17T02:27:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c1ce00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c18154a60 con 0x7f4c181590b0 2024-08-17T02:27:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c1ce00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c18154d40 con 0x7f4c180afca0 2024-08-17T02:27:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c15e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c180acf10 0x7f4c18168cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c15e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c180acf10 0x7f4c18168cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33528/0 (socket says 172.21.15.6:33528) 2024-08-17T02:27:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c15e00640 1 -- 172.21.15.6:0/2509952565 learned_addr learned my addr 172.21.15.6:0/2509952565 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c15400640 1 --2- 172.21.15.6:0/2509952565 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4c180afca0 0x7f4c180a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c16800640 1 --2- 172.21.15.6:0/2509952565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c181590b0 0x7f4c180a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c15e00640 1 -- 172.21.15.6:0/2509952565 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4c180afca0 msgr2=0x7f4c180a5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c15e00640 1 --2- 172.21.15.6:0/2509952565 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4c180afca0 0x7f4c180a5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c15e00640 1 -- 172.21.15.6:0/2509952565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c181590b0 msgr2=0x7f4c180a4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c15e00640 1 --2- 172.21.15.6:0/2509952565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c181590b0 0x7f4c180a4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c15e00640 1 -- 172.21.15.6:0/2509952565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c10009a20 con 0x7f4c180acf10 2024-08-17T02:27:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c15400640 1 --2- 172.21.15.6:0/2509952565 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4c180afca0 0x7f4c180a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.075+0000 7f4c16800640 1 --2- 172.21.15.6:0/2509952565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c181590b0 0x7f4c180a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.076+0000 7f4c15e00640 1 --2- 172.21.15.6:0/2509952565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c180acf10 0x7f4c18168cf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c810 tx=0x7f4c08007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.076+0000 7f4c0d600640 1 -- 172.21.15.6:0/2509952565 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0800a640 con 0x7f4c180acf10 2024-08-17T02:27:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.076+0000 7f4c0d600640 1 -- 172.21.15.6:0/2509952565 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0800a7e0 con 0x7f4c180acf10 2024-08-17T02:27:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.076+0000 7f4c0d600640 1 -- 172.21.15.6:0/2509952565 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0800aba0 con 0x7f4c180acf10 2024-08-17T02:27:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.076+0000 7f4c1ce00640 1 -- 172.21.15.6:0/2509952565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c18155020 con 0x7f4c180acf10 2024-08-17T02:27:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.076+0000 7f4c1ce00640 1 -- 172.21.15.6:0/2509952565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c18169230 con 0x7f4c180acf10 2024-08-17T02:27:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.077+0000 7f4c1ce00640 1 -- 172.21.15.6:0/2509952565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c18063fb0 con 0x7f4c180acf10 2024-08-17T02:27:07.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.078+0000 7f4c0d600640 1 -- 172.21.15.6:0/2509952565 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4c08012420 con 0x7f4c180acf10 2024-08-17T02:27:07.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.079+0000 7f4c0d600640 1 --2- 172.21.15.6:0/2509952565 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4bf8065150 0x7f4bf8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.079+0000 7f4c0d600640 1 -- 172.21.15.6:0/2509952565 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c08082260 con 0x7f4c180acf10 2024-08-17T02:27:07.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.079+0000 7f4c15400640 1 --2- 172.21.15.6:0/2509952565 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4bf8065150 0x7f4bf8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.080+0000 7f4c15400640 1 --2- 172.21.15.6:0/2509952565 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4bf8065150 0x7f4bf8067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4c18159770 tx=0x7f4c04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.083+0000 7f4c0d600640 1 -- 172.21.15.6:0/2509952565 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4c08050280 con 0x7f4c180acf10 2024-08-17T02:27:07.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.268+0000 7f4c1ce00640 1 -- 172.21.15.6:0/2509952565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c180cb280 con 0x7f4c180acf10 2024-08-17T02:27:07.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.269+0000 7f4c0d600640 1 -- 172.21.15.6:0/2509952565 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f4c080538a0 con 0x7f4c180acf10 2024-08-17T02:27:07.270 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:07.270 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:33.190571+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:29.257601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:30.596556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:07.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.271+0000 7f4c1ce00640 1 -- 172.21.15.6:0/2509952565 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4bf8065150 msgr2=0x7f4bf8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.271+0000 7f4c1ce00640 1 --2- 172.21.15.6:0/2509952565 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4bf8065150 0x7f4bf8067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4c18159770 tx=0x7f4c04009040 comp rx=0 tx=0).stop 2024-08-17T02:27:07.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.271+0000 7f4c1ce00640 1 -- 172.21.15.6:0/2509952565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c180acf10 msgr2=0x7f4c18168cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.271+0000 7f4c1ce00640 1 --2- 172.21.15.6:0/2509952565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c180acf10 0x7f4c18168cf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c810 tx=0x7f4c08007ea0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.271+0000 7f4c1ce00640 1 -- 172.21.15.6:0/2509952565 shutdown_connections 2024-08-17T02:27:07.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.271+0000 7f4c1ce00640 1 --2- 172.21.15.6:0/2509952565 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4bf8065150 0x7f4bf8067600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.271+0000 7f4c1ce00640 1 --2- 172.21.15.6:0/2509952565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c181590b0 0x7f4c180a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.271+0000 7f4c1ce00640 1 --2- 172.21.15.6:0/2509952565 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4c180afca0 0x7f4c180a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.271+0000 7f4c1ce00640 1 --2- 172.21.15.6:0/2509952565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c180acf10 0x7f4c18168cf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.271+0000 7f4c1ce00640 1 -- 172.21.15.6:0/2509952565 >> 172.21.15.6:0/2509952565 conn(0x7f4c18066e60 msgr2=0x7f4c18069830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.271+0000 7f4c1ce00640 1 -- 172.21.15.6:0/2509952565 shutdown_connections 2024-08-17T02:27:07.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.271+0000 7f4c1ce00640 1 -- 172.21.15.6:0/2509952565 wait complete. 2024-08-17T02:27:07.288 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:25.463503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:29.257601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:30.596556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:07.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:07.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.441+0000 7f12c4200640 1 Processor -- start 2024-08-17T02:27:07.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.441+0000 7f12c4200640 1 -- start start 2024-08-17T02:27:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.442+0000 7f12c4200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f12bc158e60 0x7f12bc0add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.443+0000 7f12c4200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f12bc0b0ac0 0x7f12bc0ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.443+0000 7f12c4200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12bc0ad8a0 con 0x7f12bc0ae860 2024-08-17T02:27:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.443+0000 7f12c4200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12bc06edf0 con 0x7f12bc0b0ac0 2024-08-17T02:27:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.443+0000 7f12c4200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12bc0acc90 con 0x7f12bc158e60 2024-08-17T02:27:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.443+0000 7f12c2200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f12bc0b0ac0 0x7f12bc0ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.443+0000 7f12c2200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f12bc0b0ac0 0x7f12bc0ac5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33536/0 (socket says 172.21.15.6:33536) 2024-08-17T02:27:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.443+0000 7f12c2200640 1 -- 172.21.15.6:0/3450111464 learned_addr learned my addr 172.21.15.6:0/3450111464 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.443+0000 7f12c1800640 1 --2- 172.21.15.6:0/3450111464 >> v2:172.21.15.136:3300/0 conn(0x7f12bc158e60 0x7f12bc0add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.443+0000 7f12c2200640 1 -- 172.21.15.6:0/3450111464 >> v2:172.21.15.136:3300/0 conn(0x7f12bc158e60 msgr2=0x7f12bc0add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:07.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.443+0000 7f12c2200640 1 --2- 172.21.15.6:0/3450111464 >> v2:172.21.15.136:3300/0 conn(0x7f12bc158e60 0x7f12bc0add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.443+0000 7f12c2200640 1 -- 172.21.15.6:0/3450111464 >> v1:172.21.15.136:6789/0 conn(0x7f12bc0ae860 legacy=0x7f12bc0b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.443+0000 7f12c2200640 1 -- 172.21.15.6:0/3450111464 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc0acf70 con 0x7f12bc0b0ac0 2024-08-17T02:27:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.444+0000 7f12c2200640 1 --2- 172.21.15.6:0/3450111464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12bc0b0ac0 0x7f12bc0ac5d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f12bc068890 tx=0x7f12b400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710e93bfa3d37011 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.445+0000 7f12bbe00640 1 -- 172.21.15.6:0/3450111464 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b400b2e0 con 0x7f12bc0b0ac0 2024-08-17T02:27:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.445+0000 7f12bbe00640 1 -- 172.21.15.6:0/3450111464 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b400b440 con 0x7f12bc0b0ac0 2024-08-17T02:27:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.445+0000 7f12bbe00640 1 -- 172.21.15.6:0/3450111464 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4009840 con 0x7f12bc0b0ac0 2024-08-17T02:27:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.445+0000 7f12c4200640 1 -- 172.21.15.6:0/3450111464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12bc0b0ac0 msgr2=0x7f12bc0ac5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.445+0000 7f12c4200640 1 --2- 172.21.15.6:0/3450111464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12bc0b0ac0 0x7f12bc0ac5d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f12bc068890 tx=0x7f12b400ba50 comp rx=0 tx=0).stop 2024-08-17T02:27:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.445+0000 7f12c4200640 1 -- 172.21.15.6:0/3450111464 shutdown_connections 2024-08-17T02:27:07.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.445+0000 7f12c4200640 1 --2- 172.21.15.6:0/3450111464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12bc0b0ac0 0x7f12bc0ac5d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.445+0000 7f12c4200640 1 --2- 172.21.15.6:0/3450111464 >> v2:172.21.15.136:3300/0 conn(0x7f12bc158e60 0x7f12bc0add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.445+0000 7f12c4200640 1 -- 172.21.15.6:0/3450111464 >> 172.21.15.6:0/3450111464 conn(0x7f12bc0cc390 msgr2=0x7f12bc066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.445+0000 7f12c4200640 1 -- 172.21.15.6:0/3450111464 shutdown_connections 2024-08-17T02:27:07.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.445+0000 7f12c4200640 1 -- 172.21.15.6:0/3450111464 wait complete. 2024-08-17T02:27:07.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.447+0000 7f12c4200640 1 Processor -- start 2024-08-17T02:27:07.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.447+0000 7f12c4200640 1 -- start start 2024-08-17T02:27:07.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.448+0000 7f12c4200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f12bc0ae860 0x7f12bc0c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.448+0000 7f12c4200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12bc0b0ac0 0x7f12bc143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.448+0000 7f12c4200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12bc158e60 0x7f12bc1684d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.448+0000 7f12c4200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0a52a0 con 0x7f12bc158e60 2024-08-17T02:27:07.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.448+0000 7f12c4200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0c0d20 con 0x7f12bc0b0ac0 2024-08-17T02:27:07.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.448+0000 7f12c4200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0a7af0 con 0x7f12bc0ae860 2024-08-17T02:27:07.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.448+0000 7f12c2200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12bc158e60 0x7f12bc1684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.448+0000 7f12c2200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12bc158e60 0x7f12bc1684d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33548/0 (socket says 172.21.15.6:33548) 2024-08-17T02:27:07.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.448+0000 7f12c2200640 1 -- 172.21.15.6:0/3979903826 learned_addr learned my addr 172.21.15.6:0/3979903826 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:07.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.448+0000 7f12c1800640 1 --2- 172.21.15.6:0/3979903826 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f12bc0ae860 0x7f12bc0c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.448+0000 7f12c0e00640 1 --2- 172.21.15.6:0/3979903826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12bc0b0ac0 0x7f12bc143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.449+0000 7f12c2200640 1 -- 172.21.15.6:0/3979903826 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f12bc0ae860 msgr2=0x7f12bc0c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.449+0000 7f12c2200640 1 --2- 172.21.15.6:0/3979903826 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f12bc0ae860 0x7f12bc0c07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.449+0000 7f12c2200640 1 -- 172.21.15.6:0/3979903826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12bc0b0ac0 msgr2=0x7f12bc143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.449+0000 7f12c2200640 1 --2- 172.21.15.6:0/3979903826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12bc0b0ac0 0x7f12bc143f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.449+0000 7f12c2200640 1 -- 172.21.15.6:0/3979903826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b400bcf0 con 0x7f12bc158e60 2024-08-17T02:27:07.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.449+0000 7f12c2200640 1 --2- 172.21.15.6:0/3979903826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12bc158e60 0x7f12bc1684d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f12b400d1d0 tx=0x7f12b4039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.449+0000 7f12b8c00640 1 -- 172.21.15.6:0/3979903826 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4031e70 con 0x7f12bc158e60 2024-08-17T02:27:07.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.449+0000 7f12b8c00640 1 -- 172.21.15.6:0/3979903826 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b403a450 con 0x7f12bc158e60 2024-08-17T02:27:07.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.449+0000 7f12b8c00640 1 -- 172.21.15.6:0/3979903826 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b403a810 con 0x7f12bc158e60 2024-08-17T02:27:07.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.449+0000 7f12c4200640 1 -- 172.21.15.6:0/3979903826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12bc0a5530 con 0x7f12bc158e60 2024-08-17T02:27:07.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.449+0000 7f12c4200640 1 -- 172.21.15.6:0/3979903826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12bc0a5af0 con 0x7f12bc158e60 2024-08-17T02:27:07.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.450+0000 7f12c4200640 1 -- 172.21.15.6:0/3979903826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12bc063fb0 con 0x7f12bc158e60 2024-08-17T02:27:07.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.451+0000 7f12b8c00640 1 -- 172.21.15.6:0/3979903826 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f12b403ab80 con 0x7f12bc158e60 2024-08-17T02:27:07.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.452+0000 7f12b8c00640 1 --2- 172.21.15.6:0/3979903826 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f129c065220 0x7f129c0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.452+0000 7f12b8c00640 1 -- 172.21.15.6:0/3979903826 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12b40a5f80 con 0x7f12bc158e60 2024-08-17T02:27:07.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.453+0000 7f12c1800640 1 --2- 172.21.15.6:0/3979903826 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f129c065220 0x7f129c0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.453+0000 7f12c1800640 1 --2- 172.21.15.6:0/3979903826 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f129c065220 0x7f129c0676d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009c10 tx=0x7f12b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.456+0000 7f12b8c00640 1 -- 172.21.15.6:0/3979903826 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f12b40740e0 con 0x7f12bc158e60 2024-08-17T02:27:07.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.641+0000 7f12c4200640 1 -- 172.21.15.6:0/3979903826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12bc0635f0 con 0x7f12bc158e60 2024-08-17T02:27:07.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.642+0000 7f12b8c00640 1 -- 172.21.15.6:0/3979903826 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f12b4077700 con 0x7f12bc158e60 2024-08-17T02:27:07.643 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-08-17T02:27:07.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.644+0000 7f12c4200640 1 -- 172.21.15.6:0/3979903826 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f129c065220 msgr2=0x7f129c0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.644+0000 7f12c4200640 1 --2- 172.21.15.6:0/3979903826 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f129c065220 0x7f129c0676d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009c10 tx=0x7f12b0008040 comp rx=0 tx=0).stop 2024-08-17T02:27:07.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.644+0000 7f12c4200640 1 -- 172.21.15.6:0/3979903826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12bc158e60 msgr2=0x7f12bc1684d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.644+0000 7f12c4200640 1 --2- 172.21.15.6:0/3979903826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12bc158e60 0x7f12bc1684d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f12b400d1d0 tx=0x7f12b4039000 comp rx=0 tx=0).stop 2024-08-17T02:27:07.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.644+0000 7f12c4200640 1 -- 172.21.15.6:0/3979903826 shutdown_connections 2024-08-17T02:27:07.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.644+0000 7f12c4200640 1 --2- 172.21.15.6:0/3979903826 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f129c065220 0x7f129c0676d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.644+0000 7f12c4200640 1 --2- 172.21.15.6:0/3979903826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12bc158e60 0x7f12bc1684d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.644+0000 7f12c4200640 1 --2- 172.21.15.6:0/3979903826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12bc0b0ac0 0x7f12bc143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.644+0000 7f12c4200640 1 --2- 172.21.15.6:0/3979903826 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f12bc0ae860 0x7f12bc0c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.644+0000 7f12c4200640 1 -- 172.21.15.6:0/3979903826 >> 172.21.15.6:0/3979903826 conn(0x7f12bc0cc390 msgr2=0x7f12bc0cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.644+0000 7f12c4200640 1 -- 172.21.15.6:0/3979903826 shutdown_connections 2024-08-17T02:27:07.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.644+0000 7f12c4200640 1 -- 172.21.15.6:0/3979903826 wait complete. 2024-08-17T02:27:07.660 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:07.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.813+0000 7f3908400640 1 Processor -- start 2024-08-17T02:27:07.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.813+0000 7f3908400640 1 -- start start 2024-08-17T02:27:07.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.814+0000 7f3908400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39000afca0 0x7f39000b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.814+0000 7f3908400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f39001590b0 0x7f3900159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.814+0000 7f3908400640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390015a4e0 con 0x7f39000acf10 2024-08-17T02:27:07.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.814+0000 7f3908400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39000b0980 con 0x7f39001590b0 2024-08-17T02:27:07.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.814+0000 7f3908400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39000c92b0 con 0x7f39000afca0 2024-08-17T02:27:07.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.814+0000 7f3905000640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f39000acf10 0x7f39001589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47784/0 (socket says 172.21.15.6:47784) 2024-08-17T02:27:07.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.814+0000 7f3905000640 1 -- 172.21.15.6:0/2257004136 learned_addr learned my addr 172.21.15.6:0/2257004136 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:07.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.815+0000 7f3906400640 1 --2- 172.21.15.6:0/2257004136 >> v2:172.21.15.136:3300/0 conn(0x7f39001590b0 0x7f3900159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.815+0000 7f3905a00640 1 --2- 172.21.15.6:0/2257004136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39000afca0 0x7f39000b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.815+0000 7f38ffe00640 1 -- 172.21.15.6:0/2257004136 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914472700 0 0) 0x7f38ec001110 con 0x7f39000acf10 2024-08-17T02:27:07.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.815+0000 7f38ffe00640 1 -- 172.21.15.6:0/2257004136 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38e80034e0 con 0x7f39000acf10 2024-08-17T02:27:07.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.815+0000 7f38ffe00640 1 -- 172.21.15.6:0/2257004136 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3396041655 0 0) 0x7f38e80034e0 con 0x7f39000acf10 2024-08-17T02:27:07.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.815+0000 7f38ffe00640 1 -- 172.21.15.6:0/2257004136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39000afca0 msgr2=0x7f39000b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:07.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.815+0000 7f38ffe00640 1 --2- 172.21.15.6:0/2257004136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39000afca0 0x7f39000b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.815+0000 7f38ffe00640 1 -- 172.21.15.6:0/2257004136 >> v2:172.21.15.136:3300/0 conn(0x7f39001590b0 msgr2=0x7f3900159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:07.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.815+0000 7f38ffe00640 1 --2- 172.21.15.6:0/2257004136 >> v2:172.21.15.136:3300/0 conn(0x7f39001590b0 0x7f3900159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.815+0000 7f38ffe00640 1 -- 172.21.15.6:0/2257004136 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39000ad480 con 0x7f39000acf10 2024-08-17T02:27:07.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.815+0000 7f38ffe00640 1 -- 172.21.15.6:0/2257004136 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f38ec001600 con 0x7f39000acf10 2024-08-17T02:27:07.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.815+0000 7f3906400640 1 --2- 172.21.15.6:0/2257004136 >> v2:172.21.15.136:3300/0 conn(0x7f39001590b0 0x7f3900159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:07.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.815+0000 7f38ffe00640 1 -- 172.21.15.6:0/2257004136 >> v1:172.21.15.6:6789/0 conn(0x7f39000acf10 legacy=0x7f39001589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.815+0000 7f38ffe00640 1 --2- 172.21.15.6:0/2257004136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38e80039d0 0x7f38e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.815+0000 7f38ffe00640 1 --2- 172.21.15.6:0/2257004136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38e8004780 0x7f38e8004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.815+0000 7f38ffe00640 1 --2- 172.21.15.6:0/2257004136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39000afca0 0x7f38e8005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.816+0000 7f38ffe00640 1 -- 172.21.15.6:0/2257004136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39000c92b0 con 0x7f38e8004780 2024-08-17T02:27:07.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.816+0000 7f38ffe00640 1 -- 172.21.15.6:0/2257004136 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e800b9d0 con 0x7f38e80039d0 2024-08-17T02:27:07.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.816+0000 7f38ffe00640 1 -- 172.21.15.6:0/2257004136 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e800dd20 con 0x7f39000afca0 2024-08-17T02:27:07.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.816+0000 7f3905000640 1 --2- 172.21.15.6:0/2257004136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38e8004780 0x7f38e8004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.816+0000 7f3905a00640 1 --2- 172.21.15.6:0/2257004136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38e80039d0 0x7f38e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.816+0000 7f3906400640 1 --2- 172.21.15.6:0/2257004136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39000afca0 0x7f38e8005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.816+0000 7f3905000640 1 -- 172.21.15.6:0/2257004136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39000afca0 msgr2=0x7f38e8005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:07.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.816+0000 7f3905000640 1 --2- 172.21.15.6:0/2257004136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39000afca0 0x7f38e8005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.816+0000 7f3905000640 1 -- 172.21.15.6:0/2257004136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38e80039d0 msgr2=0x7f38e8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:07.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.816+0000 7f3905000640 1 --2- 172.21.15.6:0/2257004136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38e80039d0 0x7f38e8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.816+0000 7f3905000640 1 -- 172.21.15.6:0/2257004136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e80034e0 con 0x7f38e8004780 2024-08-17T02:27:07.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.816+0000 7f3905a00640 1 --2- 172.21.15.6:0/2257004136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38e80039d0 0x7f38e8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:07.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.816+0000 7f3906400640 1 --2- 172.21.15.6:0/2257004136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39000afca0 0x7f38e8005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:07.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.817+0000 7f3905000640 1 --2- 172.21.15.6:0/2257004136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38e8004780 0x7f38e8004bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00c470 tx=0x7f38ec0079f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1f92e55d4f5b2c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.817+0000 7f38ffe00640 1 -- 172.21.15.6:0/2257004136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec005890 con 0x7f38e8004780 2024-08-17T02:27:07.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.817+0000 7f38ffe00640 1 -- 172.21.15.6:0/2257004136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec005a10 con 0x7f38e8004780 2024-08-17T02:27:07.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.817+0000 7f38ffe00640 1 -- 172.21.15.6:0/2257004136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec005e10 con 0x7f38e8004780 2024-08-17T02:27:07.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.818+0000 7f3908400640 1 -- 172.21.15.6:0/2257004136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38e8004780 msgr2=0x7f38e8004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.818+0000 7f3908400640 1 --2- 172.21.15.6:0/2257004136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38e8004780 0x7f38e8004bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00c470 tx=0x7f38ec0079f0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.818+0000 7f3906400640 1 -- 172.21.15.6:0/2257004136 reap_dead start 2024-08-17T02:27:07.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.818+0000 7f3908400640 1 -- 172.21.15.6:0/2257004136 shutdown_connections 2024-08-17T02:27:07.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.818+0000 7f3908400640 1 -- 172.21.15.6:0/2257004136 >> 172.21.15.6:0/2257004136 conn(0x7f3900066e60 msgr2=0x7f3900067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.818+0000 7f3908400640 1 -- 172.21.15.6:0/2257004136 shutdown_connections 2024-08-17T02:27:07.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.818+0000 7f3908400640 1 -- 172.21.15.6:0/2257004136 wait complete. 2024-08-17T02:27:07.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.819+0000 7f3908400640 1 Processor -- start 2024-08-17T02:27:07.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.819+0000 7f3908400640 1 -- start start 2024-08-17T02:27:07.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.820+0000 7f3908400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38e8004780 0x7f390015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.820+0000 7f3908400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3900169190 0x7f3900157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.820+0000 7f3908400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f390015ecc0 0x7f3900146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.820+0000 7f3908400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3900156100 con 0x7f38e8004780 2024-08-17T02:27:07.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.820+0000 7f3908400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3900169600 con 0x7f3900169190 2024-08-17T02:27:07.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.820+0000 7f3908400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3900158410 con 0x7f390015ecc0 2024-08-17T02:27:07.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.821+0000 7f3905a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38e8004780 0x7f390015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.821+0000 7f3905a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38e8004780 0x7f390015ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33570/0 (socket says 172.21.15.6:33570) 2024-08-17T02:27:07.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.821+0000 7f3905a00640 1 -- 172.21.15.6:0/4008475700 learned_addr learned my addr 172.21.15.6:0/4008475700 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:07.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.821+0000 7f3906400640 1 --2- 172.21.15.6:0/4008475700 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f390015ecc0 0x7f3900146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.821+0000 7f3905000640 1 --2- 172.21.15.6:0/4008475700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3900169190 0x7f3900157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.821+0000 7f3905a00640 1 -- 172.21.15.6:0/4008475700 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f390015ecc0 msgr2=0x7f3900146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.821+0000 7f3905a00640 1 --2- 172.21.15.6:0/4008475700 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f390015ecc0 0x7f3900146fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.821+0000 7f3905a00640 1 -- 172.21.15.6:0/4008475700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3900169190 msgr2=0x7f3900157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.821+0000 7f3905a00640 1 --2- 172.21.15.6:0/4008475700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3900169190 0x7f3900157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.821+0000 7f3905a00640 1 -- 172.21.15.6:0/4008475700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390015b170 con 0x7f38e8004780 2024-08-17T02:27:07.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.821+0000 7f3905a00640 1 --2- 172.21.15.6:0/4008475700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38e8004780 0x7f390015ab50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f38f40119c0 tx=0x7f38f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.822+0000 7f38fcc00640 1 -- 172.21.15.6:0/4008475700 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f400f950 con 0x7f38e8004780 2024-08-17T02:27:07.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.822+0000 7f38fcc00640 1 -- 172.21.15.6:0/4008475700 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f400fab0 con 0x7f38e8004780 2024-08-17T02:27:07.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.822+0000 7f38fcc00640 1 -- 172.21.15.6:0/4008475700 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f400fe30 con 0x7f38e8004780 2024-08-17T02:27:07.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.822+0000 7f3908400640 1 -- 172.21.15.6:0/4008475700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390015b450 con 0x7f38e8004780 2024-08-17T02:27:07.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.822+0000 7f3908400640 1 -- 172.21.15.6:0/4008475700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390015ba10 con 0x7f38e8004780 2024-08-17T02:27:07.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.823+0000 7f3908400640 1 -- 172.21.15.6:0/4008475700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3900063fb0 con 0x7f38e8004780 2024-08-17T02:27:07.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.823+0000 7f38fcc00640 1 -- 172.21.15.6:0/4008475700 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f38f4015670 con 0x7f38e8004780 2024-08-17T02:27:07.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.824+0000 7f38fcc00640 1 --2- 172.21.15.6:0/4008475700 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f38e0065150 0x7f38e0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.824+0000 7f38fcc00640 1 -- 172.21.15.6:0/4008475700 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f38f4082970 con 0x7f38e8004780 2024-08-17T02:27:07.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.825+0000 7f3905000640 1 --2- 172.21.15.6:0/4008475700 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f38e0065150 0x7f38e0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.825+0000 7f3905000640 1 --2- 172.21.15.6:0/4008475700 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f38e0065150 0x7f38e0067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f38ec033000 tx=0x7f38ec034000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:07.828+0000 7f38fcc00640 1 -- 172.21.15.6:0/4008475700 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f38f4050a40 con 0x7f38e8004780 2024-08-17T02:27:08.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.008+0000 7f3908400640 1 -- 172.21.15.6:0/4008475700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3900067b70 con 0x7f38e8004780 2024-08-17T02:27:08.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.008+0000 7f38fcc00640 1 -- 172.21.15.6:0/4008475700 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f38f40220a0 con 0x7f38e8004780 2024-08-17T02:27:08.009 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-08-17T02:27:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.010+0000 7f3908400640 1 -- 172.21.15.6:0/4008475700 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f38e0065150 msgr2=0x7f38e0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.010+0000 7f3908400640 1 --2- 172.21.15.6:0/4008475700 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f38e0065150 0x7f38e0067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f38ec033000 tx=0x7f38ec034000 comp rx=0 tx=0).stop 2024-08-17T02:27:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.010+0000 7f3908400640 1 -- 172.21.15.6:0/4008475700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38e8004780 msgr2=0x7f390015ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.010+0000 7f3908400640 1 --2- 172.21.15.6:0/4008475700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38e8004780 0x7f390015ab50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f38f40119c0 tx=0x7f38f4008040 comp rx=0 tx=0).stop 2024-08-17T02:27:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.010+0000 7f3908400640 1 -- 172.21.15.6:0/4008475700 shutdown_connections 2024-08-17T02:27:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.010+0000 7f3908400640 1 --2- 172.21.15.6:0/4008475700 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f38e0065150 0x7f38e0067600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.010+0000 7f3908400640 1 --2- 172.21.15.6:0/4008475700 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f390015ecc0 0x7f3900146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.010+0000 7f3908400640 1 --2- 172.21.15.6:0/4008475700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3900169190 0x7f3900157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.010+0000 7f3908400640 1 --2- 172.21.15.6:0/4008475700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38e8004780 0x7f390015ab50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.010+0000 7f3908400640 1 -- 172.21.15.6:0/4008475700 >> 172.21.15.6:0/4008475700 conn(0x7f3900066e60 msgr2=0x7f39000ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.010+0000 7f3908400640 1 -- 172.21.15.6:0/4008475700 shutdown_connections 2024-08-17T02:27:08.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.010+0000 7f3908400640 1 -- 172.21.15.6:0/4008475700 wait complete. 2024-08-17T02:27:08.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:08.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.178+0000 7ff54fe00640 1 Processor -- start 2024-08-17T02:27:08.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.178+0000 7ff54fe00640 1 -- start start 2024-08-17T02:27:08.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.180+0000 7ff54fe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5500b1850 0x7ff5500b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.180+0000 7ff54fe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5500d0650 0x7ff5500ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.180+0000 7ff54fe00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5500ce9b0 con 0x7ff5501585a0 2024-08-17T02:27:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.180+0000 7ff54fe00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5500cec90 con 0x7ff5500b1850 2024-08-17T02:27:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.180+0000 7ff54fe00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5500cef70 con 0x7ff5500d0650 2024-08-17T02:27:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.180+0000 7ff54ea00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5500b1850 0x7ff5500b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.180+0000 7ff54f400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff5501585a0 0x7ff550158a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47786/0 (socket says 172.21.15.6:47786) 2024-08-17T02:27:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.180+0000 7ff54ea00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5500b1850 0x7ff5500b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33586/0 (socket says 172.21.15.6:33586) 2024-08-17T02:27:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.180+0000 7ff54f400640 1 -- 172.21.15.6:0/4042206541 learned_addr learned my addr 172.21.15.6:0/4042206541 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.180+0000 7ff54e000640 1 --2- 172.21.15.6:0/4042206541 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5500d0650 0x7ff5500ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.180+0000 7ff54ea00640 1 -- 172.21.15.6:0/4042206541 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5500d0650 msgr2=0x7ff5500ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.180+0000 7ff54ea00640 1 --2- 172.21.15.6:0/4042206541 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5500d0650 0x7ff5500ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.180+0000 7ff54ea00640 1 -- 172.21.15.6:0/4042206541 >> v1:172.21.15.6:6789/0 conn(0x7ff5501585a0 legacy=0x7ff550158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.181+0000 7ff54ea00640 1 -- 172.21.15.6:0/4042206541 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5500cf250 con 0x7ff5500b1850 2024-08-17T02:27:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.181+0000 7ff54ea00640 1 --2- 172.21.15.6:0/4042206541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5500b1850 0x7ff5500b1c20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff540009850 tx=0x7ff5400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b74d76d3a20a64 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.182+0000 7ff54d600640 1 -- 172.21.15.6:0/4042206541 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54002ad80 con 0x7ff5500b1850 2024-08-17T02:27:08.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.182+0000 7ff54d600640 1 -- 172.21.15.6:0/4042206541 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff540032440 con 0x7ff5500b1850 2024-08-17T02:27:08.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.182+0000 7ff54d600640 1 -- 172.21.15.6:0/4042206541 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540032820 con 0x7ff5500b1850 2024-08-17T02:27:08.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.182+0000 7ff54fe00640 1 -- 172.21.15.6:0/4042206541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5500b1850 msgr2=0x7ff5500b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.182+0000 7ff54fe00640 1 --2- 172.21.15.6:0/4042206541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5500b1850 0x7ff5500b1c20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff540009850 tx=0x7ff5400090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.182+0000 7ff54fe00640 1 -- 172.21.15.6:0/4042206541 shutdown_connections 2024-08-17T02:27:08.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.182+0000 7ff54fe00640 1 --2- 172.21.15.6:0/4042206541 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5500d0650 0x7ff5500ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.182+0000 7ff54fe00640 1 --2- 172.21.15.6:0/4042206541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5500b1850 0x7ff5500b1c20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.182+0000 7ff54fe00640 1 -- 172.21.15.6:0/4042206541 >> 172.21.15.6:0/4042206541 conn(0x7ff55006e590 msgr2=0x7ff55006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.182+0000 7ff54fe00640 1 -- 172.21.15.6:0/4042206541 shutdown_connections 2024-08-17T02:27:08.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.182+0000 7ff54fe00640 1 -- 172.21.15.6:0/4042206541 wait complete. 2024-08-17T02:27:08.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.184+0000 7ff54fe00640 1 Processor -- start 2024-08-17T02:27:08.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.184+0000 7ff54fe00640 1 -- start start 2024-08-17T02:27:08.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5500b1850 0x7ff550151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54fe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5500d0650 0x7ff550151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5501585a0 0x7ff550168d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54fe00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff550152fe0 con 0x7ff5500b1850 2024-08-17T02:27:08.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54fe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5501538c0 con 0x7ff5501585a0 2024-08-17T02:27:08.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54fe00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5501523d0 con 0x7ff5500d0650 2024-08-17T02:27:08.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5500b1850 0x7ff550151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5500b1850 0x7ff550151860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33598/0 (socket says 172.21.15.6:33598) 2024-08-17T02:27:08.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54ea00640 1 -- 172.21.15.6:0/362065054 learned_addr learned my addr 172.21.15.6:0/362065054 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:08.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54ea00640 1 -- 172.21.15.6:0/362065054 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5500d0650 msgr2=0x7ff550151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54e000640 1 --2- 172.21.15.6:0/362065054 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5500d0650 0x7ff550151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54f400640 1 --2- 172.21.15.6:0/362065054 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5501585a0 0x7ff550168d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54ea00640 1 --2- 172.21.15.6:0/362065054 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5500d0650 0x7ff550151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54ea00640 1 -- 172.21.15.6:0/362065054 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5501585a0 msgr2=0x7ff550168d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54ea00640 1 --2- 172.21.15.6:0/362065054 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5501585a0 0x7ff550168d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54ea00640 1 -- 172.21.15.6:0/362065054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff540009390 con 0x7ff5500b1850 2024-08-17T02:27:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54e000640 1 --2- 172.21.15.6:0/362065054 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5500d0650 0x7ff550151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.185+0000 7ff54f400640 1 --2- 172.21.15.6:0/362065054 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5501585a0 0x7ff550168d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.186+0000 7ff54ea00640 1 --2- 172.21.15.6:0/362065054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5500b1850 0x7ff550151860 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff540009850 tx=0x7ff540032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.186+0000 7ff546000640 1 -- 172.21.15.6:0/362065054 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540000d10 con 0x7ff5500b1850 2024-08-17T02:27:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.186+0000 7ff546000640 1 -- 172.21.15.6:0/362065054 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff540031de0 con 0x7ff5500b1850 2024-08-17T02:27:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.186+0000 7ff546000640 1 -- 172.21.15.6:0/362065054 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54003d670 con 0x7ff5500b1850 2024-08-17T02:27:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.186+0000 7ff54fe00640 1 -- 172.21.15.6:0/362065054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5501526b0 con 0x7ff5500b1850 2024-08-17T02:27:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.186+0000 7ff54fe00640 1 -- 172.21.15.6:0/362065054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff550152c70 con 0x7ff5500b1850 2024-08-17T02:27:08.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.187+0000 7ff54fe00640 1 -- 172.21.15.6:0/362065054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff550070720 con 0x7ff5500b1850 2024-08-17T02:27:08.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.188+0000 7ff546000640 1 -- 172.21.15.6:0/362065054 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff540039040 con 0x7ff5500b1850 2024-08-17T02:27:08.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.189+0000 7ff546000640 1 --2- 172.21.15.6:0/362065054 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff530065180 0x7ff530067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.189+0000 7ff546000640 1 -- 172.21.15.6:0/362065054 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff5400a23c0 con 0x7ff5500b1850 2024-08-17T02:27:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.189+0000 7ff54e000640 1 --2- 172.21.15.6:0/362065054 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff530065180 0x7ff530067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.190+0000 7ff54e000640 1 --2- 172.21.15.6:0/362065054 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff530065180 0x7ff530067630 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff53c006e70 tx=0x7ff53c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.193+0000 7ff546000640 1 -- 172.21.15.6:0/362065054 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff5400703e0 con 0x7ff5500b1850 2024-08-17T02:27:08.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.375+0000 7ff54fe00640 1 -- 172.21.15.6:0/362065054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff550068140 con 0x7ff5500b1850 2024-08-17T02:27:08.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.376+0000 7ff546000640 1 -- 172.21.15.6:0/362065054 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff540073a00 con 0x7ff5500b1850 2024-08-17T02:27:08.376 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-08-17T02:27:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.378+0000 7ff54fe00640 1 -- 172.21.15.6:0/362065054 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff530065180 msgr2=0x7ff530067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.378+0000 7ff54fe00640 1 --2- 172.21.15.6:0/362065054 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff530065180 0x7ff530067630 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff53c006e70 tx=0x7ff53c008040 comp rx=0 tx=0).stop 2024-08-17T02:27:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.378+0000 7ff54fe00640 1 -- 172.21.15.6:0/362065054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5500b1850 msgr2=0x7ff550151860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.378+0000 7ff54fe00640 1 --2- 172.21.15.6:0/362065054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5500b1850 0x7ff550151860 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff540009850 tx=0x7ff540032000 comp rx=0 tx=0).stop 2024-08-17T02:27:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.378+0000 7ff54fe00640 1 -- 172.21.15.6:0/362065054 shutdown_connections 2024-08-17T02:27:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.378+0000 7ff54fe00640 1 --2- 172.21.15.6:0/362065054 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff530065180 0x7ff530067630 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.378+0000 7ff54fe00640 1 --2- 172.21.15.6:0/362065054 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5501585a0 0x7ff550168d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.378+0000 7ff54fe00640 1 --2- 172.21.15.6:0/362065054 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5500d0650 0x7ff550151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.378+0000 7ff54fe00640 1 --2- 172.21.15.6:0/362065054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5500b1850 0x7ff550151860 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.378+0000 7ff54fe00640 1 -- 172.21.15.6:0/362065054 >> 172.21.15.6:0/362065054 conn(0x7ff55006e590 msgr2=0x7ff5500afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.378+0000 7ff54fe00640 1 -- 172.21.15.6:0/362065054 shutdown_connections 2024-08-17T02:27:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.378+0000 7ff54fe00640 1 -- 172.21.15.6:0/362065054 wait complete. 2024-08-17T02:27:08.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:08.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.544+0000 7ffa97200640 1 Processor -- start 2024-08-17T02:27:08.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.544+0000 7ffa97200640 1 -- start start 2024-08-17T02:27:08.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.545+0000 7ffa97200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa98158af0 0x7ffa980ae530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.545+0000 7ffa97200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ffa980c8290 0x7ffa980ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.545+0000 7ffa97200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa980aca30 0x7ffa9815c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.545+0000 7ffa97200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa980abde0 con 0x7ffa98158af0 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.545+0000 7ffa97200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa980aa5a0 con 0x7ffa980c8290 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.545+0000 7ffa97200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980ace30 con 0x7ffa980aca30 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.545+0000 7ffa95e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa98158af0 0x7ffa980ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.545+0000 7ffa95e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa98158af0 0x7ffa980ae530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33604/0 (socket says 172.21.15.6:33604) 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.545+0000 7ffa95e00640 1 -- 172.21.15.6:0/1584771493 learned_addr learned my addr 172.21.15.6:0/1584771493 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.545+0000 7ffa96800640 1 --2- 172.21.15.6:0/1584771493 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa980aca30 0x7ffa9815c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.546+0000 7ffa8fe00640 1 --2- 172.21.15.6:0/1584771493 >> v2:172.21.15.136:3300/0 conn(0x7ffa980c8290 0x7ffa980ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.546+0000 7ffa95e00640 1 -- 172.21.15.6:0/1584771493 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa980aca30 msgr2=0x7ffa9815c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.546+0000 7ffa95e00640 1 --2- 172.21.15.6:0/1584771493 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa980aca30 0x7ffa9815c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.546+0000 7ffa95e00640 1 -- 172.21.15.6:0/1584771493 >> v2:172.21.15.136:3300/0 conn(0x7ffa980c8290 msgr2=0x7ffa980ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.546+0000 7ffa95e00640 1 --2- 172.21.15.6:0/1584771493 >> v2:172.21.15.136:3300/0 conn(0x7ffa980c8290 0x7ffa980ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.546+0000 7ffa95e00640 1 -- 172.21.15.6:0/1584771493 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa980a9c70 con 0x7ffa98158af0 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.547+0000 7ffa95e00640 1 --2- 172.21.15.6:0/1584771493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa98158af0 0x7ffa980ae530 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ffa9806dfb0 tx=0x7ffa880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be87ba02876e1e7f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.547+0000 7ffa95400640 1 -- 172.21.15.6:0/1584771493 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8802add0 con 0x7ffa98158af0 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.547+0000 7ffa95400640 1 -- 172.21.15.6:0/1584771493 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa88032440 con 0x7ffa98158af0 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.547+0000 7ffa95400640 1 -- 172.21.15.6:0/1584771493 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88032820 con 0x7ffa98158af0 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.547+0000 7ffa97200640 1 -- 172.21.15.6:0/1584771493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa98158af0 msgr2=0x7ffa980ae530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.547+0000 7ffa97200640 1 --2- 172.21.15.6:0/1584771493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa98158af0 0x7ffa980ae530 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ffa9806dfb0 tx=0x7ffa880091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.548+0000 7ffa97200640 1 -- 172.21.15.6:0/1584771493 shutdown_connections 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.548+0000 7ffa97200640 1 --2- 172.21.15.6:0/1584771493 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa980aca30 0x7ffa9815c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.548+0000 7ffa97200640 1 --2- 172.21.15.6:0/1584771493 >> v2:172.21.15.136:3300/0 conn(0x7ffa980c8290 0x7ffa980ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.548+0000 7ffa97200640 1 --2- 172.21.15.6:0/1584771493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa98158af0 0x7ffa980ae530 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.548+0000 7ffa97200640 1 -- 172.21.15.6:0/1584771493 >> 172.21.15.6:0/1584771493 conn(0x7ffa980cc060 msgr2=0x7ffa980cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.548+0000 7ffa97200640 1 -- 172.21.15.6:0/1584771493 shutdown_connections 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.548+0000 7ffa97200640 1 -- 172.21.15.6:0/1584771493 wait complete. 2024-08-17T02:27:08.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.549+0000 7ffa97200640 1 Processor -- start 2024-08-17T02:27:08.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.549+0000 7ffa97200640 1 -- start start 2024-08-17T02:27:08.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.550+0000 7ffa97200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa980aca30 0x7ffa981496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.550+0000 7ffa97200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa980c8290 0x7ffa98149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.550+0000 7ffa97200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa98158af0 0x7ffa9806b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.550+0000 7ffa97200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980c49d0 con 0x7ffa980c8290 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.550+0000 7ffa97200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa98168b10 con 0x7ffa98158af0 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.550+0000 7ffa97200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980c3dc0 con 0x7ffa980aca30 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.550+0000 7ffa8fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa980c8290 0x7ffa98149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.550+0000 7ffa8fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa980c8290 0x7ffa98149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33610/0 (socket says 172.21.15.6:33610) 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.550+0000 7ffa8fe00640 1 -- 172.21.15.6:0/2710361241 learned_addr learned my addr 172.21.15.6:0/2710361241 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.550+0000 7ffa96800640 1 --2- 172.21.15.6:0/2710361241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa98158af0 0x7ffa9806b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.550+0000 7ffa95e00640 1 --2- 172.21.15.6:0/2710361241 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa980aca30 0x7ffa981496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.551+0000 7ffa8fe00640 1 -- 172.21.15.6:0/2710361241 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa980aca30 msgr2=0x7ffa981496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.551+0000 7ffa8fe00640 1 --2- 172.21.15.6:0/2710361241 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa980aca30 0x7ffa981496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.551+0000 7ffa8fe00640 1 -- 172.21.15.6:0/2710361241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa98158af0 msgr2=0x7ffa9806b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.551+0000 7ffa8fe00640 1 --2- 172.21.15.6:0/2710361241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa98158af0 0x7ffa9806b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.551+0000 7ffa8fe00640 1 -- 172.21.15.6:0/2710361241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa88009450 con 0x7ffa980c8290 2024-08-17T02:27:08.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.551+0000 7ffa8fe00640 1 --2- 172.21.15.6:0/2710361241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa980c8290 0x7ffa98149e40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000d8c0 tx=0x7ffa80008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.551+0000 7ffa8d600640 1 -- 172.21.15.6:0/2710361241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000de50 con 0x7ffa980c8290 2024-08-17T02:27:08.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.551+0000 7ffa8d600640 1 -- 172.21.15.6:0/2710361241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8000b8d0 con 0x7ffa980c8290 2024-08-17T02:27:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.551+0000 7ffa8d600640 1 -- 172.21.15.6:0/2710361241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000bc70 con 0x7ffa980c8290 2024-08-17T02:27:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.551+0000 7ffa97200640 1 -- 172.21.15.6:0/2710361241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa980c40a0 con 0x7ffa980c8290 2024-08-17T02:27:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.551+0000 7ffa97200640 1 -- 172.21.15.6:0/2710361241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa980c4660 con 0x7ffa980c8290 2024-08-17T02:27:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.553+0000 7ffa97200640 1 -- 172.21.15.6:0/2710361241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa980c4b80 con 0x7ffa980c8290 2024-08-17T02:27:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.553+0000 7ffa8d600640 1 -- 172.21.15.6:0/2710361241 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffa80014640 con 0x7ffa980c8290 2024-08-17T02:27:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.554+0000 7ffa8d600640 1 --2- 172.21.15.6:0/2710361241 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ffa74065150 0x7ffa74067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.555+0000 7ffa8d600640 1 -- 172.21.15.6:0/2710361241 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa80082a00 con 0x7ffa980c8290 2024-08-17T02:27:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.555+0000 7ffa95e00640 1 --2- 172.21.15.6:0/2710361241 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ffa74065150 0x7ffa74067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.556+0000 7ffa95e00640 1 --2- 172.21.15.6:0/2710361241 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ffa74065150 0x7ffa74067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa88034000 tx=0x7ffa88032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.559+0000 7ffa8d600640 1 -- 172.21.15.6:0/2710361241 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffa980c4b80 con 0x7ffa980c8290 2024-08-17T02:27:08.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.779+0000 7ffa97200640 1 -- 172.21.15.6:0/2710361241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa980c4b80 con 0x7ffa980c8290 2024-08-17T02:27:08.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.780+0000 7ffa8d600640 1 -- 172.21.15.6:0/2710361241 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4582 (secure 0 0 0) 0x7ffa980c4b80 con 0x7ffa980c8290 2024-08-17T02:27:08.780 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:08.780 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/881817227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":881817227},{"type":"v1","addr":"172.21.15.6:6833","nonce":881817227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/546855411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":546855411},{"type":"v1","addr":"172.21.15.6:6835","nonce":546855411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/539185499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":539185499},{"type":"v1","addr":"172.21.15.136:6837","nonce":539185499}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:31.615645+0000","modified":"2024-08-17T02:26:35.207397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/2230598578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2230598578},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230598578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:08.781 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2024-08-17T02:27:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.782+0000 7ffa97200640 1 -- 172.21.15.6:0/2710361241 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ffa74065150 msgr2=0x7ffa74067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.782+0000 7ffa97200640 1 --2- 172.21.15.6:0/2710361241 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ffa74065150 0x7ffa74067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa88034000 tx=0x7ffa88032000 comp rx=0 tx=0).stop 2024-08-17T02:27:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.782+0000 7ffa97200640 1 -- 172.21.15.6:0/2710361241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa980c8290 msgr2=0x7ffa98149e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.782+0000 7ffa97200640 1 --2- 172.21.15.6:0/2710361241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa980c8290 0x7ffa98149e40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000d8c0 tx=0x7ffa80008040 comp rx=0 tx=0).stop 2024-08-17T02:27:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.782+0000 7ffa97200640 1 -- 172.21.15.6:0/2710361241 shutdown_connections 2024-08-17T02:27:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.782+0000 7ffa97200640 1 --2- 172.21.15.6:0/2710361241 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ffa74065150 0x7ffa74067600 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.782+0000 7ffa97200640 1 --2- 172.21.15.6:0/2710361241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa98158af0 0x7ffa9806b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.782+0000 7ffa97200640 1 --2- 172.21.15.6:0/2710361241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa980c8290 0x7ffa98149e40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.782+0000 7ffa97200640 1 --2- 172.21.15.6:0/2710361241 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa980aca30 0x7ffa981496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.782+0000 7ffa97200640 1 -- 172.21.15.6:0/2710361241 >> 172.21.15.6:0/2710361241 conn(0x7ffa980cc060 msgr2=0x7ffa9806fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.782+0000 7ffa97200640 1 -- 172.21.15.6:0/2710361241 shutdown_connections 2024-08-17T02:27:08.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.782+0000 7ffa97200640 1 -- 172.21.15.6:0/2710361241 wait complete. 2024-08-17T02:27:08.797 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.949+0000 7f0110c00640 1 Processor -- start 2024-08-17T02:27:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.949+0000 7f0110c00640 1 -- start start 2024-08-17T02:27:08.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.950+0000 7f0110c00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f010c158b90 0x7f010c0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.950+0000 7f0110c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f010c0af130 0x7f010c0ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.950+0000 7f0110c00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010c0afd20 con 0x7f010c0b2370 2024-08-17T02:27:08.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.950+0000 7f0110c00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010c0affe0 con 0x7f010c158b90 2024-08-17T02:27:08.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.950+0000 7f0110c00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010c0b02c0 con 0x7f010c0af130 2024-08-17T02:27:08.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.950+0000 7f0109e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f010c158b90 0x7f010c0b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.950+0000 7f0109e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f010c158b90 0x7f010c0b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33614/0 (socket says 172.21.15.6:33614) 2024-08-17T02:27:08.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.950+0000 7f0109e00640 1 -- 172.21.15.6:0/3216509219 learned_addr learned my addr 172.21.15.6:0/3216509219 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:08.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.951+0000 7f010a800640 1 --2- 172.21.15.6:0/3216509219 >> v2:172.21.15.136:3300/0 conn(0x7f010c0af130 0x7f010c0ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.951+0000 7f0109e00640 1 -- 172.21.15.6:0/3216509219 >> v2:172.21.15.136:3300/0 conn(0x7f010c0af130 msgr2=0x7f010c0ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.951+0000 7f0109e00640 1 --2- 172.21.15.6:0/3216509219 >> v2:172.21.15.136:3300/0 conn(0x7f010c0af130 0x7f010c0ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.951+0000 7f0109e00640 1 -- 172.21.15.6:0/3216509219 >> v1:172.21.15.136:6789/0 conn(0x7f010c0b2370 legacy=0x7f010c0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.951+0000 7f0109e00640 1 -- 172.21.15.6:0/3216509219 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c0ca3c0 con 0x7f010c158b90 2024-08-17T02:27:08.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.952+0000 7f0109e00640 1 --2- 172.21.15.6:0/3216509219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f010c158b90 0x7f010c0b1e30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f010c066fc0 tx=0x7f00fc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2e319c92c121c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.952+0000 7f0108a00640 1 -- 172.21.15.6:0/3216509219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc02ae80 con 0x7f010c158b90 2024-08-17T02:27:08.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.952+0000 7f0108a00640 1 -- 172.21.15.6:0/3216509219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc032440 con 0x7f010c158b90 2024-08-17T02:27:08.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.952+0000 7f0108a00640 1 -- 172.21.15.6:0/3216509219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc032800 con 0x7f010c158b90 2024-08-17T02:27:08.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.953+0000 7f0110c00640 1 -- 172.21.15.6:0/3216509219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f010c158b90 msgr2=0x7f010c0b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.953+0000 7f0110c00640 1 --2- 172.21.15.6:0/3216509219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f010c158b90 0x7f010c0b1e30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f010c066fc0 tx=0x7f00fc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.953+0000 7f0110c00640 1 -- 172.21.15.6:0/3216509219 shutdown_connections 2024-08-17T02:27:08.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.953+0000 7f0110c00640 1 --2- 172.21.15.6:0/3216509219 >> v2:172.21.15.136:3300/0 conn(0x7f010c0af130 0x7f010c0ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.953+0000 7f0110c00640 1 --2- 172.21.15.6:0/3216509219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f010c158b90 0x7f010c0b1e30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.953+0000 7f0110c00640 1 -- 172.21.15.6:0/3216509219 >> 172.21.15.6:0/3216509219 conn(0x7f010c06e590 msgr2=0x7f010c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.953+0000 7f0110c00640 1 -- 172.21.15.6:0/3216509219 shutdown_connections 2024-08-17T02:27:08.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.953+0000 7f0110c00640 1 -- 172.21.15.6:0/3216509219 wait complete. 2024-08-17T02:27:08.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.954+0000 7f0110c00640 1 Processor -- start 2024-08-17T02:27:08.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.955+0000 7f0110c00640 1 -- start start 2024-08-17T02:27:08.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.955+0000 7f0110c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f010c0af130 0x7f010c169100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.955+0000 7f0110c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f010c0b2370 0x7f010c15d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.956+0000 7f0110c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f010c158b90 0x7f010c15eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.956+0000 7f0110c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c15ddd0 con 0x7f010c0b2370 2024-08-17T02:27:08.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.956+0000 7f0110c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c15daf0 con 0x7f010c158b90 2024-08-17T02:27:08.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.956+0000 7f0110c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010c1590e0 con 0x7f010c0af130 2024-08-17T02:27:08.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.956+0000 7f0109400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f010c0b2370 0x7f010c15d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.956+0000 7f0109400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f010c0b2370 0x7f010c15d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33626/0 (socket says 172.21.15.6:33626) 2024-08-17T02:27:08.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.956+0000 7f0109400640 1 -- 172.21.15.6:0/3122722873 learned_addr learned my addr 172.21.15.6:0/3122722873 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:08.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.956+0000 7f010a800640 1 --2- 172.21.15.6:0/3122722873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f010c158b90 0x7f010c15eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.956+0000 7f0109e00640 1 --2- 172.21.15.6:0/3122722873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f010c0af130 0x7f010c169100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.956+0000 7f0109400640 1 -- 172.21.15.6:0/3122722873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f010c0af130 msgr2=0x7f010c169100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.956+0000 7f0109400640 1 --2- 172.21.15.6:0/3122722873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f010c0af130 0x7f010c169100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.956+0000 7f0109400640 1 -- 172.21.15.6:0/3122722873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f010c158b90 msgr2=0x7f010c15eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.956+0000 7f0109400640 1 --2- 172.21.15.6:0/3122722873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f010c158b90 0x7f010c15eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.956+0000 7f0109400640 1 -- 172.21.15.6:0/3122722873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00fc009450 con 0x7f010c0b2370 2024-08-17T02:27:08.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.957+0000 7f0109400640 1 --2- 172.21.15.6:0/3122722873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f010c0b2370 0x7f010c15d1f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c590 tx=0x7f00f8007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.957+0000 7f0101600640 1 -- 172.21.15.6:0/3122722873 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8011590 con 0x7f010c0b2370 2024-08-17T02:27:08.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.957+0000 7f0101600640 1 -- 172.21.15.6:0/3122722873 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f8011710 con 0x7f010c0b2370 2024-08-17T02:27:08.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.957+0000 7f0110c00640 1 -- 172.21.15.6:0/3122722873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010c1593c0 con 0x7f010c0b2370 2024-08-17T02:27:08.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.957+0000 7f0101600640 1 -- 172.21.15.6:0/3122722873 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8011ad0 con 0x7f010c0b2370 2024-08-17T02:27:08.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.957+0000 7f0110c00640 1 -- 172.21.15.6:0/3122722873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010c15d730 con 0x7f010c0b2370 2024-08-17T02:27:08.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.958+0000 7f0110c00640 1 -- 172.21.15.6:0/3122722873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010c063fb0 con 0x7f010c0b2370 2024-08-17T02:27:08.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.959+0000 7f0101600640 1 -- 172.21.15.6:0/3122722873 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f00f801c460 con 0x7f010c0b2370 2024-08-17T02:27:08.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.959+0000 7f0101600640 1 --2- 172.21.15.6:0/3122722873 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f00ec065150 0x7f00ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.960+0000 7f0101600640 1 -- 172.21.15.6:0/3122722873 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00f8081ff0 con 0x7f010c0b2370 2024-08-17T02:27:08.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.960+0000 7f0109e00640 1 --2- 172.21.15.6:0/3122722873 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f00ec065150 0x7f00ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.961+0000 7f0109e00640 1 --2- 172.21.15.6:0/3122722873 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f00ec065150 0x7f00ec067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f00fc034000 tx=0x7f00fc032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:08.963+0000 7f0101600640 1 -- 172.21.15.6:0/3122722873 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f00f8050120 con 0x7f010c0b2370 2024-08-17T02:27:09.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.145+0000 7f0110c00640 1 -- 172.21.15.6:0/3122722873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f010c0ce610 con 0x7f010c0b2370 2024-08-17T02:27:09.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.146+0000 7f0101600640 1 -- 172.21.15.6:0/3122722873 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f00f8053740 con 0x7f010c0b2370 2024-08-17T02:27:09.147 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:09.147 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:33.190571+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:29.257601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:30.596556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:09.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.148+0000 7f0110c00640 1 -- 172.21.15.6:0/3122722873 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f00ec065150 msgr2=0x7f00ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.148+0000 7f0110c00640 1 --2- 172.21.15.6:0/3122722873 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f00ec065150 0x7f00ec067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f00fc034000 tx=0x7f00fc032000 comp rx=0 tx=0).stop 2024-08-17T02:27:09.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.148+0000 7f0110c00640 1 -- 172.21.15.6:0/3122722873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f010c0b2370 msgr2=0x7f010c15d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.148+0000 7f0110c00640 1 --2- 172.21.15.6:0/3122722873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f010c0b2370 0x7f010c15d1f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c590 tx=0x7f00f8007e80 comp rx=0 tx=0).stop 2024-08-17T02:27:09.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.149+0000 7f0110c00640 1 -- 172.21.15.6:0/3122722873 shutdown_connections 2024-08-17T02:27:09.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.149+0000 7f0110c00640 1 --2- 172.21.15.6:0/3122722873 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f00ec065150 0x7f00ec067600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.149+0000 7f0110c00640 1 --2- 172.21.15.6:0/3122722873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f010c158b90 0x7f010c15eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.149+0000 7f0110c00640 1 --2- 172.21.15.6:0/3122722873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f010c0b2370 0x7f010c15d1f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.149+0000 7f0110c00640 1 --2- 172.21.15.6:0/3122722873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f010c0af130 0x7f010c169100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.149+0000 7f0110c00640 1 -- 172.21.15.6:0/3122722873 >> 172.21.15.6:0/3122722873 conn(0x7f010c06e590 msgr2=0x7f010c0b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.149+0000 7f0110c00640 1 -- 172.21.15.6:0/3122722873 shutdown_connections 2024-08-17T02:27:09.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.149+0000 7f0110c00640 1 -- 172.21.15.6:0/3122722873 wait complete. 2024-08-17T02:27:09.164 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:27:09.165 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.314+0000 7f1bbf200640 1 Processor -- start 2024-08-17T02:27:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.315+0000 7f1bbf200640 1 -- start start 2024-08-17T02:27:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.316+0000 7f1bbf200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bc00ca430 0x7f1bc00adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.316+0000 7f1bbf200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1bc01552d0 0x7f1bc0155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.316+0000 7f1bbf200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc00cb180 con 0x7f1bc00ad790 2024-08-17T02:27:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.316+0000 7f1bbf200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc00af530 con 0x7f1bc01552d0 2024-08-17T02:27:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.316+0000 7f1bbf200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00ca8e0 con 0x7f1bc00ca430 2024-08-17T02:27:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.316+0000 7f1bbe800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1bc01552d0 0x7f1bc0155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.316+0000 7f1bbe800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1bc01552d0 0x7f1bc0155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33636/0 (socket says 172.21.15.6:33636) 2024-08-17T02:27:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.316+0000 7f1bbe800640 1 -- 172.21.15.6:0/1565994335 learned_addr learned my addr 172.21.15.6:0/1565994335 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.316+0000 7f1bb7e00640 1 --2- 172.21.15.6:0/1565994335 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bc00ca430 0x7f1bc00adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.317+0000 7f1bbe800640 1 -- 172.21.15.6:0/1565994335 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bc00ca430 msgr2=0x7f1bc00adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.317+0000 7f1bbe800640 1 --2- 172.21.15.6:0/1565994335 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bc00ca430 0x7f1bc00adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.317+0000 7f1bbe800640 1 -- 172.21.15.6:0/1565994335 >> v1:172.21.15.136:6789/0 conn(0x7f1bc00ad790 legacy=0x7f1bc00c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.317+0000 7f1bbe800640 1 -- 172.21.15.6:0/1565994335 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc00cabc0 con 0x7f1bc01552d0 2024-08-17T02:27:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.318+0000 7f1bbe800640 1 --2- 172.21.15.6:0/1565994335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc01552d0 0x7f1bc0155750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009f20 tx=0x7f1bb8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47637e990c8c330d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.318+0000 7f1bbd400640 1 -- 172.21.15.6:0/1565994335 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8031400 con 0x7f1bc01552d0 2024-08-17T02:27:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.318+0000 7f1bbd400640 1 -- 172.21.15.6:0/1565994335 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb802d050 con 0x7f1bc01552d0 2024-08-17T02:27:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.318+0000 7f1bbd400640 1 -- 172.21.15.6:0/1565994335 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80317d0 con 0x7f1bc01552d0 2024-08-17T02:27:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.319+0000 7f1bbf200640 1 -- 172.21.15.6:0/1565994335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc01552d0 msgr2=0x7f1bc0155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.319+0000 7f1bbf200640 1 --2- 172.21.15.6:0/1565994335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc01552d0 0x7f1bc0155750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009f20 tx=0x7f1bb8009840 comp rx=0 tx=0).stop 2024-08-17T02:27:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.319+0000 7f1bbf200640 1 -- 172.21.15.6:0/1565994335 shutdown_connections 2024-08-17T02:27:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.319+0000 7f1bbf200640 1 --2- 172.21.15.6:0/1565994335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc01552d0 0x7f1bc0155750 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.319+0000 7f1bbf200640 1 --2- 172.21.15.6:0/1565994335 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bc00ca430 0x7f1bc00adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.319+0000 7f1bbf200640 1 -- 172.21.15.6:0/1565994335 >> 172.21.15.6:0/1565994335 conn(0x7f1bc0062af0 msgr2=0x7f1bc0062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.319+0000 7f1bbf200640 1 -- 172.21.15.6:0/1565994335 shutdown_connections 2024-08-17T02:27:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.319+0000 7f1bbf200640 1 -- 172.21.15.6:0/1565994335 wait complete. 2024-08-17T02:27:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.320+0000 7f1bbf200640 1 Processor -- start 2024-08-17T02:27:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.320+0000 7f1bbf200640 1 -- start start 2024-08-17T02:27:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.321+0000 7f1bbf200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc00ad790 0x7f1bc0158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.321+0000 7f1bbf200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bc00ca430 0x7f1bc0153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.321+0000 7f1bbf200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bc01552d0 0x7f1bc0143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.321+0000 7f1bbf200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00ad3b0 con 0x7f1bc00ad790 2024-08-17T02:27:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.321+0000 7f1bbf200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc016ca60 con 0x7f1bc00ca430 2024-08-17T02:27:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.321+0000 7f1bbf200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00ad0d0 con 0x7f1bc01552d0 2024-08-17T02:27:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.321+0000 7f1bbde00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc00ad790 0x7f1bc0158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.321+0000 7f1bbde00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc00ad790 0x7f1bc0158010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33652/0 (socket says 172.21.15.6:33652) 2024-08-17T02:27:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.321+0000 7f1bbde00640 1 -- 172.21.15.6:0/1019619414 learned_addr learned my addr 172.21.15.6:0/1019619414 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.321+0000 7f1bbe800640 1 --2- 172.21.15.6:0/1019619414 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bc01552d0 0x7f1bc0143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.321+0000 7f1bb7e00640 1 --2- 172.21.15.6:0/1019619414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bc00ca430 0x7f1bc0153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.322+0000 7f1bbde00640 1 -- 172.21.15.6:0/1019619414 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bc01552d0 msgr2=0x7f1bc0143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.322+0000 7f1bbde00640 1 --2- 172.21.15.6:0/1019619414 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bc01552d0 0x7f1bc0143e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.322+0000 7f1bbde00640 1 -- 172.21.15.6:0/1019619414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bc00ca430 msgr2=0x7f1bc0153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.322+0000 7f1bbde00640 1 --2- 172.21.15.6:0/1019619414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bc00ca430 0x7f1bc0153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.322+0000 7f1bbde00640 1 -- 172.21.15.6:0/1019619414 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb8009ae0 con 0x7f1bc00ad790 2024-08-17T02:27:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.322+0000 7f1bb7e00640 1 --2- 172.21.15.6:0/1019619414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bc00ca430 0x7f1bc0153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.322+0000 7f1bbe800640 1 --2- 172.21.15.6:0/1019619414 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bc01552d0 0x7f1bc0143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.322+0000 7f1bbde00640 1 --2- 172.21.15.6:0/1019619414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc00ad790 0x7f1bc0158010 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000c590 tx=0x7f1bb0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.322+0000 7f1bb5600640 1 -- 172.21.15.6:0/1019619414 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0012630 con 0x7f1bc00ad790 2024-08-17T02:27:09.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.322+0000 7f1bb5600640 1 -- 172.21.15.6:0/1019619414 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb00127b0 con 0x7f1bc00ad790 2024-08-17T02:27:09.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.322+0000 7f1bb5600640 1 -- 172.21.15.6:0/1019619414 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0012b70 con 0x7f1bc00ad790 2024-08-17T02:27:09.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.322+0000 7f1bbf200640 1 -- 172.21.15.6:0/1019619414 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc016c410 con 0x7f1bc00ad790 2024-08-17T02:27:09.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.322+0000 7f1bbf200640 1 -- 172.21.15.6:0/1019619414 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc0158550 con 0x7f1bc00ad790 2024-08-17T02:27:09.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.323+0000 7f1bbf200640 1 -- 172.21.15.6:0/1019619414 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc0070720 con 0x7f1bc00ad790 2024-08-17T02:27:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.324+0000 7f1bb5600640 1 -- 172.21.15.6:0/1019619414 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1bb001b400 con 0x7f1bc00ad790 2024-08-17T02:27:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.325+0000 7f1bb5600640 1 --2- 172.21.15.6:0/1019619414 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1b9c065150 0x7f1b9c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.325+0000 7f1bb5600640 1 -- 172.21.15.6:0/1019619414 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1bb0081fe0 con 0x7f1bc00ad790 2024-08-17T02:27:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.325+0000 7f1bb7e00640 1 --2- 172.21.15.6:0/1019619414 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1b9c065150 0x7f1b9c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.326+0000 7f1bb7e00640 1 --2- 172.21.15.6:0/1019619414 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1b9c065150 0x7f1b9c067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8006fd0 tx=0x7f1ba8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.329+0000 7f1bb5600640 1 -- 172.21.15.6:0/1019619414 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1bb0050000 con 0x7f1bc00ad790 2024-08-17T02:27:09.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.552+0000 7f1bbf200640 1 -- 172.21.15.6:0/1019619414 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bc00af810 con 0x7f1bc00ad790 2024-08-17T02:27:09.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.552+0000 7f1bb5600640 1 -- 172.21.15.6:0/1019619414 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4582 (secure 0 0 0) 0x7f1bb0053620 con 0x7f1bc00ad790 2024-08-17T02:27:09.553 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:09.553 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/881817227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":881817227},{"type":"v1","addr":"172.21.15.6:6833","nonce":881817227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/546855411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":546855411},{"type":"v1","addr":"172.21.15.6:6835","nonce":546855411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/539185499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":539185499},{"type":"v1","addr":"172.21.15.136:6837","nonce":539185499}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:31.615645+0000","modified":"2024-08-17T02:26:35.207397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/2230598578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2230598578},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230598578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:09.553 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2024-08-17T02:27:09.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.554+0000 7f1bbf200640 1 -- 172.21.15.6:0/1019619414 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1b9c065150 msgr2=0x7f1b9c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.554+0000 7f1bbf200640 1 --2- 172.21.15.6:0/1019619414 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1b9c065150 0x7f1b9c067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8006fd0 tx=0x7f1ba8008040 comp rx=0 tx=0).stop 2024-08-17T02:27:09.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.554+0000 7f1bbf200640 1 -- 172.21.15.6:0/1019619414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc00ad790 msgr2=0x7f1bc0158010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.554+0000 7f1bbf200640 1 --2- 172.21.15.6:0/1019619414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc00ad790 0x7f1bc0158010 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000c590 tx=0x7f1bb0007ef0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.555+0000 7f1bbf200640 1 -- 172.21.15.6:0/1019619414 shutdown_connections 2024-08-17T02:27:09.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.555+0000 7f1bbf200640 1 --2- 172.21.15.6:0/1019619414 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1b9c065150 0x7f1b9c067600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.555+0000 7f1bbf200640 1 --2- 172.21.15.6:0/1019619414 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bc01552d0 0x7f1bc0143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.555+0000 7f1bbf200640 1 --2- 172.21.15.6:0/1019619414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bc00ca430 0x7f1bc0153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.555+0000 7f1bbf200640 1 --2- 172.21.15.6:0/1019619414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc00ad790 0x7f1bc0158010 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.555+0000 7f1bbf200640 1 -- 172.21.15.6:0/1019619414 >> 172.21.15.6:0/1019619414 conn(0x7f1bc0062af0 msgr2=0x7f1bc0154380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.555+0000 7f1bbf200640 1 -- 172.21.15.6:0/1019619414 shutdown_connections 2024-08-17T02:27:09.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.555+0000 7f1bbf200640 1 -- 172.21.15.6:0/1019619414 wait complete. 2024-08-17T02:27:09.571 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:09.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.721+0000 7f0872e00640 1 Processor -- start 2024-08-17T02:27:09.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.721+0000 7f0872e00640 1 -- start start 2024-08-17T02:27:09.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.722+0000 7f0872e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c155040 0x7f086c158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.722+0000 7f0872e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f086c1591c0 0x7f086c06e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.722+0000 7f0872e00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c0aeeb0 con 0x7f086c06e5a0 2024-08-17T02:27:09.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.722+0000 7f0872e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c159610 con 0x7f086c1591c0 2024-08-17T02:27:09.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.722+0000 7f0872e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c06e9e0 con 0x7f086c155040 2024-08-17T02:27:09.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.723+0000 7f0870e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f086c06e5a0 0x7f086c0ab3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47800/0 (socket says 172.21.15.6:47800) 2024-08-17T02:27:09.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.723+0000 7f0870e00640 1 -- 172.21.15.6:0/112085821 learned_addr learned my addr 172.21.15.6:0/112085821 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:09.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.723+0000 7f086b400640 1 --2- 172.21.15.6:0/112085821 >> v2:172.21.15.136:3300/0 conn(0x7f086c1591c0 0x7f086c06e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.723+0000 7f086be00640 1 --2- 172.21.15.6:0/112085821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c155040 0x7f086c158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.723+0000 7f086aa00640 1 -- 172.21.15.6:0/112085821 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445958847 0 0) 0x7f086c0aeeb0 con 0x7f086c06e5a0 2024-08-17T02:27:09.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.723+0000 7f086aa00640 1 -- 172.21.15.6:0/112085821 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08500034e0 con 0x7f086c06e5a0 2024-08-17T02:27:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.723+0000 7f086aa00640 1 -- 172.21.15.6:0/112085821 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3295175204 0 0) 0x7f08500034e0 con 0x7f086c06e5a0 2024-08-17T02:27:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.723+0000 7f086aa00640 1 -- 172.21.15.6:0/112085821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c155040 msgr2=0x7f086c158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.723+0000 7f086aa00640 1 --2- 172.21.15.6:0/112085821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c155040 0x7f086c158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.723+0000 7f086aa00640 1 -- 172.21.15.6:0/112085821 >> v2:172.21.15.136:3300/0 conn(0x7f086c1591c0 msgr2=0x7f086c06e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.723+0000 7f086aa00640 1 --2- 172.21.15.6:0/112085821 >> v2:172.21.15.136:3300/0 conn(0x7f086c1591c0 0x7f086c06e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.723+0000 7f086aa00640 1 -- 172.21.15.6:0/112085821 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c0aadd0 con 0x7f086c06e5a0 2024-08-17T02:27:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.723+0000 7f086aa00640 1 -- 172.21.15.6:0/112085821 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f08640017f0 con 0x7f086c06e5a0 2024-08-17T02:27:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.723+0000 7f086aa00640 1 -- 172.21.15.6:0/112085821 >> v1:172.21.15.6:6789/0 conn(0x7f086c06e5a0 legacy=0x7f086c0ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.724+0000 7f086aa00640 1 --2- 172.21.15.6:0/112085821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c155040 0x7f0850003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.724+0000 7f086aa00640 1 --2- 172.21.15.6:0/112085821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0850004020 0x7f0850004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.724+0000 7f086aa00640 1 --2- 172.21.15.6:0/112085821 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0850004cc0 0x7f0850005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.724+0000 7f086aa00640 1 -- 172.21.15.6:0/112085821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c159610 con 0x7f0850004020 2024-08-17T02:27:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.724+0000 7f086aa00640 1 -- 172.21.15.6:0/112085821 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c06e9e0 con 0x7f0850004cc0 2024-08-17T02:27:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.724+0000 7f086aa00640 1 -- 172.21.15.6:0/112085821 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085000bad0 con 0x7f086c155040 2024-08-17T02:27:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.724+0000 7f086b400640 1 --2- 172.21.15.6:0/112085821 >> v2:172.21.15.136:3300/0 conn(0x7f086c1591c0 0x7f086c06e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.724+0000 7f086b400640 1 --2- 172.21.15.6:0/112085821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0850004020 0x7f0850004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.724+0000 7f086be00640 1 --2- 172.21.15.6:0/112085821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c155040 0x7f0850003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.724+0000 7f0870e00640 1 --2- 172.21.15.6:0/112085821 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0850004cc0 0x7f0850005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.724+0000 7f086b400640 1 -- 172.21.15.6:0/112085821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c155040 msgr2=0x7f0850003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.724+0000 7f086b400640 1 --2- 172.21.15.6:0/112085821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c155040 0x7f0850003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.724+0000 7f086b400640 1 -- 172.21.15.6:0/112085821 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0850004cc0 msgr2=0x7f0850005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.724+0000 7f086b400640 1 --2- 172.21.15.6:0/112085821 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0850004cc0 0x7f0850005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.724+0000 7f086b400640 1 -- 172.21.15.6:0/112085821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08500034e0 con 0x7f0850004020 2024-08-17T02:27:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.725+0000 7f086b400640 1 --2- 172.21.15.6:0/112085821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0850004020 0x7f0850004780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0858006e70 tx=0x7f08580090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9bd31918122461 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.726+0000 7f086aa00640 1 -- 172.21.15.6:0/112085821 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858031400 con 0x7f0850004020 2024-08-17T02:27:09.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.726+0000 7f086aa00640 1 -- 172.21.15.6:0/112085821 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085802d050 con 0x7f0850004020 2024-08-17T02:27:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.726+0000 7f086aa00640 1 -- 172.21.15.6:0/112085821 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858031790 con 0x7f0850004020 2024-08-17T02:27:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.726+0000 7f0872e00640 1 -- 172.21.15.6:0/112085821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0850004020 msgr2=0x7f0850004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.726+0000 7f0872e00640 1 --2- 172.21.15.6:0/112085821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0850004020 0x7f0850004780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0858006e70 tx=0x7f08580090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.726+0000 7f0870e00640 1 -- 172.21.15.6:0/112085821 reap_dead start 2024-08-17T02:27:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.726+0000 7f0872e00640 1 -- 172.21.15.6:0/112085821 shutdown_connections 2024-08-17T02:27:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.726+0000 7f0872e00640 1 -- 172.21.15.6:0/112085821 >> 172.21.15.6:0/112085821 conn(0x7f086c066e60 msgr2=0x7f086c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.726+0000 7f0872e00640 1 -- 172.21.15.6:0/112085821 shutdown_connections 2024-08-17T02:27:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.726+0000 7f0872e00640 1 -- 172.21.15.6:0/112085821 wait complete. 2024-08-17T02:27:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.728+0000 7f0872e00640 1 Processor -- start 2024-08-17T02:27:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.728+0000 7f0872e00640 1 -- start start 2024-08-17T02:27:09.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.729+0000 7f0872e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0850004020 0x7f086c0a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.729+0000 7f0872e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f086c154500 0x7f086c167160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.729+0000 7f0872e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c154950 0x7f086c1676a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.729+0000 7f0872e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c1583f0 con 0x7f0850004020 2024-08-17T02:27:09.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.729+0000 7f0872e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c1577e0 con 0x7f086c154500 2024-08-17T02:27:09.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.729+0000 7f0872e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c157ac0 con 0x7f086c154950 2024-08-17T02:27:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.729+0000 7f086be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0850004020 0x7f086c0a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.729+0000 7f086be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0850004020 0x7f086c0a5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33674/0 (socket says 172.21.15.6:33674) 2024-08-17T02:27:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.729+0000 7f086be00640 1 -- 172.21.15.6:0/669425013 learned_addr learned my addr 172.21.15.6:0/669425013 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.729+0000 7f0870e00640 1 --2- 172.21.15.6:0/669425013 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c154950 0x7f086c1676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.729+0000 7f086b400640 1 --2- 172.21.15.6:0/669425013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f086c154500 0x7f086c167160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.729+0000 7f086be00640 1 -- 172.21.15.6:0/669425013 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c154950 msgr2=0x7f086c1676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.729+0000 7f086be00640 1 --2- 172.21.15.6:0/669425013 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c154950 0x7f086c1676a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.729+0000 7f086be00640 1 -- 172.21.15.6:0/669425013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f086c154500 msgr2=0x7f086c167160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.729+0000 7f086be00640 1 --2- 172.21.15.6:0/669425013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f086c154500 0x7f086c167160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.729+0000 7f086be00640 1 -- 172.21.15.6:0/669425013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c157da0 con 0x7f0850004020 2024-08-17T02:27:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.730+0000 7f086be00640 1 --2- 172.21.15.6:0/669425013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0850004020 0x7f086c0a5030 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f085c010a70 tx=0x7f085c012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.730+0000 7f0863400640 1 -- 172.21.15.6:0/669425013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c00eb30 con 0x7f0850004020 2024-08-17T02:27:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.730+0000 7f0863400640 1 -- 172.21.15.6:0/669425013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c00ec90 con 0x7f0850004020 2024-08-17T02:27:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.730+0000 7f0863400640 1 -- 172.21.15.6:0/669425013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c01a640 con 0x7f0850004020 2024-08-17T02:27:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.730+0000 7f0872e00640 1 -- 172.21.15.6:0/669425013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c158080 con 0x7f0850004020 2024-08-17T02:27:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.730+0000 7f0872e00640 1 -- 172.21.15.6:0/669425013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c0a5570 con 0x7f0850004020 2024-08-17T02:27:09.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.731+0000 7f0872e00640 1 -- 172.21.15.6:0/669425013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c063fb0 con 0x7f0850004020 2024-08-17T02:27:09.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.732+0000 7f0863400640 1 -- 172.21.15.6:0/669425013 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f085c01aa70 con 0x7f0850004020 2024-08-17T02:27:09.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.733+0000 7f0863400640 1 --2- 172.21.15.6:0/669425013 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f084c065180 0x7f084c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.733+0000 7f0863400640 1 -- 172.21.15.6:0/669425013 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f085c082460 con 0x7f0850004020 2024-08-17T02:27:09.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.733+0000 7f086b400640 1 --2- 172.21.15.6:0/669425013 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f084c065180 0x7f084c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.734+0000 7f086b400640 1 --2- 172.21.15.6:0/669425013 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f084c065180 0x7f084c067630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0858034000 tx=0x7f0858035000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.737+0000 7f0863400640 1 -- 172.21.15.6:0/669425013 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f085c050530 con 0x7f0850004020 2024-08-17T02:27:09.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.956+0000 7f0872e00640 1 -- 172.21.15.6:0/669425013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f086c06b440 con 0x7f0850004020 2024-08-17T02:27:09.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.956+0000 7f0863400640 1 -- 172.21.15.6:0/669425013 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4582 (secure 0 0 0) 0x7f085c053b50 con 0x7f0850004020 2024-08-17T02:27:09.957 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:09.957 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/881817227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":881817227},{"type":"v1","addr":"172.21.15.6:6833","nonce":881817227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/546855411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":546855411},{"type":"v1","addr":"172.21.15.6:6835","nonce":546855411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/539185499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":539185499},{"type":"v1","addr":"172.21.15.136:6837","nonce":539185499}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:31.615645+0000","modified":"2024-08-17T02:26:35.207397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/2230598578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2230598578},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230598578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:09.958 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2024-08-17T02:27:09.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.959+0000 7f0872e00640 1 -- 172.21.15.6:0/669425013 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f084c065180 msgr2=0x7f084c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.959+0000 7f0872e00640 1 --2- 172.21.15.6:0/669425013 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f084c065180 0x7f084c067630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0858034000 tx=0x7f0858035000 comp rx=0 tx=0).stop 2024-08-17T02:27:09.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.959+0000 7f0872e00640 1 -- 172.21.15.6:0/669425013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0850004020 msgr2=0x7f086c0a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.959+0000 7f0872e00640 1 --2- 172.21.15.6:0/669425013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0850004020 0x7f086c0a5030 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f085c010a70 tx=0x7f085c012040 comp rx=0 tx=0).stop 2024-08-17T02:27:09.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.959+0000 7f0872e00640 1 -- 172.21.15.6:0/669425013 shutdown_connections 2024-08-17T02:27:09.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.959+0000 7f0872e00640 1 --2- 172.21.15.6:0/669425013 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f084c065180 0x7f084c067630 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.959+0000 7f0872e00640 1 --2- 172.21.15.6:0/669425013 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c154950 0x7f086c1676a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.959+0000 7f0872e00640 1 --2- 172.21.15.6:0/669425013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f086c154500 0x7f086c167160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.959+0000 7f0872e00640 1 --2- 172.21.15.6:0/669425013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0850004020 0x7f086c0a5030 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.959+0000 7f0872e00640 1 -- 172.21.15.6:0/669425013 >> 172.21.15.6:0/669425013 conn(0x7f086c066e60 msgr2=0x7f086c0c9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.959+0000 7f0872e00640 1 -- 172.21.15.6:0/669425013 shutdown_connections 2024-08-17T02:27:09.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:09.959+0000 7f0872e00640 1 -- 172.21.15.6:0/669425013 wait complete. 2024-08-17T02:27:09.975 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:10.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.125+0000 7f3bc8400640 1 Processor -- start 2024-08-17T02:27:10.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.125+0000 7f3bc8400640 1 -- start start 2024-08-17T02:27:10.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.126+0000 7f3bc8400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3bc0155040 0x7f3bc0158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.126+0000 7f3bc8400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bc006e770 0x7f3bc00af340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.126+0000 7f3bc8400640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc00aeeb0 con 0x7f3bc01591c0 2024-08-17T02:27:10.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.126+0000 7f3bc8400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc0159610 con 0x7f3bc0155040 2024-08-17T02:27:10.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.126+0000 7f3bc8400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc00aadd0 con 0x7f3bc006e770 2024-08-17T02:27:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.126+0000 7f3bc5000640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3bc01591c0 0x7f3bc006e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47804/0 (socket says 172.21.15.6:47804) 2024-08-17T02:27:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.126+0000 7f3bc5000640 1 -- 172.21.15.6:0/3758356265 learned_addr learned my addr 172.21.15.6:0/3758356265 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.127+0000 7f3bc5a00640 1 --2- 172.21.15.6:0/3758356265 >> v2:172.21.15.136:3300/0 conn(0x7f3bc0155040 0x7f3bc0158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.127+0000 7f3bc6400640 1 --2- 172.21.15.6:0/3758356265 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bc006e770 0x7f3bc00af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.127+0000 7f3bbfe00640 1 -- 172.21.15.6:0/3758356265 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684075004 0 0) 0x7f3bc00aeeb0 con 0x7f3bc01591c0 2024-08-17T02:27:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.127+0000 7f3bbfe00640 1 -- 172.21.15.6:0/3758356265 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ba80034e0 con 0x7f3bc01591c0 2024-08-17T02:27:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.127+0000 7f3bbfe00640 1 -- 172.21.15.6:0/3758356265 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3073032957 0 0) 0x7f3ba80034e0 con 0x7f3bc01591c0 2024-08-17T02:27:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.127+0000 7f3bc5a00640 1 -- 172.21.15.6:0/3758356265 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bc006e770 msgr2=0x7f3bc00af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.127+0000 7f3bc5a00640 1 --2- 172.21.15.6:0/3758356265 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bc006e770 0x7f3bc00af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.127+0000 7f3bc5a00640 1 -- 172.21.15.6:0/3758356265 >> v1:172.21.15.6:6789/0 conn(0x7f3bc01591c0 legacy=0x7f3bc006e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.127+0000 7f3bc5a00640 1 -- 172.21.15.6:0/3758356265 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc01597f0 con 0x7f3bc0155040 2024-08-17T02:27:10.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.128+0000 7f3bc5a00640 1 --2- 172.21.15.6:0/3758356265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bc0155040 0x7f3bc0158c80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009850 tx=0x7f3bb40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58c0416b890e4d35 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.129+0000 7f3bbfe00640 1 -- 172.21.15.6:0/3758356265 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac001470 con 0x7f3bc0155040 2024-08-17T02:27:10.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.129+0000 7f3bbfe00640 1 -- 172.21.15.6:0/3758356265 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb402a9c0 con 0x7f3bc0155040 2024-08-17T02:27:10.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.129+0000 7f3bbfe00640 1 -- 172.21.15.6:0/3758356265 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb402ad40 con 0x7f3bc0155040 2024-08-17T02:27:10.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.129+0000 7f3bc8400640 1 -- 172.21.15.6:0/3758356265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bc0155040 msgr2=0x7f3bc0158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.129+0000 7f3bc8400640 1 --2- 172.21.15.6:0/3758356265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bc0155040 0x7f3bc0158c80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009850 tx=0x7f3bb40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.129+0000 7f3bc8400640 1 -- 172.21.15.6:0/3758356265 shutdown_connections 2024-08-17T02:27:10.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.129+0000 7f3bc8400640 1 --2- 172.21.15.6:0/3758356265 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bc006e770 0x7f3bc00af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.129+0000 7f3bc8400640 1 --2- 172.21.15.6:0/3758356265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bc0155040 0x7f3bc0158c80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.129+0000 7f3bc8400640 1 -- 172.21.15.6:0/3758356265 >> 172.21.15.6:0/3758356265 conn(0x7f3bc0066e60 msgr2=0x7f3bc0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.129+0000 7f3bc8400640 1 -- 172.21.15.6:0/3758356265 shutdown_connections 2024-08-17T02:27:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.129+0000 7f3bc8400640 1 -- 172.21.15.6:0/3758356265 wait complete. 2024-08-17T02:27:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.131+0000 7f3bc8400640 1 Processor -- start 2024-08-17T02:27:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.131+0000 7f3bc8400640 1 -- start start 2024-08-17T02:27:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.132+0000 7f3bc8400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bc006e770 0x7f3bc014c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.132+0000 7f3bc8400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc0155040 0x7f3bc016c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.132+0000 7f3bc8400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bc01591c0 0x7f3bc016cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.132+0000 7f3bc8400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc014f9e0 con 0x7f3bc0155040 2024-08-17T02:27:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.132+0000 7f3bc8400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc006b7c0 con 0x7f3bc01591c0 2024-08-17T02:27:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.132+0000 7f3bc8400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc014ff80 con 0x7f3bc006e770 2024-08-17T02:27:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.132+0000 7f3bc5000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc0155040 0x7f3bc016c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.132+0000 7f3bc5000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc0155040 0x7f3bc016c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33680/0 (socket says 172.21.15.6:33680) 2024-08-17T02:27:10.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.132+0000 7f3bc5000640 1 -- 172.21.15.6:0/2683945314 learned_addr learned my addr 172.21.15.6:0/2683945314 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:10.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.132+0000 7f3bc6400640 1 --2- 172.21.15.6:0/2683945314 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bc01591c0 0x7f3bc016cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.132+0000 7f3bc5000640 1 -- 172.21.15.6:0/2683945314 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bc006e770 msgr2=0x7f3bc014c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.132+0000 7f3bc5000640 1 --2- 172.21.15.6:0/2683945314 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bc006e770 0x7f3bc014c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.132+0000 7f3bc5000640 1 -- 172.21.15.6:0/2683945314 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bc01591c0 msgr2=0x7f3bc016cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.132+0000 7f3bc5000640 1 --2- 172.21.15.6:0/2683945314 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bc01591c0 0x7f3bc016cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.133+0000 7f3bc5000640 1 -- 172.21.15.6:0/2683945314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb4009390 con 0x7f3bc0155040 2024-08-17T02:27:10.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.133+0000 7f3bc5000640 1 --2- 172.21.15.6:0/2683945314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc0155040 0x7f3bc016c7f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00cbc0 tx=0x7f3bac001a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.133+0000 7f3bbcc00640 1 -- 172.21.15.6:0/2683945314 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac007360 con 0x7f3bc0155040 2024-08-17T02:27:10.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.133+0000 7f3bbcc00640 1 -- 172.21.15.6:0/2683945314 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac0074e0 con 0x7f3bc0155040 2024-08-17T02:27:10.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.133+0000 7f3bbcc00640 1 -- 172.21.15.6:0/2683945314 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0049f0 con 0x7f3bc0155040 2024-08-17T02:27:10.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.133+0000 7f3bc8400640 1 -- 172.21.15.6:0/2683945314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc006b200 con 0x7f3bc0155040 2024-08-17T02:27:10.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.133+0000 7f3bc8400640 1 -- 172.21.15.6:0/2683945314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc014fc10 con 0x7f3bc0155040 2024-08-17T02:27:10.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.134+0000 7f3bc8400640 1 -- 172.21.15.6:0/2683945314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc0063fb0 con 0x7f3bc0155040 2024-08-17T02:27:10.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.135+0000 7f3bbcc00640 1 -- 172.21.15.6:0/2683945314 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3bac00a640 con 0x7f3bc0155040 2024-08-17T02:27:10.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.136+0000 7f3bbcc00640 1 --2- 172.21.15.6:0/2683945314 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3ba0065150 0x7f3ba0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.136+0000 7f3bbcc00640 1 -- 172.21.15.6:0/2683945314 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3bac081840 con 0x7f3bc0155040 2024-08-17T02:27:10.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.136+0000 7f3bc5a00640 1 --2- 172.21.15.6:0/2683945314 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3ba0065150 0x7f3ba0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.137+0000 7f3bc5a00640 1 --2- 172.21.15.6:0/2683945314 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3ba0065150 0x7f3ba0067600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4034000 tx=0x7f3bb4032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.139+0000 7f3bbcc00640 1 -- 172.21.15.6:0/2683945314 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3bac04f8e0 con 0x7f3bc0155040 2024-08-17T02:27:10.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.324+0000 7f3bc8400640 1 -- 172.21.15.6:0/2683945314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bc01500c0 con 0x7f3bc0155040 2024-08-17T02:27:10.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.325+0000 7f3bbcc00640 1 -- 172.21.15.6:0/2683945314 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f3bac018090 con 0x7f3bc0155040 2024-08-17T02:27:10.326 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:10.326 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:26:33.190571+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:29.257601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:30.596556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:10.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.327+0000 7f3bc8400640 1 -- 172.21.15.6:0/2683945314 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3ba0065150 msgr2=0x7f3ba0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.328+0000 7f3bc8400640 1 --2- 172.21.15.6:0/2683945314 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3ba0065150 0x7f3ba0067600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4034000 tx=0x7f3bb4032000 comp rx=0 tx=0).stop 2024-08-17T02:27:10.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.328+0000 7f3bc8400640 1 -- 172.21.15.6:0/2683945314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc0155040 msgr2=0x7f3bc016c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.328+0000 7f3bc8400640 1 --2- 172.21.15.6:0/2683945314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc0155040 0x7f3bc016c7f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00cbc0 tx=0x7f3bac001a90 comp rx=0 tx=0).stop 2024-08-17T02:27:10.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.328+0000 7f3bc8400640 1 -- 172.21.15.6:0/2683945314 shutdown_connections 2024-08-17T02:27:10.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.328+0000 7f3bc8400640 1 --2- 172.21.15.6:0/2683945314 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3ba0065150 0x7f3ba0067600 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.328+0000 7f3bc8400640 1 --2- 172.21.15.6:0/2683945314 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bc01591c0 0x7f3bc016cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.328+0000 7f3bc8400640 1 --2- 172.21.15.6:0/2683945314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc0155040 0x7f3bc016c7f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.328+0000 7f3bc8400640 1 --2- 172.21.15.6:0/2683945314 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bc006e770 0x7f3bc014c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.328+0000 7f3bc8400640 1 -- 172.21.15.6:0/2683945314 >> 172.21.15.6:0/2683945314 conn(0x7f3bc0066e60 msgr2=0x7f3bc00c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.328+0000 7f3bc8400640 1 -- 172.21.15.6:0/2683945314 shutdown_connections 2024-08-17T02:27:10.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.328+0000 7f3bc8400640 1 -- 172.21.15.6:0/2683945314 wait complete. 2024-08-17T02:27:10.344 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:27:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.495+0000 7f7431200640 1 Processor -- start 2024-08-17T02:27:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.495+0000 7f7431200640 1 -- start start 2024-08-17T02:27:10.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.497+0000 7f7431200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f742c158a20 0x7f742c0a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.497+0000 7f7431200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742c0aed90 con 0x7f742c0ae860 2024-08-17T02:27:10.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.497+0000 7f7431200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742c0af070 con 0x7f742c06dee0 2024-08-17T02:27:10.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.497+0000 7f7431200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f742c0af350 con 0x7f742c158a20 2024-08-17T02:27:10.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.497+0000 7f7429e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f742c158a20 0x7f742c0a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.497+0000 7f7429e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f742c158a20 0x7f742c0a89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33688/0 (socket says 172.21.15.6:33688) 2024-08-17T02:27:10.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.497+0000 7f7429e00640 1 -- 172.21.15.6:0/3418817624 learned_addr learned my addr 172.21.15.6:0/3418817624 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:10.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.497+0000 7f7423e00640 1 --1- 172.21.15.6:0/3418817624 >> v1:172.21.15.6:6789/0 conn(0x7f742c0ae860 0x7f742c06d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47810/0 (socket says 172.21.15.6:47810) 2024-08-17T02:27:10.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.497+0000 7f7429e00640 1 -- 172.21.15.6:0/3418817624 >> v1:172.21.15.136:6789/0 conn(0x7f742c06dee0 legacy=0x7f742c0afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:10.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.497+0000 7f7429e00640 1 -- 172.21.15.6:0/3418817624 >> v1:172.21.15.6:6789/0 conn(0x7f742c0ae860 legacy=0x7f742c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.497+0000 7f7429e00640 1 -- 172.21.15.6:0/3418817624 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c0af630 con 0x7f742c158a20 2024-08-17T02:27:10.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.497+0000 7f7429400640 1 -- 172.21.15.6:0/3418817624 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1574888400 0 0) 0x7f742c0aed90 con 0x7f742c0ae860 2024-08-17T02:27:10.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.498+0000 7f7429e00640 1 --2- 172.21.15.6:0/3418817624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742c158a20 0x7f742c0a89c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f741c009910 tx=0x7f741c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5fd2e3989da872b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.499+0000 7f7429400640 1 -- 172.21.15.6:0/3418817624 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c02ae60 con 0x7f742c158a20 2024-08-17T02:27:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.499+0000 7f7429400640 1 -- 172.21.15.6:0/3418817624 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741c032440 con 0x7f742c158a20 2024-08-17T02:27:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.499+0000 7f7429400640 1 -- 172.21.15.6:0/3418817624 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c0327e0 con 0x7f742c158a20 2024-08-17T02:27:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.499+0000 7f7431200640 1 -- 172.21.15.6:0/3418817624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742c158a20 msgr2=0x7f742c0a89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.499+0000 7f7431200640 1 --2- 172.21.15.6:0/3418817624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742c158a20 0x7f742c0a89c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f741c009910 tx=0x7f741c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.499+0000 7f7431200640 1 -- 172.21.15.6:0/3418817624 shutdown_connections 2024-08-17T02:27:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.499+0000 7f7431200640 1 --2- 172.21.15.6:0/3418817624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742c158a20 0x7f742c0a89c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.499+0000 7f7431200640 1 -- 172.21.15.6:0/3418817624 >> 172.21.15.6:0/3418817624 conn(0x7f742c066e60 msgr2=0x7f742c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.499+0000 7f7431200640 1 -- 172.21.15.6:0/3418817624 shutdown_connections 2024-08-17T02:27:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.499+0000 7f7431200640 1 -- 172.21.15.6:0/3418817624 wait complete. 2024-08-17T02:27:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.501+0000 7f7431200640 1 Processor -- start 2024-08-17T02:27:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.501+0000 7f7431200640 1 -- start start 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.502+0000 7f7431200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f742c06dee0 0x7f742c153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.502+0000 7f7431200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742c0ae860 0x7f742c145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.502+0000 7f7431200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f742c158a20 0x7f742c1563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.502+0000 7f7431200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c15b3e0 con 0x7f742c0ae860 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.502+0000 7f7431200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c15aab0 con 0x7f742c158a20 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.502+0000 7f7431200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742c15ad90 con 0x7f742c06dee0 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.502+0000 7f7423e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742c0ae860 0x7f742c145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.502+0000 7f7423e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742c0ae860 0x7f742c145410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33696/0 (socket says 172.21.15.6:33696) 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.502+0000 7f7423e00640 1 -- 172.21.15.6:0/2189017514 learned_addr learned my addr 172.21.15.6:0/2189017514 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.502+0000 7f7429e00640 1 --2- 172.21.15.6:0/2189017514 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f742c06dee0 0x7f742c153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.502+0000 7f742a800640 1 --2- 172.21.15.6:0/2189017514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f742c158a20 0x7f742c1563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.503+0000 7f7423e00640 1 -- 172.21.15.6:0/2189017514 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f742c06dee0 msgr2=0x7f742c153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.503+0000 7f7423e00640 1 --2- 172.21.15.6:0/2189017514 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f742c06dee0 0x7f742c153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.503+0000 7f7423e00640 1 -- 172.21.15.6:0/2189017514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f742c158a20 msgr2=0x7f742c1563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.503+0000 7f7423e00640 1 --2- 172.21.15.6:0/2189017514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f742c158a20 0x7f742c1563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.503+0000 7f7423e00640 1 -- 172.21.15.6:0/2189017514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c009450 con 0x7f742c0ae860 2024-08-17T02:27:10.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.503+0000 7f7429e00640 1 --2- 172.21.15.6:0/2189017514 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f742c06dee0 0x7f742c153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:10.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.503+0000 7f7423e00640 1 --2- 172.21.15.6:0/2189017514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742c0ae860 0x7f742c145410 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f741400c5b0 tx=0x7f7414007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.503+0000 7f7421600640 1 -- 172.21.15.6:0/2189017514 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414007300 con 0x7f742c0ae860 2024-08-17T02:27:10.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.503+0000 7f7421600640 1 -- 172.21.15.6:0/2189017514 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7414007480 con 0x7f742c0ae860 2024-08-17T02:27:10.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.503+0000 7f7421600640 1 -- 172.21.15.6:0/2189017514 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74140049f0 con 0x7f742c0ae860 2024-08-17T02:27:10.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.503+0000 7f7431200640 1 -- 172.21.15.6:0/2189017514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742c15b070 con 0x7f742c0ae860 2024-08-17T02:27:10.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.503+0000 7f7431200640 1 -- 172.21.15.6:0/2189017514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742c15a770 con 0x7f742c0ae860 2024-08-17T02:27:10.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.504+0000 7f7431200640 1 -- 172.21.15.6:0/2189017514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742c15b550 con 0x7f742c0ae860 2024-08-17T02:27:10.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.505+0000 7f7421600640 1 -- 172.21.15.6:0/2189017514 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f741401c3b0 con 0x7f742c0ae860 2024-08-17T02:27:10.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.506+0000 7f7421600640 1 --2- 172.21.15.6:0/2189017514 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7408065150 0x7f7408067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.506+0000 7f7421600640 1 -- 172.21.15.6:0/2189017514 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7414081980 con 0x7f742c0ae860 2024-08-17T02:27:10.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.506+0000 7f7429e00640 1 --2- 172.21.15.6:0/2189017514 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7408065150 0x7f7408067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.507+0000 7f7429e00640 1 --2- 172.21.15.6:0/2189017514 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7408065150 0x7f7408067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f741c034000 tx=0x7f741c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.510+0000 7f7421600640 1 -- 172.21.15.6:0/2189017514 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f741404fa20 con 0x7f742c0ae860 2024-08-17T02:27:10.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.729+0000 7f7431200640 1 -- 172.21.15.6:0/2189017514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f742c063fb0 con 0x7f742c0ae860 2024-08-17T02:27:10.730 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-08-17T02:27:10.730+0000 7f074d600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:27:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.735+0000 7f7421600640 1 -- 172.21.15.6:0/2189017514 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7414018090 con 0x7f742c0ae860 2024-08-17T02:27:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:27:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.738+0000 7f7431200640 1 -- 172.21.15.6:0/2189017514 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7408065150 msgr2=0x7f7408067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.738+0000 7f7431200640 1 --2- 172.21.15.6:0/2189017514 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7408065150 0x7f7408067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f741c034000 tx=0x7f741c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.738+0000 7f7431200640 1 -- 172.21.15.6:0/2189017514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742c0ae860 msgr2=0x7f742c145410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.738+0000 7f7431200640 1 --2- 172.21.15.6:0/2189017514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742c0ae860 0x7f742c145410 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f741400c5b0 tx=0x7f7414007d50 comp rx=0 tx=0).stop 2024-08-17T02:27:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.738+0000 7f7431200640 1 -- 172.21.15.6:0/2189017514 shutdown_connections 2024-08-17T02:27:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.738+0000 7f7431200640 1 --2- 172.21.15.6:0/2189017514 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7408065150 0x7f7408067600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.738+0000 7f7431200640 1 --2- 172.21.15.6:0/2189017514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f742c158a20 0x7f742c1563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.738+0000 7f7431200640 1 --2- 172.21.15.6:0/2189017514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742c0ae860 0x7f742c145410 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.738+0000 7f7431200640 1 --2- 172.21.15.6:0/2189017514 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f742c06dee0 0x7f742c153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.738+0000 7f7431200640 1 -- 172.21.15.6:0/2189017514 >> 172.21.15.6:0/2189017514 conn(0x7f742c066e60 msgr2=0x7f742c0cb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.738+0000 7f7431200640 1 -- 172.21.15.6:0/2189017514 shutdown_connections 2024-08-17T02:27:10.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.738+0000 7f7431200640 1 -- 172.21.15.6:0/2189017514 wait complete. 2024-08-17T02:27:10.740 INFO:tasks.ceph.mds.b.smithi136.stderr: -1968> 2024-08-17T02:26:36.521+0000 7f2571000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:27:10.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:27:10.783 INFO:tasks.ceph.mds.b.smithi136.stdout:starting mds.b at 2024-08-17T02:27:10.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.906+0000 7f4597e00640 1 Processor -- start 2024-08-17T02:27:10.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.906+0000 7f4597e00640 1 -- start start 2024-08-17T02:27:10.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.907+0000 7f4597e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45900afca0 0x7f45900b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.907+0000 7f4597e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45900acf10 0x7f4590159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.907+0000 7f4597e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459015a4e0 con 0x7f45901589a0 2024-08-17T02:27:10.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.907+0000 7f4597e00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45900b0980 con 0x7f45900afca0 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.907+0000 7f4597e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45900c92b0 con 0x7f45900acf10 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.907+0000 7f4595400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45900afca0 0x7f45900b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.907+0000 7f4595400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45900afca0 0x7f45900b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33700/0 (socket says 172.21.15.6:33700) 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.907+0000 7f4595400640 1 -- 172.21.15.6:0/3001474279 learned_addr learned my addr 172.21.15.6:0/3001474279 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.908+0000 7f4594a00640 1 --2- 172.21.15.6:0/3001474279 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45900acf10 0x7f4590159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.908+0000 7f4595400640 1 -- 172.21.15.6:0/3001474279 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45900acf10 msgr2=0x7f4590159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.908+0000 7f4595400640 1 --2- 172.21.15.6:0/3001474279 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45900acf10 0x7f4590159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.908+0000 7f4595400640 1 -- 172.21.15.6:0/3001474279 >> v1:172.21.15.136:6789/0 conn(0x7f45901589a0 legacy=0x7f459006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.908+0000 7f4595400640 1 -- 172.21.15.6:0/3001474279 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45900ad480 con 0x7f45900afca0 2024-08-17T02:27:10.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.909+0000 7f4595400640 1 --2- 172.21.15.6:0/3001474279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45900afca0 0x7f45900b0070 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4584009940 tx=0x7f45840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53312736337a9e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.909+0000 7f458fe00640 1 -- 172.21.15.6:0/3001474279 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458402ae40 con 0x7f45900afca0 2024-08-17T02:27:10.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.909+0000 7f458fe00640 1 -- 172.21.15.6:0/3001474279 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4584032440 con 0x7f45900afca0 2024-08-17T02:27:10.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.909+0000 7f458fe00640 1 -- 172.21.15.6:0/3001474279 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584032820 con 0x7f45900afca0 2024-08-17T02:27:10.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.910+0000 7f4597e00640 1 -- 172.21.15.6:0/3001474279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45900afca0 msgr2=0x7f45900b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.910+0000 7f4597e00640 1 --2- 172.21.15.6:0/3001474279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45900afca0 0x7f45900b0070 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4584009940 tx=0x7f45840091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.910+0000 7f4597e00640 1 -- 172.21.15.6:0/3001474279 shutdown_connections 2024-08-17T02:27:10.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.910+0000 7f4597e00640 1 --2- 172.21.15.6:0/3001474279 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45900acf10 0x7f4590159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.910+0000 7f4597e00640 1 --2- 172.21.15.6:0/3001474279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45900afca0 0x7f45900b0070 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.910+0000 7f4597e00640 1 -- 172.21.15.6:0/3001474279 >> 172.21.15.6:0/3001474279 conn(0x7f4590066e60 msgr2=0x7f4590067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.910+0000 7f4597e00640 1 -- 172.21.15.6:0/3001474279 shutdown_connections 2024-08-17T02:27:10.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.910+0000 7f4597e00640 1 -- 172.21.15.6:0/3001474279 wait complete. 2024-08-17T02:27:10.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.911+0000 7f4597e00640 1 Processor -- start 2024-08-17T02:27:10.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.911+0000 7f4597e00640 1 -- start start 2024-08-17T02:27:10.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.912+0000 7f4597e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45900acf10 0x7f45901441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.912+0000 7f4597e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45900afca0 0x7f45900ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.912+0000 7f4597e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45901589a0 0x7f45900c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.912+0000 7f4597e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45900cad60 con 0x7f45900acf10 2024-08-17T02:27:10.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.912+0000 7f4597e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4590142af0 con 0x7f45901589a0 2024-08-17T02:27:10.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.912+0000 7f4597e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4590143610 con 0x7f45900afca0 2024-08-17T02:27:10.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.913+0000 7f4595400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45900acf10 0x7f45901441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.913+0000 7f4595400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45900acf10 0x7f45901441f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33710/0 (socket says 172.21.15.6:33710) 2024-08-17T02:27:10.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.913+0000 7f4595400640 1 -- 172.21.15.6:0/2287983939 learned_addr learned my addr 172.21.15.6:0/2287983939 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:10.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.913+0000 7f4594a00640 1 --2- 172.21.15.6:0/2287983939 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45900afca0 0x7f45900ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.913+0000 7f4595e00640 1 --2- 172.21.15.6:0/2287983939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45901589a0 0x7f45900c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.913+0000 7f4595400640 1 -- 172.21.15.6:0/2287983939 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45900afca0 msgr2=0x7f45900ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.913+0000 7f4595400640 1 --2- 172.21.15.6:0/2287983939 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45900afca0 0x7f45900ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.913+0000 7f4595400640 1 -- 172.21.15.6:0/2287983939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45901589a0 msgr2=0x7f45900c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.913+0000 7f4595400640 1 --2- 172.21.15.6:0/2287983939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45901589a0 0x7f45900c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.913+0000 7f4595400640 1 -- 172.21.15.6:0/2287983939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4584009450 con 0x7f45900acf10 2024-08-17T02:27:10.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.913+0000 7f4595400640 1 --2- 172.21.15.6:0/2287983939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45900acf10 0x7f45901441f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4584035040 tx=0x7f4584032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.914+0000 7f458cc00640 1 -- 172.21.15.6:0/2287983939 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584031bb0 con 0x7f45900acf10 2024-08-17T02:27:10.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.914+0000 7f458cc00640 1 -- 172.21.15.6:0/2287983939 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4584031d30 con 0x7f45900acf10 2024-08-17T02:27:10.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.914+0000 7f458cc00640 1 -- 172.21.15.6:0/2287983939 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584031ea0 con 0x7f45900acf10 2024-08-17T02:27:10.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.914+0000 7f4597e00640 1 -- 172.21.15.6:0/2287983939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4590142d70 con 0x7f45900acf10 2024-08-17T02:27:10.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.914+0000 7f4597e00640 1 -- 172.21.15.6:0/2287983939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4590143330 con 0x7f45900acf10 2024-08-17T02:27:10.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.915+0000 7f4597e00640 1 -- 172.21.15.6:0/2287983939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4590063fb0 con 0x7f45900acf10 2024-08-17T02:27:10.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.916+0000 7f458cc00640 1 -- 172.21.15.6:0/2287983939 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4584039040 con 0x7f45900acf10 2024-08-17T02:27:10.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.916+0000 7f458cc00640 1 --2- 172.21.15.6:0/2287983939 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4570065150 0x7f4570067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.917+0000 7f458cc00640 1 -- 172.21.15.6:0/2287983939 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f458402ae40 con 0x7f45900acf10 2024-08-17T02:27:10.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.917+0000 7f4594a00640 1 --2- 172.21.15.6:0/2287983939 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4570065150 0x7f4570067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.918+0000 7f4594a00640 1 --2- 172.21.15.6:0/2287983939 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4570065150 0x7f4570067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4590145ab0 tx=0x7f457c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:10.920+0000 7f458cc00640 1 -- 172.21.15.6:0/2287983939 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f45840703e0 con 0x7f45900acf10 2024-08-17T02:27:11.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.139+0000 7f4597e00640 1 -- 172.21.15.6:0/2287983939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f45900b0b40 con 0x7f45900acf10 2024-08-17T02:27:11.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.738+0000 7f458cc00640 1 -- 172.21.15.6:0/2287983939 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4584073a00 con 0x7f45900acf10 2024-08-17T02:27:11.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.741+0000 7f4597e00640 1 -- 172.21.15.6:0/2287983939 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4570065150 msgr2=0x7f4570067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.741+0000 7f4597e00640 1 --2- 172.21.15.6:0/2287983939 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4570065150 0x7f4570067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4590145ab0 tx=0x7f457c008040 comp rx=0 tx=0).stop 2024-08-17T02:27:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.741+0000 7f4597e00640 1 -- 172.21.15.6:0/2287983939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45900acf10 msgr2=0x7f45901441f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.741+0000 7f4597e00640 1 --2- 172.21.15.6:0/2287983939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45900acf10 0x7f45901441f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4584035040 tx=0x7f4584032000 comp rx=0 tx=0).stop 2024-08-17T02:27:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.741+0000 7f4597e00640 1 -- 172.21.15.6:0/2287983939 shutdown_connections 2024-08-17T02:27:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.741+0000 7f4597e00640 1 --2- 172.21.15.6:0/2287983939 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4570065150 0x7f4570067600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.741+0000 7f4597e00640 1 --2- 172.21.15.6:0/2287983939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45901589a0 0x7f45900c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.741+0000 7f4597e00640 1 --2- 172.21.15.6:0/2287983939 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45900afca0 0x7f45900ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.741+0000 7f4597e00640 1 --2- 172.21.15.6:0/2287983939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45900acf10 0x7f45901441f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.741+0000 7f4597e00640 1 -- 172.21.15.6:0/2287983939 >> 172.21.15.6:0/2287983939 conn(0x7f4590066e60 msgr2=0x7f4590069830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.741+0000 7f4597e00640 1 -- 172.21.15.6:0/2287983939 shutdown_connections 2024-08-17T02:27:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.741+0000 7f4597e00640 1 -- 172.21.15.6:0/2287983939 wait complete. 2024-08-17T02:27:11.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:27:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.913+0000 7fa6a6800640 1 Processor -- start 2024-08-17T02:27:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.913+0000 7fa6a6800640 1 -- start start 2024-08-17T02:27:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.914+0000 7fa6a6800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa6a00ad020 0x7fa6a0159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.914+0000 7fa6a6800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa6a00afa00 0x7fa6a00afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.914+0000 7fa6a6800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a0159ad0 con 0x7fa6a00ac000 2024-08-17T02:27:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.914+0000 7fa6a6800640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a00b0380 con 0x7fa6a00ad020 2024-08-17T02:27:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.914+0000 7fa6a6800640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a00ad590 con 0x7fa6a00afa00 2024-08-17T02:27:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.915+0000 7fa69ea00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa6a00ad020 0x7fa6a0159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.915+0000 7fa69ea00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa6a00ad020 0x7fa6a0159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33716/0 (socket says 172.21.15.6:33716) 2024-08-17T02:27:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.915+0000 7fa69ea00640 1 -- 172.21.15.6:0/615038400 learned_addr learned my addr 172.21.15.6:0/615038400 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.915+0000 7fa69fe00640 1 --2- 172.21.15.6:0/615038400 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa6a00afa00 0x7fa6a00afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.915+0000 7fa69ea00640 1 -- 172.21.15.6:0/615038400 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa6a00afa00 msgr2=0x7fa6a00afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.915+0000 7fa69ea00640 1 --2- 172.21.15.6:0/615038400 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa6a00afa00 0x7fa6a00afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.915+0000 7fa69ea00640 1 -- 172.21.15.6:0/615038400 >> v1:172.21.15.136:6789/0 conn(0x7fa6a00ac000 legacy=0x7fa6a0156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.915+0000 7fa69ea00640 1 -- 172.21.15.6:0/615038400 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a00ad870 con 0x7fa6a00ad020 2024-08-17T02:27:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.916+0000 7fa69ea00640 1 --2- 172.21.15.6:0/615038400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a00ad020 0x7fa6a0159f60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa68c009910 tx=0x7fa68c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3906f1a889abd200 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.917+0000 7fa69e000640 1 -- 172.21.15.6:0/615038400 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c02adb0 con 0x7fa6a00ad020 2024-08-17T02:27:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.917+0000 7fa69e000640 1 -- 172.21.15.6:0/615038400 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c032440 con 0x7fa6a00ad020 2024-08-17T02:27:11.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.917+0000 7fa69e000640 1 -- 172.21.15.6:0/615038400 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c032820 con 0x7fa6a00ad020 2024-08-17T02:27:11.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.917+0000 7fa6a6800640 1 -- 172.21.15.6:0/615038400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a00ad020 msgr2=0x7fa6a0159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.917+0000 7fa6a6800640 1 --2- 172.21.15.6:0/615038400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a00ad020 0x7fa6a0159f60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa68c009910 tx=0x7fa68c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.917+0000 7fa6a6800640 1 -- 172.21.15.6:0/615038400 shutdown_connections 2024-08-17T02:27:11.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.917+0000 7fa6a6800640 1 --2- 172.21.15.6:0/615038400 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa6a00afa00 0x7fa6a00afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.917+0000 7fa6a6800640 1 --2- 172.21.15.6:0/615038400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a00ad020 0x7fa6a0159f60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.917+0000 7fa6a6800640 1 -- 172.21.15.6:0/615038400 >> 172.21.15.6:0/615038400 conn(0x7fa6a0066e60 msgr2=0x7fa6a0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:11.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.917+0000 7fa6a6800640 1 -- 172.21.15.6:0/615038400 shutdown_connections 2024-08-17T02:27:11.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.917+0000 7fa6a6800640 1 -- 172.21.15.6:0/615038400 wait complete. 2024-08-17T02:27:11.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.919+0000 7fa6a6800640 1 Processor -- start 2024-08-17T02:27:11.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.919+0000 7fa6a6800640 1 -- start start 2024-08-17T02:27:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.920+0000 7fa6a6800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa6a00ac000 0x7fa6a015a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.920+0000 7fa6a6800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a00ad020 0x7fa6a0140ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.920+0000 7fa6a6800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6a00afa00 0x7fa6a01579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.920+0000 7fa6a6800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a015aaa0 con 0x7fa6a00ad020 2024-08-17T02:27:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.920+0000 7fa6a6800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a015ad80 con 0x7fa6a00afa00 2024-08-17T02:27:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.920+0000 7fa6a6800640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a0157f20 con 0x7fa6a00ac000 2024-08-17T02:27:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.920+0000 7fa69ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a00ad020 0x7fa6a0140ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.920+0000 7fa69ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a00ad020 0x7fa6a0140ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33718/0 (socket says 172.21.15.6:33718) 2024-08-17T02:27:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.920+0000 7fa69ea00640 1 -- 172.21.15.6:0/1275325738 learned_addr learned my addr 172.21.15.6:0/1275325738 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.920+0000 7fa69fe00640 1 --2- 172.21.15.6:0/1275325738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6a00afa00 0x7fa6a01579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.920+0000 7fa69f400640 1 --2- 172.21.15.6:0/1275325738 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa6a00ac000 0x7fa6a015a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.920+0000 7fa69ea00640 1 -- 172.21.15.6:0/1275325738 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa6a00ac000 msgr2=0x7fa6a015a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.921+0000 7fa69ea00640 1 --2- 172.21.15.6:0/1275325738 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa6a00ac000 0x7fa6a015a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.921+0000 7fa69ea00640 1 -- 172.21.15.6:0/1275325738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6a00afa00 msgr2=0x7fa6a01579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.921+0000 7fa69ea00640 1 --2- 172.21.15.6:0/1275325738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6a00afa00 0x7fa6a01579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.921+0000 7fa69ea00640 1 -- 172.21.15.6:0/1275325738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c009450 con 0x7fa6a00ad020 2024-08-17T02:27:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.921+0000 7fa69fe00640 1 --2- 172.21.15.6:0/1275325738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6a00afa00 0x7fa6a01579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.921+0000 7fa69ea00640 1 --2- 172.21.15.6:0/1275325738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a00ad020 0x7fa6a0140ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa68c009970 tx=0x7fa68c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.921+0000 7fa696a00640 1 -- 172.21.15.6:0/1275325738 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c031bb0 con 0x7fa6a00ad020 2024-08-17T02:27:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.921+0000 7fa696a00640 1 -- 172.21.15.6:0/1275325738 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c031d30 con 0x7fa6a00ad020 2024-08-17T02:27:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.921+0000 7fa6a6800640 1 -- 172.21.15.6:0/1275325738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a01581f0 con 0x7fa6a00ad020 2024-08-17T02:27:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.921+0000 7fa696a00640 1 -- 172.21.15.6:0/1275325738 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c031ea0 con 0x7fa6a00ad020 2024-08-17T02:27:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.921+0000 7fa6a6800640 1 -- 172.21.15.6:0/1275325738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a01587b0 con 0x7fa6a00ad020 2024-08-17T02:27:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.922+0000 7fa6a6800640 1 -- 172.21.15.6:0/1275325738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a0063fb0 con 0x7fa6a00ad020 2024-08-17T02:27:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.923+0000 7fa696a00640 1 -- 172.21.15.6:0/1275325738 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa68c039040 con 0x7fa6a00ad020 2024-08-17T02:27:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.924+0000 7fa696a00640 1 --2- 172.21.15.6:0/1275325738 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa680065150 0x7fa680067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.924+0000 7fa696a00640 1 -- 172.21.15.6:0/1275325738 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fa68c0a26c0 con 0x7fa6a00ad020 2024-08-17T02:27:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.924+0000 7fa69f400640 1 --2- 172.21.15.6:0/1275325738 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa680065150 0x7fa680067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.925+0000 7fa69f400640 1 --2- 172.21.15.6:0/1275325738 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa680065150 0x7fa680067600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00adf40 tx=0x7fa690009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:11.928+0000 7fa696a00640 1 -- 172.21.15.6:0/1275325738 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa68c070690 con 0x7fa6a00ad020 2024-08-17T02:27:12.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.112+0000 7fa6a6800640 1 -- 172.21.15.6:0/1275325738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa6a0067c10 con 0x7fa6a00ad020 2024-08-17T02:27:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.742+0000 7fa696a00640 1 -- 172.21.15.6:0/1275325738 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa68c073cb0 con 0x7fa6a00ad020 2024-08-17T02:27:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:27:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.745+0000 7fa6a6800640 1 -- 172.21.15.6:0/1275325738 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa680065150 msgr2=0x7fa680067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.745+0000 7fa6a6800640 1 --2- 172.21.15.6:0/1275325738 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa680065150 0x7fa680067600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00adf40 tx=0x7fa690009040 comp rx=0 tx=0).stop 2024-08-17T02:27:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.745+0000 7fa6a6800640 1 -- 172.21.15.6:0/1275325738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a00ad020 msgr2=0x7fa6a0140ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.745+0000 7fa6a6800640 1 --2- 172.21.15.6:0/1275325738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a00ad020 0x7fa6a0140ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa68c009970 tx=0x7fa68c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.745+0000 7fa6a6800640 1 -- 172.21.15.6:0/1275325738 shutdown_connections 2024-08-17T02:27:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.745+0000 7fa6a6800640 1 --2- 172.21.15.6:0/1275325738 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa680065150 0x7fa680067600 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.745+0000 7fa6a6800640 1 --2- 172.21.15.6:0/1275325738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6a00afa00 0x7fa6a01579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.745+0000 7fa6a6800640 1 --2- 172.21.15.6:0/1275325738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a00ad020 0x7fa6a0140ab0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.745+0000 7fa6a6800640 1 --2- 172.21.15.6:0/1275325738 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa6a00ac000 0x7fa6a015a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.745+0000 7fa6a6800640 1 -- 172.21.15.6:0/1275325738 >> 172.21.15.6:0/1275325738 conn(0x7fa6a0066e60 msgr2=0x7fa6a00af180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.745+0000 7fa6a6800640 1 -- 172.21.15.6:0/1275325738 shutdown_connections 2024-08-17T02:27:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.745+0000 7fa6a6800640 1 -- 172.21.15.6:0/1275325738 wait complete. 2024-08-17T02:27:12.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:27:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.918+0000 7f5d80200640 1 Processor -- start 2024-08-17T02:27:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.918+0000 7f5d80200640 1 -- start start 2024-08-17T02:27:12.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.919+0000 7f5d80200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d78069cd0 0x7f5d780a8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.919+0000 7f5d80200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d780b0a70 con 0x7f5d780af410 2024-08-17T02:27:12.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.919+0000 7f5d80200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d780b1450 con 0x7f5d78158f60 2024-08-17T02:27:12.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.919+0000 7f5d80200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d78069980 con 0x7f5d78069cd0 2024-08-17T02:27:12.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.919+0000 7f5d7e200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d78069cd0 0x7f5d780a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.919+0000 7f5d7ce00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5d780af410 0x7f5d780a7d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47814/0 (socket says 172.21.15.6:47814) 2024-08-17T02:27:12.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.920+0000 7f5d7ce00640 1 -- 172.21.15.6:0/297893879 learned_addr learned my addr 172.21.15.6:0/297893879 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:12.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.920+0000 7f5d7e200640 1 -- 172.21.15.6:0/297893879 >> v1:172.21.15.136:6789/0 conn(0x7f5d78158f60 legacy=0x7f5d780aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.920+0000 7f5d7e200640 1 -- 172.21.15.6:0/297893879 >> v1:172.21.15.6:6789/0 conn(0x7f5d780af410 legacy=0x7f5d780a7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.920+0000 7f5d7e200640 1 -- 172.21.15.6:0/297893879 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d780a89d0 con 0x7f5d78069cd0 2024-08-17T02:27:12.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.920+0000 7f5d77e00640 1 -- 172.21.15.6:0/297893879 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053324961 0 0) 0x7f5d780b0a70 con 0x7f5d780af410 2024-08-17T02:27:12.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.921+0000 7f5d7e200640 1 --2- 172.21.15.6:0/297893879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d78069cd0 0x7f5d780a8490 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5d70009e60 tx=0x7f5d70009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291488de61fa1941 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:12.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.921+0000 7f5d77e00640 1 -- 172.21.15.6:0/297893879 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d70007550 con 0x7f5d78069cd0 2024-08-17T02:27:12.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.921+0000 7f5d77e00640 1 -- 172.21.15.6:0/297893879 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7002d050 con 0x7f5d78069cd0 2024-08-17T02:27:12.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.921+0000 7f5d77e00640 1 -- 172.21.15.6:0/297893879 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d70007900 con 0x7f5d78069cd0 2024-08-17T02:27:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.922+0000 7f5d80200640 1 -- 172.21.15.6:0/297893879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d78069cd0 msgr2=0x7f5d780a8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.922+0000 7f5d80200640 1 --2- 172.21.15.6:0/297893879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d78069cd0 0x7f5d780a8490 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5d70009e60 tx=0x7f5d70009780 comp rx=0 tx=0).stop 2024-08-17T02:27:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.922+0000 7f5d80200640 1 -- 172.21.15.6:0/297893879 shutdown_connections 2024-08-17T02:27:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.922+0000 7f5d80200640 1 --2- 172.21.15.6:0/297893879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d78069cd0 0x7f5d780a8490 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.922+0000 7f5d80200640 1 -- 172.21.15.6:0/297893879 >> 172.21.15.6:0/297893879 conn(0x7f5d780ce5e0 msgr2=0x7f5d78095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.922+0000 7f5d80200640 1 -- 172.21.15.6:0/297893879 shutdown_connections 2024-08-17T02:27:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.922+0000 7f5d80200640 1 -- 172.21.15.6:0/297893879 wait complete. 2024-08-17T02:27:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.923+0000 7f5d80200640 1 Processor -- start 2024-08-17T02:27:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.924+0000 7f5d80200640 1 -- start start 2024-08-17T02:27:12.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.924+0000 7f5d80200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d78069cd0 0x7f5d7816bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.924+0000 7f5d80200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d780af410 0x7f5d7815dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.924+0000 7f5d80200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d78158f60 0x7f5d78149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.924+0000 7f5d80200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7816c050 con 0x7f5d78158f60 2024-08-17T02:27:12.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.924+0000 7f5d80200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7816aa90 con 0x7f5d78069cd0 2024-08-17T02:27:12.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.924+0000 7f5d80200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7816ad70 con 0x7f5d780af410 2024-08-17T02:27:12.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.925+0000 7f5d7e200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d78158f60 0x7f5d78149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.925+0000 7f5d7e200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d78158f60 0x7f5d78149bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33728/0 (socket says 172.21.15.6:33728) 2024-08-17T02:27:12.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.925+0000 7f5d7e200640 1 -- 172.21.15.6:0/1955310926 learned_addr learned my addr 172.21.15.6:0/1955310926 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.925+0000 7f5d7d800640 1 --2- 172.21.15.6:0/1955310926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d78069cd0 0x7f5d7816bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.925+0000 7f5d7ce00640 1 --2- 172.21.15.6:0/1955310926 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d780af410 0x7f5d7815dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.925+0000 7f5d7e200640 1 -- 172.21.15.6:0/1955310926 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d780af410 msgr2=0x7f5d7815dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.925+0000 7f5d7e200640 1 --2- 172.21.15.6:0/1955310926 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d780af410 0x7f5d7815dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.925+0000 7f5d7e200640 1 -- 172.21.15.6:0/1955310926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d78069cd0 msgr2=0x7f5d7816bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.925+0000 7f5d7e200640 1 --2- 172.21.15.6:0/1955310926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d78069cd0 0x7f5d7816bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.925+0000 7f5d7e200640 1 -- 172.21.15.6:0/1955310926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d70009a20 con 0x7f5d78158f60 2024-08-17T02:27:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.925+0000 7f5d7ce00640 1 --2- 172.21.15.6:0/1955310926 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d780af410 0x7f5d7815dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.926+0000 7f5d7e200640 1 --2- 172.21.15.6:0/1955310926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d78158f60 0x7f5d78149bd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5d700099f0 tx=0x7f5d70037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:12.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.926+0000 7f5d74c00640 1 -- 172.21.15.6:0/1955310926 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d70031ce0 con 0x7f5d78158f60 2024-08-17T02:27:12.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.926+0000 7f5d74c00640 1 -- 172.21.15.6:0/1955310926 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d70031e40 con 0x7f5d78158f60 2024-08-17T02:27:12.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.926+0000 7f5d80200640 1 -- 172.21.15.6:0/1955310926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7816b050 con 0x7f5d78158f60 2024-08-17T02:27:12.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.926+0000 7f5d74c00640 1 -- 172.21.15.6:0/1955310926 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7003d640 con 0x7f5d78158f60 2024-08-17T02:27:12.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.926+0000 7f5d80200640 1 -- 172.21.15.6:0/1955310926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7816b610 con 0x7f5d78158f60 2024-08-17T02:27:12.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.927+0000 7f5d80200640 1 -- 172.21.15.6:0/1955310926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d78063fb0 con 0x7f5d78158f60 2024-08-17T02:27:12.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.928+0000 7f5d74c00640 1 -- 172.21.15.6:0/1955310926 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5d70003040 con 0x7f5d78158f60 2024-08-17T02:27:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.928+0000 7f5d74c00640 1 --2- 172.21.15.6:0/1955310926 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5d58065150 0x7f5d58067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.929+0000 7f5d74c00640 1 -- 172.21.15.6:0/1955310926 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f5d700a42a0 con 0x7f5d78158f60 2024-08-17T02:27:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.929+0000 7f5d7d800640 1 --2- 172.21.15.6:0/1955310926 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5d58065150 0x7f5d58067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.930+0000 7f5d7d800640 1 --2- 172.21.15.6:0/1955310926 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5d58065150 0x7f5d58067600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c003720 tx=0x7f5d6c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:12.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:12.933+0000 7f5d74c00640 1 -- 172.21.15.6:0/1955310926 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5d700724e0 con 0x7f5d78158f60 2024-08-17T02:27:13.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:13.126+0000 7f5d80200640 1 -- 172.21.15.6:0/1955310926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5d7809b6c0 con 0x7f5d78158f60 2024-08-17T02:27:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:13.750+0000 7f5d74c00640 1 -- 172.21.15.6:0/1955310926 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5d70075b00 con 0x7f5d78158f60 2024-08-17T02:27:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-08-17T02:27:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:13.753+0000 7f5d80200640 1 -- 172.21.15.6:0/1955310926 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5d58065150 msgr2=0x7f5d58067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:13.753+0000 7f5d80200640 1 --2- 172.21.15.6:0/1955310926 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5d58065150 0x7f5d58067600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c003720 tx=0x7f5d6c009040 comp rx=0 tx=0).stop 2024-08-17T02:27:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:13.753+0000 7f5d80200640 1 -- 172.21.15.6:0/1955310926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d78158f60 msgr2=0x7f5d78149bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:13.753+0000 7f5d80200640 1 --2- 172.21.15.6:0/1955310926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d78158f60 0x7f5d78149bd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5d700099f0 tx=0x7f5d70037000 comp rx=0 tx=0).stop 2024-08-17T02:27:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:13.753+0000 7f5d80200640 1 -- 172.21.15.6:0/1955310926 shutdown_connections 2024-08-17T02:27:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:13.753+0000 7f5d80200640 1 --2- 172.21.15.6:0/1955310926 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5d58065150 0x7f5d58067600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:13.753+0000 7f5d80200640 1 --2- 172.21.15.6:0/1955310926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d78158f60 0x7f5d78149bd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:13.753+0000 7f5d80200640 1 --2- 172.21.15.6:0/1955310926 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d780af410 0x7f5d7815dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:13.753+0000 7f5d80200640 1 --2- 172.21.15.6:0/1955310926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d78069cd0 0x7f5d7816bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:13.753+0000 7f5d80200640 1 -- 172.21.15.6:0/1955310926 >> 172.21.15.6:0/1955310926 conn(0x7f5d780ce5e0 msgr2=0x7f5d781580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:13.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:13.753+0000 7f5d80200640 1 -- 172.21.15.6:0/1955310926 shutdown_connections 2024-08-17T02:27:13.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:13.753+0000 7f5d80200640 1 -- 172.21.15.6:0/1955310926 wait complete. 2024-08-17T02:27:13.772 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:27:13.772 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:27:13.773 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:27:13.773 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:13.773 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:27:13.773 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:27:13.773 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:27:13.773 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:13.773 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:27:13.774 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:27:13.774 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:27:13.774 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:13.774 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:27:13.774 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:27:13.774 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:27:13.774 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:13.788 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:27:13.789 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:27:13.790 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:27:13.790 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:27:13.791 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:27:13.791 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:27:13.792 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:27:13.792 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:27:13.834 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:27:13.835 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:13.836 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:27:13.836 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:13.837 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:27:13.837 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:13.838 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:27:13.838 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:13.838 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:27:13.971 INFO:tasks.ceph.mds.b.smithi136.stdout:starting mds.b at 2024-08-17T02:27:13.971 INFO:tasks.ceph.mds.d.smithi136.stdout:starting mds.d at 2024-08-17T02:27:13.973 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-08-17T02:27:13.975 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-08-17T02:27:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.011+0000 7f7e51400640 1 Processor -- start 2024-08-17T02:27:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.011+0000 7f7e51400640 1 -- start start 2024-08-17T02:27:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.012+0000 7f7e51400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e4c158a20 0x7f7e4c0a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.012+0000 7f7e51400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7e4c0ae860 0x7f7e4c06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.012+0000 7f7e51400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7e4c158df0 0x7f7e4c06dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.012+0000 7f7e51400640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4c0aed90 con 0x7f7e4c0ae860 2024-08-17T02:27:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.012+0000 7f7e51400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4c0af070 con 0x7f7e4c158df0 2024-08-17T02:27:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.012+0000 7f7e51400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c0af350 con 0x7f7e4c158a20 2024-08-17T02:27:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.013+0000 7f7e43e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7e4c0ae860 0x7f7e4c06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.013+0000 7f7e43e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7e4c0ae860 0x7f7e4c06d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33776/0 (socket says 172.21.15.6:33776) 2024-08-17T02:27:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.013+0000 7f7e43e00640 1 -- 172.21.15.6:0/3202391098 learned_addr learned my addr 172.21.15.6:0/3202391098 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.013+0000 7f7e4a800640 1 --2- 172.21.15.6:0/3202391098 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e4c158a20 0x7f7e4c0a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.013+0000 7f7e4b200640 1 --2- 172.21.15.6:0/3202391098 >> v2:172.21.15.136:3300/0 conn(0x7f7e4c158df0 0x7f7e4c06dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.013+0000 7f7e43e00640 1 -- 172.21.15.6:0/3202391098 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e4c158a20 msgr2=0x7f7e4c0a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.013+0000 7f7e43e00640 1 --2- 172.21.15.6:0/3202391098 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e4c158a20 0x7f7e4c0a89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.013+0000 7f7e43e00640 1 -- 172.21.15.6:0/3202391098 >> v2:172.21.15.136:3300/0 conn(0x7f7e4c158df0 msgr2=0x7f7e4c06dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:14.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.013+0000 7f7e43e00640 1 --2- 172.21.15.6:0/3202391098 >> v2:172.21.15.136:3300/0 conn(0x7f7e4c158df0 0x7f7e4c06dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.013+0000 7f7e43e00640 1 -- 172.21.15.6:0/3202391098 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c0af630 con 0x7f7e4c0ae860 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.014+0000 7f7e43e00640 1 --2- 172.21.15.6:0/3202391098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e4c0ae860 0x7f7e4c06d7d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c067d20 tx=0x7f7e340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903b88c0283475e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.014+0000 7f7e49e00640 1 -- 172.21.15.6:0/3202391098 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3402add0 con 0x7f7e4c0ae860 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.015+0000 7f7e49e00640 1 -- 172.21.15.6:0/3202391098 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e34032440 con 0x7f7e4c0ae860 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.015+0000 7f7e49e00640 1 -- 172.21.15.6:0/3202391098 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34032820 con 0x7f7e4c0ae860 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.015+0000 7f7e51400640 1 -- 172.21.15.6:0/3202391098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e4c0ae860 msgr2=0x7f7e4c06d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.015+0000 7f7e51400640 1 --2- 172.21.15.6:0/3202391098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e4c0ae860 0x7f7e4c06d7d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c067d20 tx=0x7f7e340091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.015+0000 7f7e51400640 1 -- 172.21.15.6:0/3202391098 shutdown_connections 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.015+0000 7f7e51400640 1 --2- 172.21.15.6:0/3202391098 >> v2:172.21.15.136:3300/0 conn(0x7f7e4c158df0 0x7f7e4c06dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.015+0000 7f7e51400640 1 --2- 172.21.15.6:0/3202391098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e4c0ae860 0x7f7e4c06d7d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.015+0000 7f7e51400640 1 --2- 172.21.15.6:0/3202391098 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e4c158a20 0x7f7e4c0a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.015+0000 7f7e51400640 1 -- 172.21.15.6:0/3202391098 >> 172.21.15.6:0/3202391098 conn(0x7f7e4c066e60 msgr2=0x7f7e4c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.015+0000 7f7e51400640 1 -- 172.21.15.6:0/3202391098 shutdown_connections 2024-08-17T02:27:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.015+0000 7f7e51400640 1 -- 172.21.15.6:0/3202391098 wait complete. 2024-08-17T02:27:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.017+0000 7f7e51400640 1 Processor -- start 2024-08-17T02:27:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.017+0000 7f7e51400640 1 -- start start 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.017+0000 7f7e51400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e4c0ae860 0x7f7e4c141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.018+0000 7f7e51400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e4c158a20 0x7f7e4c160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.018+0000 7f7e51400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e4c158df0 0x7f7e4c156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.018+0000 7f7e51400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c141b40 con 0x7f7e4c0ae860 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.018+0000 7f7e51400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c1626c0 con 0x7f7e4c158a20 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.018+0000 7f7e51400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c161620 con 0x7f7e4c158df0 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.018+0000 7f7e4a800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e4c0ae860 0x7f7e4c141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.018+0000 7f7e43e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e4c158a20 0x7f7e4c160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.018+0000 7f7e4a800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e4c0ae860 0x7f7e4c141600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33784/0 (socket says 172.21.15.6:33784) 2024-08-17T02:27:14.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.018+0000 7f7e4a800640 1 -- 172.21.15.6:0/2286461058 learned_addr learned my addr 172.21.15.6:0/2286461058 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:14.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.018+0000 7f7e4b200640 1 --2- 172.21.15.6:0/2286461058 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e4c158df0 0x7f7e4c156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.018+0000 7f7e4a800640 1 -- 172.21.15.6:0/2286461058 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e4c158df0 msgr2=0x7f7e4c156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.018+0000 7f7e4a800640 1 --2- 172.21.15.6:0/2286461058 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e4c158df0 0x7f7e4c156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.018+0000 7f7e4a800640 1 -- 172.21.15.6:0/2286461058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e4c158a20 msgr2=0x7f7e4c160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.018+0000 7f7e4a800640 1 --2- 172.21.15.6:0/2286461058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e4c158a20 0x7f7e4c160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.018+0000 7f7e4a800640 1 -- 172.21.15.6:0/2286461058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e34009450 con 0x7f7e4c0ae860 2024-08-17T02:27:14.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.019+0000 7f7e4a800640 1 --2- 172.21.15.6:0/2286461058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e4c0ae860 0x7f7e4c141600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00ea20 tx=0x7f7e3c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.019+0000 7f7e42000640 1 -- 172.21.15.6:0/2286461058 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c00ca10 con 0x7f7e4c0ae860 2024-08-17T02:27:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.019+0000 7f7e42000640 1 -- 172.21.15.6:0/2286461058 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c00cb70 con 0x7f7e4c0ae860 2024-08-17T02:27:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.019+0000 7f7e42000640 1 -- 172.21.15.6:0/2286461058 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c013470 con 0x7f7e4c0ae860 2024-08-17T02:27:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.019+0000 7f7e51400640 1 -- 172.21.15.6:0/2286461058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4c161900 con 0x7f7e4c0ae860 2024-08-17T02:27:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.019+0000 7f7e51400640 1 -- 172.21.15.6:0/2286461058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4c161ec0 con 0x7f7e4c0ae860 2024-08-17T02:27:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.020+0000 7f7e51400640 1 -- 172.21.15.6:0/2286461058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4c063fb0 con 0x7f7e4c0ae860 2024-08-17T02:27:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.021+0000 7f7e42000640 1 -- 172.21.15.6:0/2286461058 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7e3c013860 con 0x7f7e4c0ae860 2024-08-17T02:27:14.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.022+0000 7f7e42000640 1 --2- 172.21.15.6:0/2286461058 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7e28065150 0x7f7e28067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.022+0000 7f7e42000640 1 -- 172.21.15.6:0/2286461058 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7e3c082430 con 0x7f7e4c0ae860 2024-08-17T02:27:14.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.022+0000 7f7e43e00640 1 --2- 172.21.15.6:0/2286461058 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7e28065150 0x7f7e28067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.023+0000 7f7e43e00640 1 --2- 172.21.15.6:0/2286461058 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7e28065150 0x7f7e28067600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e34034000 tx=0x7f7e34032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:14.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.026+0000 7f7e42000640 1 -- 172.21.15.6:0/2286461058 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7e3c050800 con 0x7f7e4c0ae860 2024-08-17T02:27:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.221+0000 7f7e51400640 1 -- 172.21.15.6:0/2286461058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7e4c06e4c0 con 0x7f7e4c0ae860 2024-08-17T02:27:14.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.763+0000 7f7e42000640 1 -- 172.21.15.6:0/2286461058 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7e3c053e20 con 0x7f7e4c0ae860 2024-08-17T02:27:14.764 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2024-08-17T02:27:14.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.766+0000 7f7e51400640 1 -- 172.21.15.6:0/2286461058 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7e28065150 msgr2=0x7f7e28067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.766+0000 7f7e51400640 1 --2- 172.21.15.6:0/2286461058 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7e28065150 0x7f7e28067600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e34034000 tx=0x7f7e34032000 comp rx=0 tx=0).stop 2024-08-17T02:27:14.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.766+0000 7f7e51400640 1 -- 172.21.15.6:0/2286461058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e4c0ae860 msgr2=0x7f7e4c141600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.766+0000 7f7e51400640 1 --2- 172.21.15.6:0/2286461058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e4c0ae860 0x7f7e4c141600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00ea20 tx=0x7f7e3c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.766+0000 7f7e51400640 1 -- 172.21.15.6:0/2286461058 shutdown_connections 2024-08-17T02:27:14.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.766+0000 7f7e51400640 1 --2- 172.21.15.6:0/2286461058 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7e28065150 0x7f7e28067600 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.766+0000 7f7e51400640 1 --2- 172.21.15.6:0/2286461058 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e4c158df0 0x7f7e4c156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.766+0000 7f7e51400640 1 --2- 172.21.15.6:0/2286461058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e4c158a20 0x7f7e4c160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.766+0000 7f7e51400640 1 --2- 172.21.15.6:0/2286461058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e4c0ae860 0x7f7e4c141600 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.766+0000 7f7e51400640 1 -- 172.21.15.6:0/2286461058 >> 172.21.15.6:0/2286461058 conn(0x7f7e4c066e60 msgr2=0x7f7e4c0b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:14.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.766+0000 7f7e51400640 1 -- 172.21.15.6:0/2286461058 shutdown_connections 2024-08-17T02:27:14.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.766+0000 7f7e51400640 1 -- 172.21.15.6:0/2286461058 wait complete. 2024-08-17T02:27:14.784 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:27:14.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.935+0000 7f41a9600640 1 Processor -- start 2024-08-17T02:27:14.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.935+0000 7f41a9600640 1 -- start start 2024-08-17T02:27:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.937+0000 7f41a9600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41a40afca0 0x7f41a40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.937+0000 7f41a9600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41a40acf10 0x7f41a4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.937+0000 7f41a9600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f41a41589a0 0x7f41a4158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.937+0000 7f41a9600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a40b0980 con 0x7f41a40afca0 2024-08-17T02:27:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.937+0000 7f41a9600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a415a4e0 con 0x7f41a41589a0 2024-08-17T02:27:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.937+0000 7f41a9600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a40c92b0 con 0x7f41a40acf10 2024-08-17T02:27:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.937+0000 7f41a2a00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41a40afca0 0x7f41a40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.937+0000 7f41a2a00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41a40afca0 0x7f41a40b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52902/0 (socket says 172.21.15.6:52902) 2024-08-17T02:27:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.937+0000 7f41a2a00640 1 -- 172.21.15.6:0/3711399872 learned_addr learned my addr 172.21.15.6:0/3711399872 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.937+0000 7f41a2000640 1 --2- 172.21.15.6:0/3711399872 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41a40acf10 0x7f41a4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.937+0000 7f41a3400640 1 --2- 172.21.15.6:0/3711399872 >> v2:172.21.15.136:3300/0 conn(0x7f41a41589a0 0x7f41a4158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.937+0000 7f41a2a00640 1 -- 172.21.15.6:0/3711399872 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41a40acf10 msgr2=0x7f41a4159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.937+0000 7f41a2a00640 1 --2- 172.21.15.6:0/3711399872 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41a40acf10 0x7f41a4159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.937+0000 7f41a2a00640 1 -- 172.21.15.6:0/3711399872 >> v2:172.21.15.136:3300/0 conn(0x7f41a41589a0 msgr2=0x7f41a4158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.937+0000 7f41a2a00640 1 --2- 172.21.15.6:0/3711399872 >> v2:172.21.15.136:3300/0 conn(0x7f41a41589a0 0x7f41a4158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.937+0000 7f41a2a00640 1 -- 172.21.15.6:0/3711399872 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a4159360 con 0x7f41a40afca0 2024-08-17T02:27:14.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.938+0000 7f41a2a00640 1 --2- 172.21.15.6:0/3711399872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a40afca0 0x7f41a40b0070 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4194009910 tx=0x7f41940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb02122d5e24310 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:14.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.938+0000 7f41a1600640 1 -- 172.21.15.6:0/3711399872 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419402adb0 con 0x7f41a40afca0 2024-08-17T02:27:14.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.939+0000 7f41a1600640 1 -- 172.21.15.6:0/3711399872 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4194032440 con 0x7f41a40afca0 2024-08-17T02:27:14.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.939+0000 7f41a1600640 1 -- 172.21.15.6:0/3711399872 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4194032820 con 0x7f41a40afca0 2024-08-17T02:27:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.939+0000 7f41a9600640 1 -- 172.21.15.6:0/3711399872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a40afca0 msgr2=0x7f41a40b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.939+0000 7f41a9600640 1 --2- 172.21.15.6:0/3711399872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a40afca0 0x7f41a40b0070 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4194009910 tx=0x7f41940091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.939+0000 7f41a9600640 1 -- 172.21.15.6:0/3711399872 shutdown_connections 2024-08-17T02:27:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.939+0000 7f41a9600640 1 --2- 172.21.15.6:0/3711399872 >> v2:172.21.15.136:3300/0 conn(0x7f41a41589a0 0x7f41a4158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.939+0000 7f41a9600640 1 --2- 172.21.15.6:0/3711399872 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41a40acf10 0x7f41a4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.939+0000 7f41a9600640 1 --2- 172.21.15.6:0/3711399872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a40afca0 0x7f41a40b0070 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.939+0000 7f41a9600640 1 -- 172.21.15.6:0/3711399872 >> 172.21.15.6:0/3711399872 conn(0x7f41a4066e60 msgr2=0x7f41a4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.939+0000 7f41a9600640 1 -- 172.21.15.6:0/3711399872 shutdown_connections 2024-08-17T02:27:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.939+0000 7f41a9600640 1 -- 172.21.15.6:0/3711399872 wait complete. 2024-08-17T02:27:14.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.941+0000 7f41a9600640 1 Processor -- start 2024-08-17T02:27:14.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.941+0000 7f41a9600640 1 -- start start 2024-08-17T02:27:14.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.942+0000 7f41a9600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41a40acf10 0x7f41a4149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.942+0000 7f41a9600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a40afca0 0x7f41a416ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.942+0000 7f41a9600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41a41589a0 0x7f41a4147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.942+0000 7f41a9600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a4169b50 con 0x7f41a40afca0 2024-08-17T02:27:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.942+0000 7f41a9600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a416d3f0 con 0x7f41a40acf10 2024-08-17T02:27:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.942+0000 7f41a9600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a4169850 con 0x7f41a41589a0 2024-08-17T02:27:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.942+0000 7f41a2000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a40afca0 0x7f41a416ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.942+0000 7f41a2000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a40afca0 0x7f41a416ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52910/0 (socket says 172.21.15.6:52910) 2024-08-17T02:27:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.942+0000 7f41a2000640 1 -- 172.21.15.6:0/1020442483 learned_addr learned my addr 172.21.15.6:0/1020442483 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.942+0000 7f41a3400640 1 --2- 172.21.15.6:0/1020442483 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41a41589a0 0x7f41a4147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.942+0000 7f41a2a00640 1 --2- 172.21.15.6:0/1020442483 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41a40acf10 0x7f41a4149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.942+0000 7f41a2000640 1 -- 172.21.15.6:0/1020442483 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41a41589a0 msgr2=0x7f41a4147440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.942+0000 7f41a2000640 1 --2- 172.21.15.6:0/1020442483 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41a41589a0 0x7f41a4147440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.942+0000 7f41a2000640 1 -- 172.21.15.6:0/1020442483 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41a40acf10 msgr2=0x7f41a4149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.942+0000 7f41a2000640 1 --2- 172.21.15.6:0/1020442483 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41a40acf10 0x7f41a4149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.942+0000 7f41a2000640 1 -- 172.21.15.6:0/1020442483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4194009450 con 0x7f41a40afca0 2024-08-17T02:27:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.942+0000 7f41a2a00640 1 --2- 172.21.15.6:0/1020442483 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41a40acf10 0x7f41a4149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.943+0000 7f41a2000640 1 --2- 172.21.15.6:0/1020442483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a40afca0 0x7f41a416ceb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f419000d8c0 tx=0x7f4190008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.943+0000 7f419a000640 1 -- 172.21.15.6:0/1020442483 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419000de50 con 0x7f41a40afca0 2024-08-17T02:27:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.943+0000 7f419a000640 1 -- 172.21.15.6:0/1020442483 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4190009940 con 0x7f41a40afca0 2024-08-17T02:27:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.943+0000 7f419a000640 1 -- 172.21.15.6:0/1020442483 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190009ce0 con 0x7f41a40afca0 2024-08-17T02:27:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.943+0000 7f41a9600640 1 -- 172.21.15.6:0/1020442483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a4147980 con 0x7f41a40afca0 2024-08-17T02:27:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.943+0000 7f41a9600640 1 -- 172.21.15.6:0/1020442483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a416d930 con 0x7f41a40afca0 2024-08-17T02:27:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.944+0000 7f41a9600640 1 -- 172.21.15.6:0/1020442483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a40ac760 con 0x7f41a40afca0 2024-08-17T02:27:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.945+0000 7f419a000640 1 -- 172.21.15.6:0/1020442483 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4190014620 con 0x7f41a40afca0 2024-08-17T02:27:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.946+0000 7f419a000640 1 --2- 172.21.15.6:0/1020442483 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4184065150 0x7f4184067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.946+0000 7f419a000640 1 -- 172.21.15.6:0/1020442483 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4190082990 con 0x7f41a40afca0 2024-08-17T02:27:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.946+0000 7f41a2a00640 1 --2- 172.21.15.6:0/1020442483 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4184065150 0x7f4184067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.947+0000 7f41a2a00640 1 --2- 172.21.15.6:0/1020442483 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4184065150 0x7f4184067600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4194034000 tx=0x7f4194032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:14.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:14.950+0000 7f419a000640 1 -- 172.21.15.6:0/1020442483 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f41a40ac760 con 0x7f41a40afca0 2024-08-17T02:27:15.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.195+0000 7f41a9600640 1 -- 172.21.15.6:0/1020442483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f41a40ac760 con 0x7f41a40afca0 2024-08-17T02:27:15.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.196+0000 7f419a000640 1 -- 172.21.15.6:0/1020442483 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f41a40ac760 con 0x7f41a40afca0 2024-08-17T02:27:15.196 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:15.196 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-08-17T02:27:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2024-08-17T02:27:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2024-08-17T02:27:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAhCsBm/ceFEBAA5H3zY7fQkLxL7RW+jnyD0g==", 2024-08-17T02:27:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-08-17T02:27:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-08-17T02:27:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-08-17T02:27:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-08-17T02:27:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2024-08-17T02:27:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAhCsBmZlRuIxAA/uBYkzeY3rgleTJvtWU+Jw==", 2024-08-17T02:27:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-08-17T02:27:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-08-17T02:27:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-08-17T02:27:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-08-17T02:27:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2024-08-17T02:27:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAhCsBmQ6rsGRAA/ee8rJJYpKFX7xYeqKZIPQ==", 2024-08-17T02:27:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-08-17T02:27:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-08-17T02:27:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-08-17T02:27:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-08-17T02:27:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2024-08-17T02:27:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAhCsBm3I3QLBAAErIDgwSwKw9bVPijIzG7HQ==", 2024-08-17T02:27:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-08-17T02:27:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-08-17T02:27:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-08-17T02:27:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-08-17T02:27:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2024-08-17T02:27:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAlCsBmM6YlBxAAfewdjL7d4oM24o0RcGU9lg==", 2024-08-17T02:27:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-08-17T02:27:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-08-17T02:27:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-08-17T02:27:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2024-08-17T02:27:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAoCsBmDv8MDhAAYjLxXtuNcL7mOfaf5VzgeQ==", 2024-08-17T02:27:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-08-17T02:27:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-08-17T02:27:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-08-17T02:27:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2024-08-17T02:27:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQArCsBmq8/NEhAAMUPa3AHafw8D4z3xZBS4WQ==", 2024-08-17T02:27:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-08-17T02:27:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-08-17T02:27:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-08-17T02:27:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2024-08-17T02:27:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAuCsBmZw7BFhAAZWR9+cKLLSh53k2uZm6PqA==", 2024-08-17T02:27:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-08-17T02:27:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-08-17T02:27:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-08-17T02:27:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2024-08-17T02:27:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQA0CsBmoh3vFRAAKwDKQXZW3eIslbycZase4A==", 2024-08-17T02:27:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-08-17T02:27:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-08-17T02:27:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-08-17T02:27:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2024-08-17T02:27:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQA3CsBmT+5/GRAA1d755Bhog/3Nd5t2PH3Isw==", 2024-08-17T02:27:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-08-17T02:27:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-08-17T02:27:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-08-17T02:27:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2024-08-17T02:27:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQA6CsBmKD2XHhAADn2Smi4OjrDwt+2dY3Gb5w==", 2024-08-17T02:27:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-08-17T02:27:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-08-17T02:27:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-08-17T02:27:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2024-08-17T02:27:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQA9CsBm60MbIxAAN8HLGHuyuTtD4GRQGgf1dw==", 2024-08-17T02:27:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-08-17T02:27:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-08-17T02:27:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-08-17T02:27:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2024-08-17T02:27:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAhCsBmafXxNBAA+58u8+oYz1TgwUxQ+2UIyw==", 2024-08-17T02:27:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-08-17T02:27:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-08-17T02:27:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-08-17T02:27:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-08-17T02:27:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2024-08-17T02:27:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAiCsBmdQOFBRAAXYq157pgoLO/hhJDjWWtyg==", 2024-08-17T02:27:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-08-17T02:27:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-08-17T02:27:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-08-17T02:27:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-08-17T02:27:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2024-08-17T02:27:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAhCsBmj4YLOxAAtJNZZWUdl2pBy7rlHbh+Ow==", 2024-08-17T02:27:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-08-17T02:27:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-08-17T02:27:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-08-17T02:27:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-08-17T02:27:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2024-08-17T02:27:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAiCsBmYhGYCxAAcRkRSM9AP6+tubwo4UScEw==", 2024-08-17T02:27:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-08-17T02:27:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-08-17T02:27:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-08-17T02:27:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-08-17T02:27:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2024-08-17T02:27:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAgCsBmDYAPHhAAGXfzLZXfj2LNGVizjIJLYw==", 2024-08-17T02:27:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-08-17T02:27:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-08-17T02:27:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-08-17T02:27:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-08-17T02:27:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:27:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBECsBmlxKTNxAA1Vhv35b2vKLqdMgKDVRTPw==", 2024-08-17T02:27:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:27:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:27:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBECsBm+xuTNxAAjmb3btZq1MXpvIKRQsRg4w==", 2024-08-17T02:27:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:27:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:27:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBECsBmxCSTNxAA0OESLWenmPGGBlCaBpuUXQ==", 2024-08-17T02:27:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:27:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:27:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBECsBm0SyTNxAApN2beP2HhZAZ8trL7xM8QA==", 2024-08-17T02:27:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:27:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:27:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBECsBm7zSTNxAAPdNqYyFgdSfCvduw9FtUFw==", 2024-08-17T02:27:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:27:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:27:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBECsBmOj2TNxAABHXpdxIW8+zYtyIuxD1gBw==", 2024-08-17T02:27:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:27:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2024-08-17T02:27:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAhCsBmCLZJChAAIdD/gUt6md7CcVlR40O3AA==", 2024-08-17T02:27:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-08-17T02:27:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-08-17T02:27:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-08-17T02:27:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2024-08-17T02:27:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAhCsBmMoDFAxAAzRs4W1ap/lmTveg4gFqjfw==", 2024-08-17T02:27:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-08-17T02:27:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-08-17T02:27:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-08-17T02:27:15.213 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-08-17T02:27:15.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:15.213 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-08-17T02:27:15.213 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-08-17T02:27:15.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.198+0000 7f41a9600640 1 -- 172.21.15.6:0/1020442483 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4184065150 msgr2=0x7f4184067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.198+0000 7f41a9600640 1 --2- 172.21.15.6:0/1020442483 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4184065150 0x7f4184067600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4194034000 tx=0x7f4194032000 comp rx=0 tx=0).stop 2024-08-17T02:27:15.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.198+0000 7f41a9600640 1 -- 172.21.15.6:0/1020442483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a40afca0 msgr2=0x7f41a416ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.198+0000 7f41a9600640 1 --2- 172.21.15.6:0/1020442483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a40afca0 0x7f41a416ceb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f419000d8c0 tx=0x7f4190008040 comp rx=0 tx=0).stop 2024-08-17T02:27:15.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.198+0000 7f41a9600640 1 -- 172.21.15.6:0/1020442483 shutdown_connections 2024-08-17T02:27:15.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.198+0000 7f41a9600640 1 --2- 172.21.15.6:0/1020442483 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4184065150 0x7f4184067600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.198+0000 7f41a9600640 1 --2- 172.21.15.6:0/1020442483 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41a41589a0 0x7f41a4147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.198+0000 7f41a9600640 1 --2- 172.21.15.6:0/1020442483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a40afca0 0x7f41a416ceb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.198+0000 7f41a9600640 1 --2- 172.21.15.6:0/1020442483 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41a40acf10 0x7f41a4149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.198+0000 7f41a9600640 1 -- 172.21.15.6:0/1020442483 >> 172.21.15.6:0/1020442483 conn(0x7f41a4066e60 msgr2=0x7f41a40caa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:15.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.198+0000 7f41a9600640 1 -- 172.21.15.6:0/1020442483 shutdown_connections 2024-08-17T02:27:15.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.198+0000 7f41a9600640 1 -- 172.21.15.6:0/1020442483 wait complete. 2024-08-17T02:27:15.215 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:27:15.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.368+0000 7fa468000640 1 Processor -- start 2024-08-17T02:27:15.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.368+0000 7fa468000640 1 -- start start 2024-08-17T02:27:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.369+0000 7fa468000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4600ad960 0x7fa46015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.369+0000 7fa468000640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa46015b5e0 con 0x7fa4600add30 2024-08-17T02:27:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.369+0000 7fa468000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4600cb160 con 0x7fa4600ca050 2024-08-17T02:27:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.369+0000 7fa468000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600b0d10 con 0x7fa4600ad960 2024-08-17T02:27:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.370+0000 7fa466000640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa4600add30 0x7fa4600aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60072/0 (socket says 172.21.15.6:60072) 2024-08-17T02:27:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.370+0000 7fa466000640 1 -- 172.21.15.6:0/1668411402 learned_addr learned my addr 172.21.15.6:0/1668411402 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.370+0000 7fa465600640 1 --2- 172.21.15.6:0/1668411402 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4600ad960 0x7fa46015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.370+0000 7fa45fe00640 1 -- 172.21.15.6:0/1668411402 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407337650 0 0) 0x7fa458001490 con 0x7fa4600add30 2024-08-17T02:27:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.370+0000 7fa45fe00640 1 -- 172.21.15.6:0/1668411402 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4480034e0 con 0x7fa4600add30 2024-08-17T02:27:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.370+0000 7fa45fe00640 1 -- 172.21.15.6:0/1668411402 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026887156 0 0) 0x7fa4600cb160 con 0x7fa4600ca050 2024-08-17T02:27:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.370+0000 7fa45fe00640 1 -- 172.21.15.6:0/1668411402 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa458001490 con 0x7fa4600ca050 2024-08-17T02:27:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.370+0000 7fa465600640 1 -- 172.21.15.6:0/1668411402 >> v1:172.21.15.136:6789/0 conn(0x7fa4600ca050 legacy=0x7fa460156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.370+0000 7fa465600640 1 -- 172.21.15.6:0/1668411402 >> v1:172.21.15.6:6789/0 conn(0x7fa4600add30 legacy=0x7fa4600aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.370+0000 7fa465600640 1 -- 172.21.15.6:0/1668411402 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4600ca550 con 0x7fa4600ad960 2024-08-17T02:27:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.372+0000 7fa465600640 1 --2- 172.21.15.6:0/1668411402 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4600ad960 0x7fa46015b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa454009880 tx=0x7fa4540090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bae42f2fca1e00c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.372+0000 7fa45fe00640 1 -- 172.21.15.6:0/1668411402 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa454032440 con 0x7fa4600ad960 2024-08-17T02:27:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.372+0000 7fa45fe00640 1 -- 172.21.15.6:0/1668411402 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4540325a0 con 0x7fa4600ad960 2024-08-17T02:27:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.372+0000 7fa45fe00640 1 -- 172.21.15.6:0/1668411402 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa454032920 con 0x7fa4600ad960 2024-08-17T02:27:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.372+0000 7fa468000640 1 -- 172.21.15.6:0/1668411402 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4600ad960 msgr2=0x7fa46015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.372+0000 7fa468000640 1 --2- 172.21.15.6:0/1668411402 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4600ad960 0x7fa46015b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa454009880 tx=0x7fa4540090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.372+0000 7fa468000640 1 -- 172.21.15.6:0/1668411402 shutdown_connections 2024-08-17T02:27:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.372+0000 7fa468000640 1 --2- 172.21.15.6:0/1668411402 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4600ad960 0x7fa46015b0a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.372+0000 7fa468000640 1 -- 172.21.15.6:0/1668411402 >> 172.21.15.6:0/1668411402 conn(0x7fa460066e60 msgr2=0x7fa460067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:15.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.373+0000 7fa468000640 1 -- 172.21.15.6:0/1668411402 shutdown_connections 2024-08-17T02:27:15.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.373+0000 7fa468000640 1 -- 172.21.15.6:0/1668411402 wait complete. 2024-08-17T02:27:15.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.374+0000 7fa468000640 1 Processor -- start 2024-08-17T02:27:15.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.374+0000 7fa468000640 1 -- start start 2024-08-17T02:27:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.375+0000 7fa468000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4600ad960 0x7fa4600aa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.375+0000 7fa468000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4600add30 0x7fa460159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.375+0000 7fa468000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4600ca050 0x7fa4600ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.375+0000 7fa468000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600ab8c0 con 0x7fa4600ca050 2024-08-17T02:27:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.375+0000 7fa468000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46015a030 con 0x7fa4600add30 2024-08-17T02:27:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.375+0000 7fa468000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600abb10 con 0x7fa4600ad960 2024-08-17T02:27:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.375+0000 7fa466000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4600ca050 0x7fa4600ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.375+0000 7fa466000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4600ca050 0x7fa4600ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52916/0 (socket says 172.21.15.6:52916) 2024-08-17T02:27:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.375+0000 7fa466000640 1 -- 172.21.15.6:0/920079009 learned_addr learned my addr 172.21.15.6:0/920079009 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.375+0000 7fa464c00640 1 --2- 172.21.15.6:0/920079009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4600add30 0x7fa460159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.376+0000 7fa465600640 1 --2- 172.21.15.6:0/920079009 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4600ad960 0x7fa4600aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.376+0000 7fa466000640 1 -- 172.21.15.6:0/920079009 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4600ad960 msgr2=0x7fa4600aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.376+0000 7fa466000640 1 --2- 172.21.15.6:0/920079009 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4600ad960 0x7fa4600aa860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.376+0000 7fa466000640 1 -- 172.21.15.6:0/920079009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4600add30 msgr2=0x7fa460159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.376+0000 7fa466000640 1 --2- 172.21.15.6:0/920079009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4600add30 0x7fa460159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.376+0000 7fa466000640 1 -- 172.21.15.6:0/920079009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa454009390 con 0x7fa4600ca050 2024-08-17T02:27:15.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.376+0000 7fa466000640 1 --2- 172.21.15.6:0/920079009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4600ca050 0x7fa4600ac8d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa458002070 tx=0x7fa458001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:15.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.376+0000 7fa45cc00640 1 -- 172.21.15.6:0/920079009 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45800a920 con 0x7fa4600ca050 2024-08-17T02:27:15.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.376+0000 7fa45cc00640 1 -- 172.21.15.6:0/920079009 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45800aaa0 con 0x7fa4600ca050 2024-08-17T02:27:15.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.376+0000 7fa45cc00640 1 -- 172.21.15.6:0/920079009 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45800ae60 con 0x7fa4600ca050 2024-08-17T02:27:15.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.376+0000 7fa468000640 1 -- 172.21.15.6:0/920079009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4600abdf0 con 0x7fa4600ca050 2024-08-17T02:27:15.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.377+0000 7fa468000640 1 -- 172.21.15.6:0/920079009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4600ac3b0 con 0x7fa4600ca050 2024-08-17T02:27:15.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.378+0000 7fa468000640 1 -- 172.21.15.6:0/920079009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa460063fb0 con 0x7fa4600ca050 2024-08-17T02:27:15.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.379+0000 7fa45cc00640 1 -- 172.21.15.6:0/920079009 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa458007300 con 0x7fa4600ca050 2024-08-17T02:27:15.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.379+0000 7fa45cc00640 1 --2- 172.21.15.6:0/920079009 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa440065150 0x7fa440067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.379+0000 7fa45cc00640 1 -- 172.21.15.6:0/920079009 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa458082200 con 0x7fa4600ca050 2024-08-17T02:27:15.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.380+0000 7fa465600640 1 --2- 172.21.15.6:0/920079009 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa440065150 0x7fa440067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.381+0000 7fa465600640 1 --2- 172.21.15.6:0/920079009 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa440065150 0x7fa440067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa454034000 tx=0x7fa454032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:15.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.383+0000 7fa45cc00640 1 -- 172.21.15.6:0/920079009 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa4580506a0 con 0x7fa4600ca050 2024-08-17T02:27:15.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.630+0000 7fa468000640 1 -- 172.21.15.6:0/920079009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fa46006ba30 con 0x7fa4600ca050 2024-08-17T02:27:15.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.634+0000 7fa45cc00640 1 -- 172.21.15.6:0/920079009 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa458053cc0 con 0x7fa4600ca050 2024-08-17T02:27:15.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.637+0000 7fa468000640 1 -- 172.21.15.6:0/920079009 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa440065150 msgr2=0x7fa440067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.637+0000 7fa468000640 1 --2- 172.21.15.6:0/920079009 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa440065150 0x7fa440067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa454034000 tx=0x7fa454032000 comp rx=0 tx=0).stop 2024-08-17T02:27:15.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.637+0000 7fa468000640 1 -- 172.21.15.6:0/920079009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4600ca050 msgr2=0x7fa4600ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.637+0000 7fa468000640 1 --2- 172.21.15.6:0/920079009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4600ca050 0x7fa4600ac8d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa458002070 tx=0x7fa458001c70 comp rx=0 tx=0).stop 2024-08-17T02:27:15.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.637+0000 7fa468000640 1 -- 172.21.15.6:0/920079009 shutdown_connections 2024-08-17T02:27:15.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.637+0000 7fa468000640 1 --2- 172.21.15.6:0/920079009 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa440065150 0x7fa440067600 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.637+0000 7fa468000640 1 --2- 172.21.15.6:0/920079009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4600ca050 0x7fa4600ac8d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.637+0000 7fa468000640 1 --2- 172.21.15.6:0/920079009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4600add30 0x7fa460159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.637+0000 7fa468000640 1 --2- 172.21.15.6:0/920079009 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4600ad960 0x7fa4600aa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.637+0000 7fa468000640 1 -- 172.21.15.6:0/920079009 >> 172.21.15.6:0/920079009 conn(0x7fa460066e60 msgr2=0x7fa4601555f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:15.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.637+0000 7fa468000640 1 -- 172.21.15.6:0/920079009 shutdown_connections 2024-08-17T02:27:15.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.637+0000 7fa468000640 1 -- 172.21.15.6:0/920079009 wait complete. 2024-08-17T02:27:15.653 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:27:15.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.806+0000 7f389f400640 1 Processor -- start 2024-08-17T02:27:15.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.806+0000 7f389f400640 1 -- start start 2024-08-17T02:27:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.807+0000 7f389f400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3898158a20 0x7f38980a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.807+0000 7f389f400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f389806dee0 0x7f38980afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.807+0000 7f389f400640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38980aed90 con 0x7f38980ae860 2024-08-17T02:27:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.807+0000 7f389f400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38980af070 con 0x7f389806dee0 2024-08-17T02:27:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.807+0000 7f389f400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38980af350 con 0x7f3898158a20 2024-08-17T02:27:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.808+0000 7f3897e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f38980ae860 0x7f389806d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60080/0 (socket says 172.21.15.6:60080) 2024-08-17T02:27:15.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.808+0000 7f3897e00640 1 -- 172.21.15.6:0/2242358458 learned_addr learned my addr 172.21.15.6:0/2242358458 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:15.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.808+0000 7f389d400640 1 --2- 172.21.15.6:0/2242358458 >> v2:172.21.15.136:3300/0 conn(0x7f389806dee0 0x7f38980afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.808+0000 7f3897400640 1 -- 172.21.15.6:0/2242358458 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109950799 0 0) 0x7f38980aed90 con 0x7f38980ae860 2024-08-17T02:27:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.808+0000 7f389ca00640 1 --2- 172.21.15.6:0/2242358458 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3898158a20 0x7f38980a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.808+0000 7f3897400640 1 -- 172.21.15.6:0/2242358458 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38800034e0 con 0x7f38980ae860 2024-08-17T02:27:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.808+0000 7f3897400640 1 -- 172.21.15.6:0/2242358458 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 225536624 0 0) 0x7f38800034e0 con 0x7f38980ae860 2024-08-17T02:27:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f3897400640 1 -- 172.21.15.6:0/2242358458 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3898158a20 msgr2=0x7f38980a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f3897400640 1 --2- 172.21.15.6:0/2242358458 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3898158a20 0x7f38980a89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f3897400640 1 -- 172.21.15.6:0/2242358458 >> v2:172.21.15.136:3300/0 conn(0x7f389806dee0 msgr2=0x7f38980afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f3897400640 1 --2- 172.21.15.6:0/2242358458 >> v2:172.21.15.136:3300/0 conn(0x7f389806dee0 0x7f38980afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f3897400640 1 -- 172.21.15.6:0/2242358458 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38980af630 con 0x7f38980ae860 2024-08-17T02:27:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f3897400640 1 -- 172.21.15.6:0/2242358458 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f3884001470 con 0x7f38980ae860 2024-08-17T02:27:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f3897400640 1 -- 172.21.15.6:0/2242358458 >> v1:172.21.15.6:6789/0 conn(0x7f38980ae860 legacy=0x7f389806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f3897400640 1 --2- 172.21.15.6:0/2242358458 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3898158a20 0x7f3880003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f3897400640 1 --2- 172.21.15.6:0/2242358458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3880004020 0x7f3880004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f3897400640 1 --2- 172.21.15.6:0/2242358458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3880004cc0 0x7f3880005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f3897400640 1 -- 172.21.15.6:0/2242358458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38980af070 con 0x7f3880004020 2024-08-17T02:27:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f3897400640 1 -- 172.21.15.6:0/2242358458 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38980af350 con 0x7f3880004cc0 2024-08-17T02:27:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f3897400640 1 -- 172.21.15.6:0/2242358458 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388000bad0 con 0x7f3898158a20 2024-08-17T02:27:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f3897e00640 1 --2- 172.21.15.6:0/2242358458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3880004020 0x7f3880004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f389ca00640 1 --2- 172.21.15.6:0/2242358458 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3898158a20 0x7f3880003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f389d400640 1 --2- 172.21.15.6:0/2242358458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3880004cc0 0x7f3880005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f3897e00640 1 -- 172.21.15.6:0/2242358458 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3898158a20 msgr2=0x7f3880003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.809+0000 7f3897e00640 1 --2- 172.21.15.6:0/2242358458 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3898158a20 0x7f3880003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.810+0000 7f3897e00640 1 -- 172.21.15.6:0/2242358458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3880004cc0 msgr2=0x7f3880005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.810+0000 7f3897e00640 1 --2- 172.21.15.6:0/2242358458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3880004cc0 0x7f3880005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.810+0000 7f3897e00640 1 -- 172.21.15.6:0/2242358458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38800034e0 con 0x7f3880004020 2024-08-17T02:27:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.810+0000 7f3897e00640 1 --2- 172.21.15.6:0/2242358458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3880004020 0x7f3880004780 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f388400c1e0 tx=0x7f3884001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa60007ce002d716 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.811+0000 7f3897400640 1 -- 172.21.15.6:0/2242358458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3884005890 con 0x7f3880004020 2024-08-17T02:27:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.811+0000 7f3897400640 1 -- 172.21.15.6:0/2242358458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388402d070 con 0x7f3880004020 2024-08-17T02:27:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.811+0000 7f3897400640 1 -- 172.21.15.6:0/2242358458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3884005a50 con 0x7f3880004020 2024-08-17T02:27:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.811+0000 7f389f400640 1 -- 172.21.15.6:0/2242358458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3880004020 msgr2=0x7f3880004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.811+0000 7f389f400640 1 --2- 172.21.15.6:0/2242358458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3880004020 0x7f3880004780 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f388400c1e0 tx=0x7f3884001dc0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.811+0000 7f389d400640 1 -- 172.21.15.6:0/2242358458 reap_dead start 2024-08-17T02:27:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.811+0000 7f389f400640 1 -- 172.21.15.6:0/2242358458 shutdown_connections 2024-08-17T02:27:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.811+0000 7f389f400640 1 -- 172.21.15.6:0/2242358458 >> 172.21.15.6:0/2242358458 conn(0x7f3898066e60 msgr2=0x7f3898067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.811+0000 7f389f400640 1 -- 172.21.15.6:0/2242358458 shutdown_connections 2024-08-17T02:27:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.811+0000 7f389f400640 1 -- 172.21.15.6:0/2242358458 wait complete. 2024-08-17T02:27:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.813+0000 7f389f400640 1 Processor -- start 2024-08-17T02:27:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.813+0000 7f389f400640 1 -- start start 2024-08-17T02:27:15.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.814+0000 7f389f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3880004020 0x7f3898169e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.814+0000 7f389f400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f389814f730 0x7f389814c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.814+0000 7f389f400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f389815b070 0x7f389815b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.814+0000 7f389f400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389815a3b0 con 0x7f3880004020 2024-08-17T02:27:15.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.814+0000 7f389f400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3898150450 con 0x7f389815b070 2024-08-17T02:27:15.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.814+0000 7f389f400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389815abe0 con 0x7f389814f730 2024-08-17T02:27:15.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.814+0000 7f389ca00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3880004020 0x7f3898169e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.814+0000 7f389ca00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3880004020 0x7f3898169e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52940/0 (socket says 172.21.15.6:52940) 2024-08-17T02:27:15.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.814+0000 7f389ca00640 1 -- 172.21.15.6:0/3484586946 learned_addr learned my addr 172.21.15.6:0/3484586946 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:15.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.814+0000 7f389d400640 1 --2- 172.21.15.6:0/3484586946 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f389815b070 0x7f389815b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.814+0000 7f3897e00640 1 --2- 172.21.15.6:0/3484586946 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f389814f730 0x7f389814c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.814+0000 7f389ca00640 1 -- 172.21.15.6:0/3484586946 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f389814f730 msgr2=0x7f389814c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.814+0000 7f389ca00640 1 --2- 172.21.15.6:0/3484586946 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f389814f730 0x7f389814c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.814+0000 7f389ca00640 1 -- 172.21.15.6:0/3484586946 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f389815b070 msgr2=0x7f389815b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.814+0000 7f389ca00640 1 --2- 172.21.15.6:0/3484586946 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f389815b070 0x7f389815b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.814+0000 7f389ca00640 1 -- 172.21.15.6:0/3484586946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389816a370 con 0x7f3880004020 2024-08-17T02:27:15.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.814+0000 7f3897e00640 1 --2- 172.21.15.6:0/3484586946 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f389814f730 0x7f389814c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:15.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.815+0000 7f389ca00640 1 --2- 172.21.15.6:0/3484586946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3880004020 0x7f3898169e30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f388c011b70 tx=0x7f388c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:15.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.815+0000 7f388be00640 1 -- 172.21.15.6:0/3484586946 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00fae0 con 0x7f3880004020 2024-08-17T02:27:15.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.815+0000 7f388be00640 1 -- 172.21.15.6:0/3484586946 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c00fc40 con 0x7f3880004020 2024-08-17T02:27:15.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.815+0000 7f389f400640 1 -- 172.21.15.6:0/3484586946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389814fc80 con 0x7f3880004020 2024-08-17T02:27:15.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.815+0000 7f388be00640 1 -- 172.21.15.6:0/3484586946 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c014440 con 0x7f3880004020 2024-08-17T02:27:15.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.815+0000 7f389f400640 1 -- 172.21.15.6:0/3484586946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389815a870 con 0x7f3880004020 2024-08-17T02:27:15.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.816+0000 7f389f400640 1 -- 172.21.15.6:0/3484586946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3898063fb0 con 0x7f3880004020 2024-08-17T02:27:15.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.817+0000 7f388be00640 1 -- 172.21.15.6:0/3484586946 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f388c0147b0 con 0x7f3880004020 2024-08-17T02:27:15.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.818+0000 7f388be00640 1 --2- 172.21.15.6:0/3484586946 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3878065150 0x7f3878067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.818+0000 7f388be00640 1 -- 172.21.15.6:0/3484586946 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f388c018030 con 0x7f3880004020 2024-08-17T02:27:15.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.818+0000 7f3897e00640 1 --2- 172.21.15.6:0/3484586946 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3878065150 0x7f3878067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.819+0000 7f3897e00640 1 --2- 172.21.15.6:0/3484586946 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3878065150 0x7f3878067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3884032000 tx=0x7f3884033000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:15.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:15.822+0000 7f388be00640 1 -- 172.21.15.6:0/3484586946 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f388c050ec0 con 0x7f3880004020 2024-08-17T02:27:16.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.074+0000 7f389f400640 1 -- 172.21.15.6:0/3484586946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f3898153cf0 con 0x7f3880004020 2024-08-17T02:27:16.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.078+0000 7f388be00640 1 -- 172.21.15.6:0/3484586946 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f388c0220a0 con 0x7f3880004020 2024-08-17T02:27:16.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.080+0000 7f389f400640 1 -- 172.21.15.6:0/3484586946 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3878065150 msgr2=0x7f3878067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.080+0000 7f389f400640 1 --2- 172.21.15.6:0/3484586946 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3878065150 0x7f3878067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3884032000 tx=0x7f3884033000 comp rx=0 tx=0).stop 2024-08-17T02:27:16.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.080+0000 7f389f400640 1 -- 172.21.15.6:0/3484586946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3880004020 msgr2=0x7f3898169e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.080+0000 7f389f400640 1 --2- 172.21.15.6:0/3484586946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3880004020 0x7f3898169e30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f388c011b70 tx=0x7f388c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.080+0000 7f389f400640 1 -- 172.21.15.6:0/3484586946 shutdown_connections 2024-08-17T02:27:16.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.080+0000 7f389f400640 1 --2- 172.21.15.6:0/3484586946 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3878065150 0x7f3878067600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.080+0000 7f389f400640 1 --2- 172.21.15.6:0/3484586946 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f389815b070 0x7f389815b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.080+0000 7f389f400640 1 --2- 172.21.15.6:0/3484586946 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f389814f730 0x7f389814c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.080+0000 7f389f400640 1 --2- 172.21.15.6:0/3484586946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3880004020 0x7f3898169e30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.080+0000 7f389f400640 1 -- 172.21.15.6:0/3484586946 >> 172.21.15.6:0/3484586946 conn(0x7f3898066e60 msgr2=0x7f389806ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:16.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.080+0000 7f389f400640 1 -- 172.21.15.6:0/3484586946 shutdown_connections 2024-08-17T02:27:16.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.081+0000 7f389f400640 1 -- 172.21.15.6:0/3484586946 wait complete. 2024-08-17T02:27:16.096 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:27:16.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.247+0000 7f80f4200640 1 Processor -- start 2024-08-17T02:27:16.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.247+0000 7f80f4200640 1 -- start start 2024-08-17T02:27:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.248+0000 7f80f4200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f80ec1590b0 0x7f80ec0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.248+0000 7f80f4200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f80ec0acf10 0x7f80ec159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.248+0000 7f80f4200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ec15a4e0 con 0x7f80ec0afca0 2024-08-17T02:27:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.248+0000 7f80f4200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ec0b0980 con 0x7f80ec0acf10 2024-08-17T02:27:16.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.248+0000 7f80f4200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ec0c92b0 con 0x7f80ec1590b0 2024-08-17T02:27:16.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.249+0000 7f80f2200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f80ec0acf10 0x7f80ec159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.249+0000 7f80f1800640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f80ec0afca0 0x7f80ec1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60096/0 (socket says 172.21.15.6:60096) 2024-08-17T02:27:16.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.249+0000 7f80f1800640 1 -- 172.21.15.6:0/1157225700 learned_addr learned my addr 172.21.15.6:0/1157225700 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:16.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.249+0000 7f80f0e00640 1 --2- 172.21.15.6:0/1157225700 >> v2:172.21.15.136:3300/0 conn(0x7f80ec1590b0 0x7f80ec0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.249+0000 7f80f2200640 1 -- 172.21.15.6:0/1157225700 >> v2:172.21.15.136:3300/0 conn(0x7f80ec1590b0 msgr2=0x7f80ec0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:16.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.249+0000 7f80f2200640 1 --2- 172.21.15.6:0/1157225700 >> v2:172.21.15.136:3300/0 conn(0x7f80ec1590b0 0x7f80ec0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.249+0000 7f80f2200640 1 -- 172.21.15.6:0/1157225700 >> v1:172.21.15.6:6789/0 conn(0x7f80ec0afca0 legacy=0x7f80ec1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.249+0000 7f80f2200640 1 -- 172.21.15.6:0/1157225700 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec0ad480 con 0x7f80ec0acf10 2024-08-17T02:27:16.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.249+0000 7f80ebe00640 1 -- 172.21.15.6:0/1157225700 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228135627 0 0) 0x7f80e0001110 con 0x7f80ec0afca0 2024-08-17T02:27:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.250+0000 7f80f2200640 1 --2- 172.21.15.6:0/1157225700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80ec0acf10 0x7f80ec159fa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0c83b0 tx=0x7f80e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c0290bc6907151 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.250+0000 7f80ebe00640 1 -- 172.21.15.6:0/1157225700 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e4007550 con 0x7f80ec0acf10 2024-08-17T02:27:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.250+0000 7f80ebe00640 1 -- 172.21.15.6:0/1157225700 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e402d050 con 0x7f80ec0acf10 2024-08-17T02:27:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.251+0000 7f80ebe00640 1 -- 172.21.15.6:0/1157225700 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e40078e0 con 0x7f80ec0acf10 2024-08-17T02:27:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.251+0000 7f80f4200640 1 -- 172.21.15.6:0/1157225700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80ec0acf10 msgr2=0x7f80ec159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.251+0000 7f80f4200640 1 --2- 172.21.15.6:0/1157225700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80ec0acf10 0x7f80ec159fa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0c83b0 tx=0x7f80e4009780 comp rx=0 tx=0).stop 2024-08-17T02:27:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.251+0000 7f80f4200640 1 -- 172.21.15.6:0/1157225700 shutdown_connections 2024-08-17T02:27:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.251+0000 7f80f4200640 1 --2- 172.21.15.6:0/1157225700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80ec0acf10 0x7f80ec159fa0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.251+0000 7f80f4200640 1 --2- 172.21.15.6:0/1157225700 >> v2:172.21.15.136:3300/0 conn(0x7f80ec1590b0 0x7f80ec0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.251+0000 7f80f4200640 1 -- 172.21.15.6:0/1157225700 >> 172.21.15.6:0/1157225700 conn(0x7f80ec066e60 msgr2=0x7f80ec067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:16.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.251+0000 7f80f4200640 1 -- 172.21.15.6:0/1157225700 shutdown_connections 2024-08-17T02:27:16.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.251+0000 7f80f4200640 1 -- 172.21.15.6:0/1157225700 wait complete. 2024-08-17T02:27:16.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.252+0000 7f80f4200640 1 Processor -- start 2024-08-17T02:27:16.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.253+0000 7f80f4200640 1 -- start start 2024-08-17T02:27:16.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.253+0000 7f80f4200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f80ec0acf10 0x7f80ec142050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.253+0000 7f80f4200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80ec0afca0 0x7f80ec0c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.253+0000 7f80f4200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80ec1590b0 0x7f80ec153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.254+0000 7f80f4200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0c51f0 con 0x7f80ec0afca0 2024-08-17T02:27:16.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.254+0000 7f80f4200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0c45e0 con 0x7f80ec1590b0 2024-08-17T02:27:16.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.254+0000 7f80f4200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0c48c0 con 0x7f80ec0acf10 2024-08-17T02:27:16.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.254+0000 7f80f0e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80ec0afca0 0x7f80ec0c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.254+0000 7f80f0e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80ec0afca0 0x7f80ec0c7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52954/0 (socket says 172.21.15.6:52954) 2024-08-17T02:27:16.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.254+0000 7f80f0e00640 1 -- 172.21.15.6:0/2839828843 learned_addr learned my addr 172.21.15.6:0/2839828843 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:16.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.254+0000 7f80f0e00640 1 -- 172.21.15.6:0/2839828843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f80ec0acf10 msgr2=0x7f80ec142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.254+0000 7f80f1800640 1 --2- 172.21.15.6:0/2839828843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f80ec0acf10 0x7f80ec142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.254+0000 7f80f2200640 1 --2- 172.21.15.6:0/2839828843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80ec1590b0 0x7f80ec153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.254+0000 7f80f0e00640 1 --2- 172.21.15.6:0/2839828843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f80ec0acf10 0x7f80ec142050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.254+0000 7f80f0e00640 1 -- 172.21.15.6:0/2839828843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80ec1590b0 msgr2=0x7f80ec153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.254+0000 7f80f0e00640 1 --2- 172.21.15.6:0/2839828843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80ec1590b0 0x7f80ec153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.254+0000 7f80f0e00640 1 -- 172.21.15.6:0/2839828843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e4009a20 con 0x7f80ec0afca0 2024-08-17T02:27:16.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.254+0000 7f80f1800640 1 --2- 172.21.15.6:0/2839828843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f80ec0acf10 0x7f80ec142050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:16.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.254+0000 7f80f2200640 1 --2- 172.21.15.6:0/2839828843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80ec1590b0 0x7f80ec153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:16.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.255+0000 7f80f0e00640 1 --2- 172.21.15.6:0/2839828843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80ec0afca0 0x7f80ec0c7290 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009fd0 tx=0x7f80d80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.255+0000 7f80e8c00640 1 -- 172.21.15.6:0/2839828843 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d800c940 con 0x7f80ec0afca0 2024-08-17T02:27:16.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.255+0000 7f80e8c00640 1 -- 172.21.15.6:0/2839828843 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d800caa0 con 0x7f80ec0afca0 2024-08-17T02:27:16.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.255+0000 7f80e8c00640 1 -- 172.21.15.6:0/2839828843 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d800ce40 con 0x7f80ec0afca0 2024-08-17T02:27:16.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.255+0000 7f80f4200640 1 -- 172.21.15.6:0/2839828843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ec0c4ba0 con 0x7f80ec0afca0 2024-08-17T02:27:16.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.255+0000 7f80f4200640 1 -- 172.21.15.6:0/2839828843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ec142590 con 0x7f80ec0afca0 2024-08-17T02:27:16.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.256+0000 7f80f4200640 1 -- 172.21.15.6:0/2839828843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ec0c5360 con 0x7f80ec0afca0 2024-08-17T02:27:16.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.257+0000 7f80e8c00640 1 -- 172.21.15.6:0/2839828843 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f80d8013680 con 0x7f80ec0afca0 2024-08-17T02:27:16.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.258+0000 7f80e8c00640 1 --2- 172.21.15.6:0/2839828843 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f80cc0651d0 0x7f80cc067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.258+0000 7f80e8c00640 1 -- 172.21.15.6:0/2839828843 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f80d8082440 con 0x7f80ec0afca0 2024-08-17T02:27:16.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.258+0000 7f80f1800640 1 --2- 172.21.15.6:0/2839828843 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f80cc0651d0 0x7f80cc067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.259+0000 7f80f1800640 1 --2- 172.21.15.6:0/2839828843 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f80cc0651d0 0x7f80cc067680 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f80e0001820 tx=0x7f80e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.261+0000 7f80e8c00640 1 -- 172.21.15.6:0/2839828843 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f80d80507b0 con 0x7f80ec0afca0 2024-08-17T02:27:16.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.509+0000 7f80f4200640 1 -- 172.21.15.6:0/2839828843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f80ec063fb0 con 0x7f80ec0afca0 2024-08-17T02:27:16.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.513+0000 7f80e8c00640 1 -- 172.21.15.6:0/2839828843 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f80d8053dd0 con 0x7f80ec0afca0 2024-08-17T02:27:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.515+0000 7f80f4200640 1 -- 172.21.15.6:0/2839828843 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f80cc0651d0 msgr2=0x7f80cc067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.515+0000 7f80f4200640 1 --2- 172.21.15.6:0/2839828843 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f80cc0651d0 0x7f80cc067680 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f80e0001820 tx=0x7f80e0009040 comp rx=0 tx=0).stop 2024-08-17T02:27:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.515+0000 7f80f4200640 1 -- 172.21.15.6:0/2839828843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80ec0afca0 msgr2=0x7f80ec0c7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.515+0000 7f80f4200640 1 --2- 172.21.15.6:0/2839828843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80ec0afca0 0x7f80ec0c7290 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009fd0 tx=0x7f80d80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.515+0000 7f80f4200640 1 -- 172.21.15.6:0/2839828843 shutdown_connections 2024-08-17T02:27:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.515+0000 7f80f4200640 1 --2- 172.21.15.6:0/2839828843 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f80cc0651d0 0x7f80cc067680 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.515+0000 7f80f4200640 1 --2- 172.21.15.6:0/2839828843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80ec1590b0 0x7f80ec153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.515+0000 7f80f4200640 1 --2- 172.21.15.6:0/2839828843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80ec0afca0 0x7f80ec0c7290 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.515+0000 7f80f4200640 1 --2- 172.21.15.6:0/2839828843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f80ec0acf10 0x7f80ec142050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.515+0000 7f80f4200640 1 -- 172.21.15.6:0/2839828843 >> 172.21.15.6:0/2839828843 conn(0x7f80ec066e60 msgr2=0x7f80ec153140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.515+0000 7f80f4200640 1 -- 172.21.15.6:0/2839828843 shutdown_connections 2024-08-17T02:27:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.515+0000 7f80f4200640 1 -- 172.21.15.6:0/2839828843 wait complete. 2024-08-17T02:27:16.530 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:27:16.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.682+0000 7f3fac200640 1 Processor -- start 2024-08-17T02:27:16.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.682+0000 7f3fac200640 1 -- start start 2024-08-17T02:27:16.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.683+0000 7f3fac200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3fa41590b0 0x7f3fa40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.683+0000 7f3fac200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3fa40acf10 0x7f3fa4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.683+0000 7f3fac200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa415a4e0 con 0x7f3fa40afca0 2024-08-17T02:27:16.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.683+0000 7f3fac200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa40b0980 con 0x7f3fa41590b0 2024-08-17T02:27:16.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.683+0000 7f3fac200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa40c92b0 con 0x7f3fa40acf10 2024-08-17T02:27:16.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.684+0000 7f3fa9800640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3fa40afca0 0x7f3fa41589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60110/0 (socket says 172.21.15.6:60110) 2024-08-17T02:27:16.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.684+0000 7f3fa8e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3fa41590b0 0x7f3fa40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.684+0000 7f3fa9800640 1 -- 172.21.15.6:0/224672781 learned_addr learned my addr 172.21.15.6:0/224672781 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:16.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.684+0000 7f3faa200640 1 --2- 172.21.15.6:0/224672781 >> v2:172.21.15.136:3300/0 conn(0x7f3fa40acf10 0x7f3fa4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.684+0000 7f3fa3e00640 1 -- 172.21.15.6:0/224672781 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423343125 0 0) 0x7f3f98001110 con 0x7f3fa40afca0 2024-08-17T02:27:16.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.684+0000 7f3fa3e00640 1 -- 172.21.15.6:0/224672781 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f8c0034e0 con 0x7f3fa40afca0 2024-08-17T02:27:16.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.684+0000 7f3fa8e00640 1 -- 172.21.15.6:0/224672781 >> v2:172.21.15.136:3300/0 conn(0x7f3fa40acf10 msgr2=0x7f3fa4159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:16.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.684+0000 7f3fa8e00640 1 --2- 172.21.15.6:0/224672781 >> v2:172.21.15.136:3300/0 conn(0x7f3fa40acf10 0x7f3fa4159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.684+0000 7f3fa8e00640 1 -- 172.21.15.6:0/224672781 >> v1:172.21.15.6:6789/0 conn(0x7f3fa40afca0 legacy=0x7f3fa41589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.684+0000 7f3fa8e00640 1 -- 172.21.15.6:0/224672781 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa40ad480 con 0x7f3fa41590b0 2024-08-17T02:27:16.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.685+0000 7f3fa8e00640 1 --2- 172.21.15.6:0/224672781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa41590b0 0x7f3fa40b0070 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40cb4a0 tx=0x7f3f900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade10e64ed6e97be server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.685+0000 7f3fa3e00640 1 -- 172.21.15.6:0/224672781 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9002adb0 con 0x7f3fa41590b0 2024-08-17T02:27:16.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.686+0000 7f3fa3e00640 1 -- 172.21.15.6:0/224672781 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f90032440 con 0x7f3fa41590b0 2024-08-17T02:27:16.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.686+0000 7f3fa3e00640 1 -- 172.21.15.6:0/224672781 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90032820 con 0x7f3fa41590b0 2024-08-17T02:27:16.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.686+0000 7f3fac200640 1 -- 172.21.15.6:0/224672781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa41590b0 msgr2=0x7f3fa40b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.686+0000 7f3fac200640 1 --2- 172.21.15.6:0/224672781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa41590b0 0x7f3fa40b0070 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40cb4a0 tx=0x7f3f900090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.686+0000 7f3fac200640 1 -- 172.21.15.6:0/224672781 shutdown_connections 2024-08-17T02:27:16.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.686+0000 7f3fac200640 1 --2- 172.21.15.6:0/224672781 >> v2:172.21.15.136:3300/0 conn(0x7f3fa40acf10 0x7f3fa4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.686+0000 7f3fac200640 1 --2- 172.21.15.6:0/224672781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa41590b0 0x7f3fa40b0070 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.686+0000 7f3fac200640 1 -- 172.21.15.6:0/224672781 >> 172.21.15.6:0/224672781 conn(0x7f3fa4066e60 msgr2=0x7f3fa4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.686+0000 7f3fac200640 1 -- 172.21.15.6:0/224672781 shutdown_connections 2024-08-17T02:27:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.686+0000 7f3fac200640 1 -- 172.21.15.6:0/224672781 wait complete. 2024-08-17T02:27:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.688+0000 7f3fac200640 1 Processor -- start 2024-08-17T02:27:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.688+0000 7f3fac200640 1 -- start start 2024-08-17T02:27:16.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.689+0000 7f3fac200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa40acf10 0x7f3fa4146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.689+0000 7f3fac200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fa40afca0 0x7f3fa40c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.689+0000 7f3fac200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa41590b0 0x7f3fa406a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.689+0000 7f3fac200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40c27f0 con 0x7f3fa41590b0 2024-08-17T02:27:16.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.689+0000 7f3fac200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40c7ee0 con 0x7f3fa40afca0 2024-08-17T02:27:16.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.689+0000 7f3fac200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40c81c0 con 0x7f3fa40acf10 2024-08-17T02:27:16.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.689+0000 7f3faa200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa41590b0 0x7f3fa406a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.689+0000 7f3faa200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa41590b0 0x7f3fa406a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52964/0 (socket says 172.21.15.6:52964) 2024-08-17T02:27:16.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.689+0000 7f3faa200640 1 -- 172.21.15.6:0/692159894 learned_addr learned my addr 172.21.15.6:0/692159894 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:16.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.689+0000 7f3fa8e00640 1 --2- 172.21.15.6:0/692159894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fa40afca0 0x7f3fa40c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.689+0000 7f3fa9800640 1 --2- 172.21.15.6:0/692159894 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa40acf10 0x7f3fa4146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.689+0000 7f3faa200640 1 -- 172.21.15.6:0/692159894 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa40acf10 msgr2=0x7f3fa4146200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.689+0000 7f3faa200640 1 --2- 172.21.15.6:0/692159894 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa40acf10 0x7f3fa4146200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.689+0000 7f3faa200640 1 -- 172.21.15.6:0/692159894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fa40afca0 msgr2=0x7f3fa40c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.689+0000 7f3faa200640 1 --2- 172.21.15.6:0/692159894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fa40afca0 0x7f3fa40c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.689+0000 7f3faa200640 1 -- 172.21.15.6:0/692159894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f90009390 con 0x7f3fa41590b0 2024-08-17T02:27:16.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.689+0000 7f3fa9800640 1 --2- 172.21.15.6:0/692159894 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa40acf10 0x7f3fa4146200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:16.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.690+0000 7f3faa200640 1 --2- 172.21.15.6:0/692159894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa41590b0 0x7f3fa406a800 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c007f20 tx=0x7f3f9c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.690+0000 7f3fa0c00640 1 -- 172.21.15.6:0/692159894 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c00ee30 con 0x7f3fa41590b0 2024-08-17T02:27:16.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.690+0000 7f3fa0c00640 1 -- 172.21.15.6:0/692159894 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c014420 con 0x7f3fa41590b0 2024-08-17T02:27:16.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.690+0000 7f3fa0c00640 1 -- 172.21.15.6:0/692159894 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0147e0 con 0x7f3fa41590b0 2024-08-17T02:27:16.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.690+0000 7f3fac200640 1 -- 172.21.15.6:0/692159894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa40c21a0 con 0x7f3fa41590b0 2024-08-17T02:27:16.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.690+0000 7f3fac200640 1 -- 172.21.15.6:0/692159894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa40c4b20 con 0x7f3fa41590b0 2024-08-17T02:27:16.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.691+0000 7f3fac200640 1 -- 172.21.15.6:0/692159894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa40c4d10 con 0x7f3fa41590b0 2024-08-17T02:27:16.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.692+0000 7f3fa0c00640 1 -- 172.21.15.6:0/692159894 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3f9c014b50 con 0x7f3fa41590b0 2024-08-17T02:27:16.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.693+0000 7f3fa0c00640 1 --2- 172.21.15.6:0/692159894 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3f84065150 0x7f3f84067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.693+0000 7f3fa0c00640 1 -- 172.21.15.6:0/692159894 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3f9c082850 con 0x7f3fa41590b0 2024-08-17T02:27:16.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.693+0000 7f3fa9800640 1 --2- 172.21.15.6:0/692159894 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3f84065150 0x7f3f84067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.694+0000 7f3fa9800640 1 --2- 172.21.15.6:0/692159894 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3f84065150 0x7f3f84067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3f98001270 tx=0x7f3f98009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.697+0000 7f3fa0c00640 1 -- 172.21.15.6:0/692159894 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3fa40c4d10 con 0x7f3fa41590b0 2024-08-17T02:27:16.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.952+0000 7f3fac200640 1 -- 172.21.15.6:0/692159894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f3fa40c4d10 con 0x7f3fa41590b0 2024-08-17T02:27:16.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.956+0000 7f3fa0c00640 1 -- 172.21.15.6:0/692159894 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3fa40c4d10 con 0x7f3fa41590b0 2024-08-17T02:27:16.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.958+0000 7f3fac200640 1 -- 172.21.15.6:0/692159894 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3f84065150 msgr2=0x7f3f84067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.958+0000 7f3fac200640 1 --2- 172.21.15.6:0/692159894 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3f84065150 0x7f3f84067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3f98001270 tx=0x7f3f98009040 comp rx=0 tx=0).stop 2024-08-17T02:27:16.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.958+0000 7f3fac200640 1 -- 172.21.15.6:0/692159894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa41590b0 msgr2=0x7f3fa406a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.958+0000 7f3fac200640 1 --2- 172.21.15.6:0/692159894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa41590b0 0x7f3fa406a800 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c007f20 tx=0x7f3f9c009860 comp rx=0 tx=0).stop 2024-08-17T02:27:16.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.958+0000 7f3fac200640 1 -- 172.21.15.6:0/692159894 shutdown_connections 2024-08-17T02:27:16.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.958+0000 7f3fac200640 1 --2- 172.21.15.6:0/692159894 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f3f84065150 0x7f3f84067600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.958+0000 7f3fac200640 1 --2- 172.21.15.6:0/692159894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa41590b0 0x7f3fa406a800 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.958+0000 7f3fac200640 1 --2- 172.21.15.6:0/692159894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fa40afca0 0x7f3fa40c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.958+0000 7f3fac200640 1 --2- 172.21.15.6:0/692159894 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa40acf10 0x7f3fa4146200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.958+0000 7f3fac200640 1 -- 172.21.15.6:0/692159894 >> 172.21.15.6:0/692159894 conn(0x7f3fa4066e60 msgr2=0x7f3fa40aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:16.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.958+0000 7f3fac200640 1 -- 172.21.15.6:0/692159894 shutdown_connections 2024-08-17T02:27:16.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:16.958+0000 7f3fac200640 1 -- 172.21.15.6:0/692159894 wait complete. 2024-08-17T02:27:16.973 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:27:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.125+0000 7fae23e00640 1 Processor -- start 2024-08-17T02:27:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.125+0000 7fae23e00640 1 -- start start 2024-08-17T02:27:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.126+0000 7fae23e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae1c1590b0 0x7fae1c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.126+0000 7fae23e00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1c0c92b0 con 0x7fae1c0afca0 2024-08-17T02:27:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.126+0000 7fae23e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1c0ad480 con 0x7fae1c0acf10 2024-08-17T02:27:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.126+0000 7fae23e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0b0980 con 0x7fae1c1590b0 2024-08-17T02:27:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.127+0000 7fae21400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fae1c0afca0 0x7fae1c1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60118/0 (socket says 172.21.15.6:60118) 2024-08-17T02:27:17.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.127+0000 7fae21400640 1 -- 172.21.15.6:0/2520639211 learned_addr learned my addr 172.21.15.6:0/2520639211 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:17.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.127+0000 7fae20a00640 1 --2- 172.21.15.6:0/2520639211 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae1c1590b0 0x7fae1c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.127+0000 7fae1be00640 1 -- 172.21.15.6:0/2520639211 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276794589 0 0) 0x7fae1c0c92b0 con 0x7fae1c0afca0 2024-08-17T02:27:17.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.127+0000 7fae1be00640 1 -- 172.21.15.6:0/2520639211 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae040034e0 con 0x7fae1c0afca0 2024-08-17T02:27:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.127+0000 7fae1be00640 1 -- 172.21.15.6:0/2520639211 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917505316 0 0) 0x7fae1c0ad480 con 0x7fae1c0acf10 2024-08-17T02:27:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.127+0000 7fae20a00640 1 -- 172.21.15.6:0/2520639211 >> v1:172.21.15.136:6789/0 conn(0x7fae1c0acf10 legacy=0x7fae1c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.127+0000 7fae20a00640 1 -- 172.21.15.6:0/2520639211 >> v1:172.21.15.6:6789/0 conn(0x7fae1c0afca0 legacy=0x7fae1c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.127+0000 7fae20a00640 1 -- 172.21.15.6:0/2520639211 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c0ad760 con 0x7fae1c1590b0 2024-08-17T02:27:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.128+0000 7fae20a00640 1 --2- 172.21.15.6:0/2520639211 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae1c1590b0 0x7fae1c0b0070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fae08009880 tx=0x7fae080090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87d22327cae950 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.129+0000 7fae1be00640 1 -- 172.21.15.6:0/2520639211 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0802ae20 con 0x7fae1c1590b0 2024-08-17T02:27:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.129+0000 7fae1be00640 1 -- 172.21.15.6:0/2520639211 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae08032440 con 0x7fae1c1590b0 2024-08-17T02:27:17.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.129+0000 7fae1be00640 1 -- 172.21.15.6:0/2520639211 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae080327e0 con 0x7fae1c1590b0 2024-08-17T02:27:17.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.129+0000 7fae23e00640 1 -- 172.21.15.6:0/2520639211 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae1c1590b0 msgr2=0x7fae1c0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.129+0000 7fae23e00640 1 --2- 172.21.15.6:0/2520639211 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae1c1590b0 0x7fae1c0b0070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fae08009880 tx=0x7fae080090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.129+0000 7fae23e00640 1 -- 172.21.15.6:0/2520639211 shutdown_connections 2024-08-17T02:27:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.129+0000 7fae23e00640 1 --2- 172.21.15.6:0/2520639211 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae1c1590b0 0x7fae1c0b0070 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.129+0000 7fae23e00640 1 -- 172.21.15.6:0/2520639211 >> 172.21.15.6:0/2520639211 conn(0x7fae1c066e60 msgr2=0x7fae1c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.130+0000 7fae23e00640 1 -- 172.21.15.6:0/2520639211 shutdown_connections 2024-08-17T02:27:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.130+0000 7fae23e00640 1 -- 172.21.15.6:0/2520639211 wait complete. 2024-08-17T02:27:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.131+0000 7fae23e00640 1 Processor -- start 2024-08-17T02:27:17.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.131+0000 7fae23e00640 1 -- start start 2024-08-17T02:27:17.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.132+0000 7fae23e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae1c0acf10 0x7fae1c142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.132+0000 7fae23e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c0afca0 0x7fae1c142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.132+0000 7fae23e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae1c1590b0 0x7fae1c14bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.132+0000 7fae23e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0c1590 con 0x7fae1c0afca0 2024-08-17T02:27:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.132+0000 7fae23e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0c0980 con 0x7fae1c1590b0 2024-08-17T02:27:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.132+0000 7fae23e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0c0c60 con 0x7fae1c0acf10 2024-08-17T02:27:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.132+0000 7fae20a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c0afca0 0x7fae1c142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.132+0000 7fae20a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c0afca0 0x7fae1c142f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52974/0 (socket says 172.21.15.6:52974) 2024-08-17T02:27:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.132+0000 7fae20a00640 1 -- 172.21.15.6:0/4076511042 learned_addr learned my addr 172.21.15.6:0/4076511042 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.133+0000 7fae21400640 1 --2- 172.21.15.6:0/4076511042 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae1c0acf10 0x7fae1c142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.133+0000 7fae21e00640 1 --2- 172.21.15.6:0/4076511042 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae1c1590b0 0x7fae1c14bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.133+0000 7fae20a00640 1 -- 172.21.15.6:0/4076511042 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae1c0acf10 msgr2=0x7fae1c142a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.133+0000 7fae20a00640 1 --2- 172.21.15.6:0/4076511042 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae1c0acf10 0x7fae1c142a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.133+0000 7fae20a00640 1 -- 172.21.15.6:0/4076511042 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae1c1590b0 msgr2=0x7fae1c14bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.133+0000 7fae20a00640 1 --2- 172.21.15.6:0/4076511042 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae1c1590b0 0x7fae1c14bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.133+0000 7fae20a00640 1 -- 172.21.15.6:0/4076511042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae08009390 con 0x7fae1c0afca0 2024-08-17T02:27:17.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.133+0000 7fae20a00640 1 --2- 172.21.15.6:0/4076511042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c0afca0 0x7fae1c142f60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fae080097d0 tx=0x7fae08032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:17.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.133+0000 7fae18c00640 1 -- 172.21.15.6:0/4076511042 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae08031a60 con 0x7fae1c0afca0 2024-08-17T02:27:17.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.133+0000 7fae18c00640 1 -- 172.21.15.6:0/4076511042 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae08031bc0 con 0x7fae1c0afca0 2024-08-17T02:27:17.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.133+0000 7fae18c00640 1 -- 172.21.15.6:0/4076511042 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0803d420 con 0x7fae1c0afca0 2024-08-17T02:27:17.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.133+0000 7fae23e00640 1 -- 172.21.15.6:0/4076511042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1c0c0f40 con 0x7fae1c0afca0 2024-08-17T02:27:17.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.134+0000 7fae23e00640 1 -- 172.21.15.6:0/4076511042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1c140120 con 0x7fae1c0afca0 2024-08-17T02:27:17.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.135+0000 7fae23e00640 1 -- 172.21.15.6:0/4076511042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1c1402b0 con 0x7fae1c0afca0 2024-08-17T02:27:17.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.135+0000 7fae18c00640 1 -- 172.21.15.6:0/4076511042 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fae08039040 con 0x7fae1c0afca0 2024-08-17T02:27:17.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.136+0000 7fae18c00640 1 --2- 172.21.15.6:0/4076511042 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fadfc065150 0x7fadfc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.136+0000 7fae18c00640 1 -- 172.21.15.6:0/4076511042 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fae080a1d50 con 0x7fae1c0afca0 2024-08-17T02:27:17.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.137+0000 7fae21400640 1 --2- 172.21.15.6:0/4076511042 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fadfc065150 0x7fadfc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.138+0000 7fae21400640 1 --2- 172.21.15.6:0/4076511042 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fadfc065150 0x7fadfc067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0c2710 tx=0x7fae10009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:17.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.140+0000 7fae18c00640 1 -- 172.21.15.6:0/4076511042 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fae08070180 con 0x7fae1c0afca0 2024-08-17T02:27:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.387+0000 7fae23e00640 1 -- 172.21.15.6:0/4076511042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fae1c063fb0 con 0x7fae1c0afca0 2024-08-17T02:27:17.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.392+0000 7fae18c00640 1 -- 172.21.15.6:0/4076511042 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7fae080737a0 con 0x7fae1c0afca0 2024-08-17T02:27:17.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.394+0000 7fae23e00640 1 -- 172.21.15.6:0/4076511042 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fadfc065150 msgr2=0x7fadfc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.394+0000 7fae23e00640 1 --2- 172.21.15.6:0/4076511042 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fadfc065150 0x7fadfc067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0c2710 tx=0x7fae10009040 comp rx=0 tx=0).stop 2024-08-17T02:27:17.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.394+0000 7fae23e00640 1 -- 172.21.15.6:0/4076511042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c0afca0 msgr2=0x7fae1c142f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.394+0000 7fae23e00640 1 --2- 172.21.15.6:0/4076511042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c0afca0 0x7fae1c142f60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fae080097d0 tx=0x7fae08032000 comp rx=0 tx=0).stop 2024-08-17T02:27:17.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.394+0000 7fae23e00640 1 -- 172.21.15.6:0/4076511042 shutdown_connections 2024-08-17T02:27:17.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.394+0000 7fae23e00640 1 --2- 172.21.15.6:0/4076511042 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fadfc065150 0x7fadfc067600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.394+0000 7fae23e00640 1 --2- 172.21.15.6:0/4076511042 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae1c1590b0 0x7fae1c14bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.394+0000 7fae23e00640 1 --2- 172.21.15.6:0/4076511042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c0afca0 0x7fae1c142f60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.394+0000 7fae23e00640 1 --2- 172.21.15.6:0/4076511042 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae1c0acf10 0x7fae1c142a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.394+0000 7fae23e00640 1 -- 172.21.15.6:0/4076511042 >> 172.21.15.6:0/4076511042 conn(0x7fae1c066e60 msgr2=0x7fae1c0ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:17.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.394+0000 7fae23e00640 1 -- 172.21.15.6:0/4076511042 shutdown_connections 2024-08-17T02:27:17.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.394+0000 7fae23e00640 1 -- 172.21.15.6:0/4076511042 wait complete. 2024-08-17T02:27:17.411 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:27:17.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.562+0000 7f9118a00640 1 Processor -- start 2024-08-17T02:27:17.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.563+0000 7f9118a00640 1 -- start start 2024-08-17T02:27:17.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.564+0000 7f9118a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9114158b20 0x7f91140a9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.564+0000 7f9118a00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91140b0ec0 con 0x7f9114066e60 2024-08-17T02:27:17.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.564+0000 7f9118a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91140acca0 con 0x7f9114158ef0 2024-08-17T02:27:17.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.564+0000 7f9118a00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91140b0870 con 0x7f9114158b20 2024-08-17T02:27:17.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.564+0000 7f9113200640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9114066e60 0x7f91140b1350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60122/0 (socket says 172.21.15.6:60122) 2024-08-17T02:27:17.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.564+0000 7f9113200640 1 -- 172.21.15.6:0/745543423 learned_addr learned my addr 172.21.15.6:0/745543423 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:17.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.565+0000 7f9112800640 1 --2- 172.21.15.6:0/745543423 >> v2:172.21.15.136:3300/0 conn(0x7f9114158b20 0x7f91140a9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.565+0000 7f9111e00640 1 -- 172.21.15.6:0/745543423 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242323769 0 0) 0x7f91140b0ec0 con 0x7f9114066e60 2024-08-17T02:27:17.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.565+0000 7f9111e00640 1 -- 172.21.15.6:0/745543423 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90f80034e0 con 0x7f9114066e60 2024-08-17T02:27:17.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.565+0000 7f9111e00640 1 -- 172.21.15.6:0/745543423 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1748880916 0 0) 0x7f90f80034e0 con 0x7f9114066e60 2024-08-17T02:27:17.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.565+0000 7f9111e00640 1 -- 172.21.15.6:0/745543423 >> v2:172.21.15.136:3300/0 conn(0x7f9114158b20 msgr2=0x7f91140a9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:17.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.565+0000 7f9111e00640 1 --2- 172.21.15.6:0/745543423 >> v2:172.21.15.136:3300/0 conn(0x7f9114158b20 0x7f91140a9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.565+0000 7f9111e00640 1 -- 172.21.15.6:0/745543423 >> v1:172.21.15.136:6789/0 conn(0x7f9114158ef0 legacy=0x7f91140ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.565+0000 7f9111e00640 1 -- 172.21.15.6:0/745543423 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91140b0b50 con 0x7f9114066e60 2024-08-17T02:27:17.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.565+0000 7f9111e00640 1 -- 172.21.15.6:0/745543423 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f910c0017f0 con 0x7f9114066e60 2024-08-17T02:27:17.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.565+0000 7f9111e00640 1 -- 172.21.15.6:0/745543423 >> v1:172.21.15.6:6789/0 conn(0x7f9114066e60 legacy=0x7f91140b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.565+0000 7f9111e00640 1 --2- 172.21.15.6:0/745543423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f80039d0 0x7f90f8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.565+0000 7f9111e00640 1 --2- 172.21.15.6:0/745543423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90f8004780 0x7f90f8004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.565+0000 7f9111e00640 1 --2- 172.21.15.6:0/745543423 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90f8005130 0x7f90f800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.565+0000 7f9111e00640 1 -- 172.21.15.6:0/745543423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91140b0870 con 0x7f90f80039d0 2024-08-17T02:27:17.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.565+0000 7f9111e00640 1 -- 172.21.15.6:0/745543423 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f800c040 con 0x7f90f8004780 2024-08-17T02:27:17.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.565+0000 7f9111e00640 1 -- 172.21.15.6:0/745543423 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f800c200 con 0x7f90f8005130 2024-08-17T02:27:17.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.565+0000 7f9112800640 1 --2- 172.21.15.6:0/745543423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f80039d0 0x7f90f8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.566+0000 7f9109e00640 1 --2- 172.21.15.6:0/745543423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90f8004780 0x7f90f8004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.566+0000 7f9113200640 1 --2- 172.21.15.6:0/745543423 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90f8005130 0x7f90f800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.566+0000 7f9112800640 1 -- 172.21.15.6:0/745543423 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90f8005130 msgr2=0x7f90f800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:17.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.566+0000 7f9112800640 1 --2- 172.21.15.6:0/745543423 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90f8005130 0x7f90f800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.566+0000 7f9112800640 1 -- 172.21.15.6:0/745543423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90f8004780 msgr2=0x7f90f8004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:17.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.566+0000 7f9112800640 1 --2- 172.21.15.6:0/745543423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90f8004780 0x7f90f8004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.566+0000 7f9112800640 1 -- 172.21.15.6:0/745543423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f80034e0 con 0x7f90f80039d0 2024-08-17T02:27:17.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.566+0000 7f9113200640 1 -- 172.21.15.6:0/745543423 reap_dead start 2024-08-17T02:27:17.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.567+0000 7f9112800640 1 --2- 172.21.15.6:0/745543423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f80039d0 0x7f90f8003de0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9104009b70 tx=0x7f91040090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e579a6a295730ffe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:17.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.567+0000 7f9111e00640 1 -- 172.21.15.6:0/745543423 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9104031400 con 0x7f90f80039d0 2024-08-17T02:27:17.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.567+0000 7f9111e00640 1 -- 172.21.15.6:0/745543423 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910402d050 con 0x7f90f80039d0 2024-08-17T02:27:17.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.567+0000 7f9111e00640 1 -- 172.21.15.6:0/745543423 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9104031790 con 0x7f90f80039d0 2024-08-17T02:27:17.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.568+0000 7f9118a00640 1 -- 172.21.15.6:0/745543423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f80039d0 msgr2=0x7f90f8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.568+0000 7f9118a00640 1 --2- 172.21.15.6:0/745543423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f80039d0 0x7f90f8003de0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9104009b70 tx=0x7f91040090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.568+0000 7f9118a00640 1 -- 172.21.15.6:0/745543423 shutdown_connections 2024-08-17T02:27:17.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.568+0000 7f9118a00640 1 --2- 172.21.15.6:0/745543423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f80039d0 0x7f90f8003de0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.568+0000 7f9118a00640 1 -- 172.21.15.6:0/745543423 >> 172.21.15.6:0/745543423 conn(0x7f9114095a70 msgr2=0x7f9114095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:17.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.568+0000 7f9118a00640 1 -- 172.21.15.6:0/745543423 shutdown_connections 2024-08-17T02:27:17.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.568+0000 7f9118a00640 1 -- 172.21.15.6:0/745543423 wait complete. 2024-08-17T02:27:17.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.569+0000 7f9118a00640 1 Processor -- start 2024-08-17T02:27:17.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.569+0000 7f9118a00640 1 -- start start 2024-08-17T02:27:17.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.570+0000 7f9118a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f80039d0 0x7f9114159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.570+0000 7f9118a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f911414baf0 0x7f911415bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.570+0000 7f9118a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f911414b1e0 0x7f911406b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.570+0000 7f9118a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91140c5bf0 con 0x7f90f80039d0 2024-08-17T02:27:17.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.570+0000 7f9118a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911415a8d0 con 0x7f911414b1e0 2024-08-17T02:27:17.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.570+0000 7f9118a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911415a310 con 0x7f911414baf0 2024-08-17T02:27:17.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.570+0000 7f9112800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f80039d0 0x7f9114159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.570+0000 7f9112800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f80039d0 0x7f9114159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52994/0 (socket says 172.21.15.6:52994) 2024-08-17T02:27:17.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.570+0000 7f9112800640 1 -- 172.21.15.6:0/122547643 learned_addr learned my addr 172.21.15.6:0/122547643 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.571+0000 7f9109e00640 1 --2- 172.21.15.6:0/122547643 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f911414baf0 0x7f911415bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.571+0000 7f9113200640 1 --2- 172.21.15.6:0/122547643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f911414b1e0 0x7f911406b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.571+0000 7f9112800640 1 -- 172.21.15.6:0/122547643 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f911414baf0 msgr2=0x7f911415bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.571+0000 7f9112800640 1 --2- 172.21.15.6:0/122547643 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f911414baf0 0x7f911415bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.571+0000 7f9112800640 1 -- 172.21.15.6:0/122547643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f911414b1e0 msgr2=0x7f911406b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.571+0000 7f9112800640 1 --2- 172.21.15.6:0/122547643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f911414b1e0 0x7f911406b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.571+0000 7f9112800640 1 -- 172.21.15.6:0/122547643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911415a5f0 con 0x7f90f80039d0 2024-08-17T02:27:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.571+0000 7f9113200640 1 --2- 172.21.15.6:0/122547643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f911414b1e0 0x7f911406b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.571+0000 7f9112800640 1 --2- 172.21.15.6:0/122547643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f80039d0 0x7f9114159d10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f910402aae0 tx=0x7f9104035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.571+0000 7f910aa00640 1 -- 172.21.15.6:0/122547643 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9104000c40 con 0x7f90f80039d0 2024-08-17T02:27:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.571+0000 7f910aa00640 1 -- 172.21.15.6:0/122547643 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9104030a60 con 0x7f90f80039d0 2024-08-17T02:27:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.571+0000 7f910aa00640 1 -- 172.21.15.6:0/122547643 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9104030e20 con 0x7f90f80039d0 2024-08-17T02:27:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.571+0000 7f9118a00640 1 -- 172.21.15.6:0/122547643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91140c5e90 con 0x7f90f80039d0 2024-08-17T02:27:17.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.572+0000 7f9118a00640 1 -- 172.21.15.6:0/122547643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911414b650 con 0x7f90f80039d0 2024-08-17T02:27:17.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.572+0000 7f9118a00640 1 -- 172.21.15.6:0/122547643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91140c5a50 con 0x7f90f80039d0 2024-08-17T02:27:17.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.573+0000 7f910aa00640 1 -- 172.21.15.6:0/122547643 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9104045620 con 0x7f90f80039d0 2024-08-17T02:27:17.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.574+0000 7f910aa00640 1 --2- 172.21.15.6:0/122547643 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f90f0065150 0x7f90f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.574+0000 7f910aa00640 1 -- 172.21.15.6:0/122547643 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f91040a3270 con 0x7f90f80039d0 2024-08-17T02:27:17.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.575+0000 7f9109e00640 1 --2- 172.21.15.6:0/122547643 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f90f0065150 0x7f90f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.575+0000 7f9109e00640 1 --2- 172.21.15.6:0/122547643 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f90f0065150 0x7f90f0067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f90fc000f60 tx=0x7f90fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:17.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.578+0000 7f910aa00640 1 -- 172.21.15.6:0/122547643 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f91140c5a50 con 0x7f90f80039d0 2024-08-17T02:27:17.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.829+0000 7f9118a00640 1 -- 172.21.15.6:0/122547643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f91140c5a50 con 0x7f90f80039d0 2024-08-17T02:27:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.833+0000 7f910aa00640 1 -- 172.21.15.6:0/122547643 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f91140c5a50 con 0x7f90f80039d0 2024-08-17T02:27:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.835+0000 7f9118a00640 1 -- 172.21.15.6:0/122547643 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f90f0065150 msgr2=0x7f90f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.835+0000 7f9118a00640 1 --2- 172.21.15.6:0/122547643 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f90f0065150 0x7f90f0067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f90fc000f60 tx=0x7f90fc009040 comp rx=0 tx=0).stop 2024-08-17T02:27:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.835+0000 7f9118a00640 1 -- 172.21.15.6:0/122547643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f80039d0 msgr2=0x7f9114159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.835+0000 7f9118a00640 1 --2- 172.21.15.6:0/122547643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f80039d0 0x7f9114159d10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f910402aae0 tx=0x7f9104035000 comp rx=0 tx=0).stop 2024-08-17T02:27:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.835+0000 7f9118a00640 1 -- 172.21.15.6:0/122547643 shutdown_connections 2024-08-17T02:27:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.835+0000 7f9118a00640 1 --2- 172.21.15.6:0/122547643 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f90f0065150 0x7f90f0067600 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.835+0000 7f9118a00640 1 --2- 172.21.15.6:0/122547643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f911414b1e0 0x7f911406b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.835+0000 7f9118a00640 1 --2- 172.21.15.6:0/122547643 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f911414baf0 0x7f911415bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.835+0000 7f9118a00640 1 --2- 172.21.15.6:0/122547643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f80039d0 0x7f9114159d10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.835+0000 7f9118a00640 1 -- 172.21.15.6:0/122547643 >> 172.21.15.6:0/122547643 conn(0x7f9114095a70 msgr2=0x7f911406aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.835+0000 7f9118a00640 1 -- 172.21.15.6:0/122547643 shutdown_connections 2024-08-17T02:27:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:17.835+0000 7f9118a00640 1 -- 172.21.15.6:0/122547643 wait complete. 2024-08-17T02:27:17.852 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.003+0000 7fb0a3e00640 1 Processor -- start 2024-08-17T02:27:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.003+0000 7fb0a3e00640 1 -- start start 2024-08-17T02:27:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.004+0000 7fb0a3e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0a415a490 0x7fb0a40ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.004+0000 7fb0a3e00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a415b6b0 con 0x7fb0a40b1920 2024-08-17T02:27:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.004+0000 7fb0a3e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a415aac0 con 0x7fb0a4158c60 2024-08-17T02:27:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.004+0000 7fb0a3e00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a40b0540 con 0x7fb0a415a490 2024-08-17T02:27:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.004+0000 7fb09be00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0a415a490 0x7fb0a40ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.004+0000 7fb0a3400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb0a40b1920 0x7fb0a40b1d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60132/0 (socket says 172.21.15.6:60132) 2024-08-17T02:27:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.004+0000 7fb0a3400640 1 -- 172.21.15.6:0/2140209390 learned_addr learned my addr 172.21.15.6:0/2140209390 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:18.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.005+0000 7fb09be00640 1 -- 172.21.15.6:0/2140209390 >> v1:172.21.15.136:6789/0 conn(0x7fb0a4158c60 legacy=0x7fb0a4159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.005+0000 7fb09be00640 1 -- 172.21.15.6:0/2140209390 >> v1:172.21.15.6:6789/0 conn(0x7fb0a40b1920 legacy=0x7fb0a40b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.005+0000 7fb09be00640 1 -- 172.21.15.6:0/2140209390 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a415ad80 con 0x7fb0a415a490 2024-08-17T02:27:18.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.005+0000 7fb0a2000640 1 -- 172.21.15.6:0/2140209390 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9235332 0 0) 0x7fb0a415b6b0 con 0x7fb0a40b1920 2024-08-17T02:27:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.006+0000 7fb09be00640 1 --2- 172.21.15.6:0/2140209390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a415a490 0x7fb0a40ca8b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009850 tx=0x7fb08c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7d061fa0479c28 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.006+0000 7fb0a2000640 1 -- 172.21.15.6:0/2140209390 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c02ad90 con 0x7fb0a415a490 2024-08-17T02:27:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.006+0000 7fb0a2000640 1 -- 172.21.15.6:0/2140209390 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c032440 con 0x7fb0a415a490 2024-08-17T02:27:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.006+0000 7fb0a2000640 1 -- 172.21.15.6:0/2140209390 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c0327e0 con 0x7fb0a415a490 2024-08-17T02:27:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.007+0000 7fb0a3e00640 1 -- 172.21.15.6:0/2140209390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a415a490 msgr2=0x7fb0a40ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.007+0000 7fb0a3e00640 1 --2- 172.21.15.6:0/2140209390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a415a490 0x7fb0a40ca8b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009850 tx=0x7fb08c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.007+0000 7fb0a3e00640 1 -- 172.21.15.6:0/2140209390 shutdown_connections 2024-08-17T02:27:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.007+0000 7fb0a3e00640 1 --2- 172.21.15.6:0/2140209390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a415a490 0x7fb0a40ca8b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.007+0000 7fb0a3e00640 1 -- 172.21.15.6:0/2140209390 >> 172.21.15.6:0/2140209390 conn(0x7fb0a406e590 msgr2=0x7fb0a406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.007+0000 7fb0a3e00640 1 -- 172.21.15.6:0/2140209390 shutdown_connections 2024-08-17T02:27:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.007+0000 7fb0a3e00640 1 -- 172.21.15.6:0/2140209390 wait complete. 2024-08-17T02:27:18.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.008+0000 7fb0a3e00640 1 Processor -- start 2024-08-17T02:27:18.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.008+0000 7fb0a3e00640 1 -- start start 2024-08-17T02:27:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.009+0000 7fb0a3e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0a40b1920 0x7fb0a40c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.009+0000 7fb0a3e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a4158c60 0x7fb0a416c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.009+0000 7fb0a3e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0a415a490 0x7fb0a416cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.009+0000 7fb0a3e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40c9640 con 0x7fb0a4158c60 2024-08-17T02:27:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.009+0000 7fb0a3e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40c85a0 con 0x7fb0a40b1920 2024-08-17T02:27:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.009+0000 7fb0a3e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40c8880 con 0x7fb0a415a490 2024-08-17T02:27:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.009+0000 7fb09be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a4158c60 0x7fb0a416c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.009+0000 7fb09be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a4158c60 0x7fb0a416c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53016/0 (socket says 172.21.15.6:53016) 2024-08-17T02:27:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.009+0000 7fb09be00640 1 -- 172.21.15.6:0/300072844 learned_addr learned my addr 172.21.15.6:0/300072844 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.010+0000 7fb0a2a00640 1 --2- 172.21.15.6:0/300072844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0a40b1920 0x7fb0a40c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.010+0000 7fb0a3400640 1 --2- 172.21.15.6:0/300072844 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0a415a490 0x7fb0a416cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.010+0000 7fb09be00640 1 -- 172.21.15.6:0/300072844 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0a415a490 msgr2=0x7fb0a416cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.010+0000 7fb09be00640 1 --2- 172.21.15.6:0/300072844 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0a415a490 0x7fb0a416cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.010+0000 7fb09be00640 1 -- 172.21.15.6:0/300072844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0a40b1920 msgr2=0x7fb0a40c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.010+0000 7fb09be00640 1 --2- 172.21.15.6:0/300072844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0a40b1920 0x7fb0a40c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.010+0000 7fb09be00640 1 -- 172.21.15.6:0/300072844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c009390 con 0x7fb0a4158c60 2024-08-17T02:27:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.010+0000 7fb0a2a00640 1 --2- 172.21.15.6:0/300072844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0a40b1920 0x7fb0a40c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.010+0000 7fb0a3400640 1 --2- 172.21.15.6:0/300072844 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0a415a490 0x7fb0a416cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.010+0000 7fb09be00640 1 --2- 172.21.15.6:0/300072844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a4158c60 0x7fb0a416c6b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009850 tx=0x7fb08c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.010+0000 7fb09a000640 1 -- 172.21.15.6:0/300072844 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c031b30 con 0x7fb0a4158c60 2024-08-17T02:27:18.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.010+0000 7fb09a000640 1 -- 172.21.15.6:0/300072844 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c031c90 con 0x7fb0a4158c60 2024-08-17T02:27:18.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.010+0000 7fb09a000640 1 -- 172.21.15.6:0/300072844 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c03c660 con 0x7fb0a4158c60 2024-08-17T02:27:18.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.010+0000 7fb0a3e00640 1 -- 172.21.15.6:0/300072844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a40c8b60 con 0x7fb0a4158c60 2024-08-17T02:27:18.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.011+0000 7fb0a3e00640 1 -- 172.21.15.6:0/300072844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a40c9120 con 0x7fb0a4158c60 2024-08-17T02:27:18.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.012+0000 7fb0a3e00640 1 -- 172.21.15.6:0/300072844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a40c9340 con 0x7fb0a4158c60 2024-08-17T02:27:18.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.012+0000 7fb09a000640 1 -- 172.21.15.6:0/300072844 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb08c039050 con 0x7fb0a4158c60 2024-08-17T02:27:18.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.013+0000 7fb09a000640 1 --2- 172.21.15.6:0/300072844 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb080065150 0x7fb080067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.014+0000 7fb09a000640 1 -- 172.21.15.6:0/300072844 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb08c0a2680 con 0x7fb0a4158c60 2024-08-17T02:27:18.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.014+0000 7fb0a2a00640 1 --2- 172.21.15.6:0/300072844 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb080065150 0x7fb080067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.015+0000 7fb0a2a00640 1 --2- 172.21.15.6:0/300072844 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb080065150 0x7fb080067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb0940017a0 tx=0x7fb094009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.018+0000 7fb09a000640 1 -- 172.21.15.6:0/300072844 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb08c070ab0 con 0x7fb0a4158c60 2024-08-17T02:27:18.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.200+0000 7fb0a3e00640 1 -- 172.21.15.6:0/300072844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0a4070720 con 0x7fb0a4158c60 2024-08-17T02:27:18.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.201+0000 7fb09a000640 1 -- 172.21.15.6:0/300072844 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12086 (secure 0 0 0) 0x7fb08c037090 con 0x7fb0a4158c60 2024-08-17T02:27:18.201 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:18.202 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":28,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:27:14.770144+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:18.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.203+0000 7fb0a3e00640 1 -- 172.21.15.6:0/300072844 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb080065150 msgr2=0x7fb080067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.203+0000 7fb0a3e00640 1 --2- 172.21.15.6:0/300072844 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb080065150 0x7fb080067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb0940017a0 tx=0x7fb094009040 comp rx=0 tx=0).stop 2024-08-17T02:27:18.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.203+0000 7fb0a3e00640 1 -- 172.21.15.6:0/300072844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a4158c60 msgr2=0x7fb0a416c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.203+0000 7fb0a3e00640 1 --2- 172.21.15.6:0/300072844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a4158c60 0x7fb0a416c6b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009850 tx=0x7fb08c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:18.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.203+0000 7fb0a3e00640 1 -- 172.21.15.6:0/300072844 shutdown_connections 2024-08-17T02:27:18.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.203+0000 7fb0a3e00640 1 --2- 172.21.15.6:0/300072844 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb080065150 0x7fb080067600 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.203+0000 7fb0a3e00640 1 --2- 172.21.15.6:0/300072844 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0a415a490 0x7fb0a416cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.203+0000 7fb0a3e00640 1 --2- 172.21.15.6:0/300072844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a4158c60 0x7fb0a416c6b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.203+0000 7fb0a3e00640 1 --2- 172.21.15.6:0/300072844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0a40b1920 0x7fb0a40c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.203+0000 7fb0a3e00640 1 -- 172.21.15.6:0/300072844 >> 172.21.15.6:0/300072844 conn(0x7fb0a406e590 msgr2=0x7fb0a4068e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:18.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.203+0000 7fb0a3e00640 1 -- 172.21.15.6:0/300072844 shutdown_connections 2024-08-17T02:27:18.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.203+0000 7fb0a3e00640 1 -- 172.21.15.6:0/300072844 wait complete. 2024-08-17T02:27:18.218 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:25.463503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:27:18.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:18.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.372+0000 7fb044c00640 1 Processor -- start 2024-08-17T02:27:18.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.372+0000 7fb044c00640 1 -- start start 2024-08-17T02:27:18.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.373+0000 7fb044c00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb040156ae0 0x7fb0400cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.373+0000 7fb044c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb040156eb0 0x7fb0400b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.373+0000 7fb044c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb0400b1120 0x7fb0400c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.374+0000 7fb044c00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0400c9490 con 0x7fb040156ae0 2024-08-17T02:27:18.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.374+0000 7fb044c00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0400ac140 con 0x7fb0400b1120 2024-08-17T02:27:18.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.374+0000 7fb044c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0400b1560 con 0x7fb040156eb0 2024-08-17T02:27:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.374+0000 7fb03de00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb040156ae0 0x7fb0400cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.374+0000 7fb03de00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb040156ae0 0x7fb0400cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53028/0 (socket says 172.21.15.6:53028) 2024-08-17T02:27:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.374+0000 7fb03de00640 1 -- 172.21.15.6:0/282202592 learned_addr learned my addr 172.21.15.6:0/282202592 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.374+0000 7fb03e800640 1 --2- 172.21.15.6:0/282202592 >> v2:172.21.15.136:3300/0 conn(0x7fb0400b1120 0x7fb0400c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.374+0000 7fb037e00640 1 --2- 172.21.15.6:0/282202592 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb040156eb0 0x7fb0400b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.374+0000 7fb03de00640 1 -- 172.21.15.6:0/282202592 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb040156eb0 msgr2=0x7fb0400b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.374+0000 7fb03de00640 1 --2- 172.21.15.6:0/282202592 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb040156eb0 0x7fb0400b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.374+0000 7fb03de00640 1 -- 172.21.15.6:0/282202592 >> v2:172.21.15.136:3300/0 conn(0x7fb0400b1120 msgr2=0x7fb0400c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.374+0000 7fb03de00640 1 --2- 172.21.15.6:0/282202592 >> v2:172.21.15.136:3300/0 conn(0x7fb0400b1120 0x7fb0400c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.374+0000 7fb03de00640 1 -- 172.21.15.6:0/282202592 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0400ab530 con 0x7fb040156ae0 2024-08-17T02:27:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.374+0000 7fb037e00640 1 --2- 172.21.15.6:0/282202592 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb040156eb0 0x7fb0400b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.374+0000 7fb03e800640 1 --2- 172.21.15.6:0/282202592 >> v2:172.21.15.136:3300/0 conn(0x7fb0400b1120 0x7fb0400c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.375+0000 7fb03de00640 1 --2- 172.21.15.6:0/282202592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb040156ae0 0x7fb0400cbff0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb0400adad0 tx=0x7fb0300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be85ddcc9334d4e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.376+0000 7fb03d400640 1 -- 172.21.15.6:0/282202592 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03002ad40 con 0x7fb040156ae0 2024-08-17T02:27:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.376+0000 7fb03d400640 1 -- 172.21.15.6:0/282202592 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb030032440 con 0x7fb040156ae0 2024-08-17T02:27:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.376+0000 7fb03d400640 1 -- 172.21.15.6:0/282202592 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03002aea0 con 0x7fb040156ae0 2024-08-17T02:27:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.376+0000 7fb044c00640 1 -- 172.21.15.6:0/282202592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb040156ae0 msgr2=0x7fb0400cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.376+0000 7fb044c00640 1 --2- 172.21.15.6:0/282202592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb040156ae0 0x7fb0400cbff0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb0400adad0 tx=0x7fb0300091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.376+0000 7fb044c00640 1 -- 172.21.15.6:0/282202592 shutdown_connections 2024-08-17T02:27:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.376+0000 7fb044c00640 1 --2- 172.21.15.6:0/282202592 >> v2:172.21.15.136:3300/0 conn(0x7fb0400b1120 0x7fb0400c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.376+0000 7fb044c00640 1 --2- 172.21.15.6:0/282202592 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb040156eb0 0x7fb0400b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.376+0000 7fb044c00640 1 --2- 172.21.15.6:0/282202592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb040156ae0 0x7fb0400cbff0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.376+0000 7fb044c00640 1 -- 172.21.15.6:0/282202592 >> 172.21.15.6:0/282202592 conn(0x7fb0400678e0 msgr2=0x7fb0400cb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.376+0000 7fb044c00640 1 -- 172.21.15.6:0/282202592 shutdown_connections 2024-08-17T02:27:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.376+0000 7fb044c00640 1 -- 172.21.15.6:0/282202592 wait complete. 2024-08-17T02:27:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.378+0000 7fb044c00640 1 Processor -- start 2024-08-17T02:27:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.378+0000 7fb044c00640 1 -- start start 2024-08-17T02:27:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.379+0000 7fb044c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0400b1120 0x7fb0400aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.379+0000 7fb044c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb040156ae0 0x7fb040169140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.379+0000 7fb044c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb040156eb0 0x7fb0401577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.379+0000 7fb044c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0401513d0 con 0x7fb040156ae0 2024-08-17T02:27:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.379+0000 7fb044c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04016c990 con 0x7fb0400b1120 2024-08-17T02:27:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.379+0000 7fb044c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04016a190 con 0x7fb040156eb0 2024-08-17T02:27:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.379+0000 7fb037e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb040156ae0 0x7fb040169140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.379+0000 7fb037e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb040156ae0 0x7fb040169140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53044/0 (socket says 172.21.15.6:53044) 2024-08-17T02:27:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.379+0000 7fb037e00640 1 -- 172.21.15.6:0/3499462739 learned_addr learned my addr 172.21.15.6:0/3499462739 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.379+0000 7fb03e800640 1 --2- 172.21.15.6:0/3499462739 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb040156eb0 0x7fb0401577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.379+0000 7fb03de00640 1 --2- 172.21.15.6:0/3499462739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0400b1120 0x7fb0400aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.379+0000 7fb037e00640 1 -- 172.21.15.6:0/3499462739 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb040156eb0 msgr2=0x7fb0401577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.379+0000 7fb037e00640 1 --2- 172.21.15.6:0/3499462739 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb040156eb0 0x7fb0401577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.379+0000 7fb037e00640 1 -- 172.21.15.6:0/3499462739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0400b1120 msgr2=0x7fb0400aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.379+0000 7fb037e00640 1 --2- 172.21.15.6:0/3499462739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0400b1120 0x7fb0400aa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.379+0000 7fb037e00640 1 -- 172.21.15.6:0/3499462739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb030009450 con 0x7fb040156ae0 2024-08-17T02:27:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.380+0000 7fb037e00640 1 --2- 172.21.15.6:0/3499462739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb040156ae0 0x7fb040169140 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb02800c880 tx=0x7fb028008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.380+0000 7fb035600640 1 -- 172.21.15.6:0/3499462739 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02800ce10 con 0x7fb040156ae0 2024-08-17T02:27:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.380+0000 7fb035600640 1 -- 172.21.15.6:0/3499462739 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb028007830 con 0x7fb040156ae0 2024-08-17T02:27:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.380+0000 7fb044c00640 1 -- 172.21.15.6:0/3499462739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb040169680 con 0x7fb040156ae0 2024-08-17T02:27:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.380+0000 7fb035600640 1 -- 172.21.15.6:0/3499462739 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb028007c10 con 0x7fb040156ae0 2024-08-17T02:27:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.380+0000 7fb044c00640 1 -- 172.21.15.6:0/3499462739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb040169eb0 con 0x7fb040156ae0 2024-08-17T02:27:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.381+0000 7fb044c00640 1 -- 172.21.15.6:0/3499462739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04016cb00 con 0x7fb040156ae0 2024-08-17T02:27:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.382+0000 7fb035600640 1 -- 172.21.15.6:0/3499462739 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb028011600 con 0x7fb040156ae0 2024-08-17T02:27:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.383+0000 7fb035600640 1 --2- 172.21.15.6:0/3499462739 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb01c065150 0x7fb01c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.383+0000 7fb035600640 1 -- 172.21.15.6:0/3499462739 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb028082410 con 0x7fb040156ae0 2024-08-17T02:27:18.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.383+0000 7fb03de00640 1 --2- 172.21.15.6:0/3499462739 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb01c065150 0x7fb01c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.384+0000 7fb03de00640 1 --2- 172.21.15.6:0/3499462739 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb01c065150 0x7fb01c067600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb030034000 tx=0x7fb030032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.387+0000 7fb035600640 1 -- 172.21.15.6:0/3499462739 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb04016cb00 con 0x7fb040156ae0 2024-08-17T02:27:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.568+0000 7fb044c00640 1 -- 172.21.15.6:0/3499462739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb04016cb00 con 0x7fb040156ae0 2024-08-17T02:27:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.569+0000 7fb035600640 1 -- 172.21.15.6:0/3499462739 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb04016cb00 con 0x7fb040156ae0 2024-08-17T02:27:18.570 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-08-17T02:27:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.571+0000 7fb044c00640 1 -- 172.21.15.6:0/3499462739 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb01c065150 msgr2=0x7fb01c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.571+0000 7fb044c00640 1 --2- 172.21.15.6:0/3499462739 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb01c065150 0x7fb01c067600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb030034000 tx=0x7fb030032000 comp rx=0 tx=0).stop 2024-08-17T02:27:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.571+0000 7fb044c00640 1 -- 172.21.15.6:0/3499462739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb040156ae0 msgr2=0x7fb040169140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.571+0000 7fb044c00640 1 --2- 172.21.15.6:0/3499462739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb040156ae0 0x7fb040169140 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb02800c880 tx=0x7fb028008040 comp rx=0 tx=0).stop 2024-08-17T02:27:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.571+0000 7fb044c00640 1 -- 172.21.15.6:0/3499462739 shutdown_connections 2024-08-17T02:27:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.571+0000 7fb044c00640 1 --2- 172.21.15.6:0/3499462739 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb01c065150 0x7fb01c067600 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.571+0000 7fb044c00640 1 --2- 172.21.15.6:0/3499462739 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb040156eb0 0x7fb0401577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.571+0000 7fb044c00640 1 --2- 172.21.15.6:0/3499462739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb040156ae0 0x7fb040169140 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.571+0000 7fb044c00640 1 --2- 172.21.15.6:0/3499462739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0400b1120 0x7fb0400aa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.571+0000 7fb044c00640 1 -- 172.21.15.6:0/3499462739 >> 172.21.15.6:0/3499462739 conn(0x7fb0400678e0 msgr2=0x7fb04006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.571+0000 7fb044c00640 1 -- 172.21.15.6:0/3499462739 shutdown_connections 2024-08-17T02:27:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.571+0000 7fb044c00640 1 -- 172.21.15.6:0/3499462739 wait complete. 2024-08-17T02:27:18.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:27:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.737+0000 7fb52ca00640 1 Processor -- start 2024-08-17T02:27:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.737+0000 7fb52ca00640 1 -- start start 2024-08-17T02:27:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.738+0000 7fb52ca00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5280ad960 0x7fb52815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.738+0000 7fb52ca00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb5280ca050 0x7fb528156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.738+0000 7fb52ca00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb52815b5e0 con 0x7fb5280add30 2024-08-17T02:27:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.738+0000 7fb52ca00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5280cb160 con 0x7fb5280ca050 2024-08-17T02:27:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.738+0000 7fb52ca00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5280b0d10 con 0x7fb5280ad960 2024-08-17T02:27:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.738+0000 7fb51fe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb5280ca050 0x7fb528156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.738+0000 7fb525e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5280ad960 0x7fb52815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.739+0000 7fb526800640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fb5280add30 0x7fb528156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:41160/0 (socket says 172.21.15.6:41160) 2024-08-17T02:27:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.739+0000 7fb526800640 1 -- 172.21.15.6:0/3124601320 learned_addr learned my addr 172.21.15.6:0/3124601320 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.739+0000 7fb51fe00640 1 -- 172.21.15.6:0/3124601320 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5280ad960 msgr2=0x7fb52815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.739+0000 7fb51fe00640 1 --2- 172.21.15.6:0/3124601320 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5280ad960 0x7fb52815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.739+0000 7fb51fe00640 1 -- 172.21.15.6:0/3124601320 >> v1:172.21.15.136:6789/0 conn(0x7fb5280add30 legacy=0x7fb528156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.739+0000 7fb51fe00640 1 -- 172.21.15.6:0/3124601320 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5280ca550 con 0x7fb5280ca050 2024-08-17T02:27:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.739+0000 7fb525400640 1 -- 172.21.15.6:0/3124601320 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486906667 0 0) 0x7fb520001490 con 0x7fb5280add30 2024-08-17T02:27:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.740+0000 7fb51fe00640 1 --2- 172.21.15.6:0/3124601320 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5280ca050 0x7fb528156420 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb510009850 tx=0x7fb5100090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9d0729500e6bd92 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.740+0000 7fb525400640 1 -- 172.21.15.6:0/3124601320 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51002ae10 con 0x7fb5280ca050 2024-08-17T02:27:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.740+0000 7fb525400640 1 -- 172.21.15.6:0/3124601320 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb510032440 con 0x7fb5280ca050 2024-08-17T02:27:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.740+0000 7fb525400640 1 -- 172.21.15.6:0/3124601320 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5100327e0 con 0x7fb5280ca050 2024-08-17T02:27:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.741+0000 7fb52ca00640 1 -- 172.21.15.6:0/3124601320 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5280ca050 msgr2=0x7fb528156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.741+0000 7fb52ca00640 1 --2- 172.21.15.6:0/3124601320 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5280ca050 0x7fb528156420 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb510009850 tx=0x7fb5100090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.741+0000 7fb52ca00640 1 -- 172.21.15.6:0/3124601320 shutdown_connections 2024-08-17T02:27:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.741+0000 7fb52ca00640 1 --2- 172.21.15.6:0/3124601320 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5280ca050 0x7fb528156420 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.741+0000 7fb52ca00640 1 --2- 172.21.15.6:0/3124601320 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5280ad960 0x7fb52815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.741+0000 7fb52ca00640 1 -- 172.21.15.6:0/3124601320 >> 172.21.15.6:0/3124601320 conn(0x7fb528066e60 msgr2=0x7fb528067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.741+0000 7fb52ca00640 1 -- 172.21.15.6:0/3124601320 shutdown_connections 2024-08-17T02:27:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.741+0000 7fb52ca00640 1 -- 172.21.15.6:0/3124601320 wait complete. 2024-08-17T02:27:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.742+0000 7fb52ca00640 1 Processor -- start 2024-08-17T02:27:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.743+0000 7fb52ca00640 1 -- start start 2024-08-17T02:27:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.743+0000 7fb52ca00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5280ad960 0x7fb52814a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.743+0000 7fb52ca00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5280add30 0x7fb5280aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.743+0000 7fb52ca00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5280ca050 0x7fb528152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.743+0000 7fb52ca00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5280a8a80 con 0x7fb5280ad960 2024-08-17T02:27:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.743+0000 7fb52ca00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5280a8d60 con 0x7fb5280add30 2024-08-17T02:27:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.743+0000 7fb52ca00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5280a9040 con 0x7fb5280ca050 2024-08-17T02:27:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.744+0000 7fb525e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5280ad960 0x7fb52814a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.744+0000 7fb525e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5280ad960 0x7fb52814a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53056/0 (socket says 172.21.15.6:53056) 2024-08-17T02:27:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.744+0000 7fb525e00640 1 -- 172.21.15.6:0/3475520774 learned_addr learned my addr 172.21.15.6:0/3475520774 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.744+0000 7fb51fe00640 1 --2- 172.21.15.6:0/3475520774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5280add30 0x7fb5280aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.744+0000 7fb526800640 1 --2- 172.21.15.6:0/3475520774 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5280ca050 0x7fb528152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.744+0000 7fb525e00640 1 -- 172.21.15.6:0/3475520774 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5280ca050 msgr2=0x7fb528152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.744+0000 7fb525e00640 1 --2- 172.21.15.6:0/3475520774 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5280ca050 0x7fb528152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.744+0000 7fb525e00640 1 -- 172.21.15.6:0/3475520774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5280add30 msgr2=0x7fb5280aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.744+0000 7fb525e00640 1 --2- 172.21.15.6:0/3475520774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5280add30 0x7fb5280aa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.744+0000 7fb525e00640 1 -- 172.21.15.6:0/3475520774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb510009390 con 0x7fb5280ad960 2024-08-17T02:27:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.744+0000 7fb526800640 1 --2- 172.21.15.6:0/3475520774 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5280ca050 0x7fb528152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.744+0000 7fb525e00640 1 --2- 172.21.15.6:0/3475520774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5280ad960 0x7fb52814a500 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb51800ea20 tx=0x7fb5180090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.745+0000 7fb51d600640 1 -- 172.21.15.6:0/3475520774 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51800ca10 con 0x7fb5280ad960 2024-08-17T02:27:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.745+0000 7fb51d600640 1 -- 172.21.15.6:0/3475520774 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51800cb70 con 0x7fb5280ad960 2024-08-17T02:27:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.745+0000 7fb51d600640 1 -- 172.21.15.6:0/3475520774 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb518013470 con 0x7fb5280ad960 2024-08-17T02:27:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.745+0000 7fb52ca00640 1 -- 172.21.15.6:0/3475520774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5280a9320 con 0x7fb5280ad960 2024-08-17T02:27:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.745+0000 7fb52ca00640 1 -- 172.21.15.6:0/3475520774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb52814aa40 con 0x7fb5280ad960 2024-08-17T02:27:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.746+0000 7fb52ca00640 1 -- 172.21.15.6:0/3475520774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5280a97a0 con 0x7fb5280ad960 2024-08-17T02:27:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.747+0000 7fb51d600640 1 -- 172.21.15.6:0/3475520774 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb518013860 con 0x7fb5280ad960 2024-08-17T02:27:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.748+0000 7fb51d600640 1 --2- 172.21.15.6:0/3475520774 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb504065150 0x7fb504067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.748+0000 7fb51d600640 1 -- 172.21.15.6:0/3475520774 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb518082480 con 0x7fb5280ad960 2024-08-17T02:27:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.748+0000 7fb51fe00640 1 --2- 172.21.15.6:0/3475520774 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb504065150 0x7fb504067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.749+0000 7fb51fe00640 1 --2- 172.21.15.6:0/3475520774 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb504065150 0x7fb504067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb510034000 tx=0x7fb510032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.752+0000 7fb51d600640 1 -- 172.21.15.6:0/3475520774 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb5180508a0 con 0x7fb5280ad960 2024-08-17T02:27:18.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.935+0000 7fb52ca00640 1 -- 172.21.15.6:0/3475520774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb528063fb0 con 0x7fb5280ad960 2024-08-17T02:27:18.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.935+0000 7fb51d600640 1 -- 172.21.15.6:0/3475520774 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb518017060 con 0x7fb5280ad960 2024-08-17T02:27:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:18.936 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-08-17T02:27:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-08-17T02:27:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-08-17T02:27:18.937 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:18.937 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-08-17T02:27:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.937+0000 7fb52ca00640 1 -- 172.21.15.6:0/3475520774 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb504065150 msgr2=0x7fb504067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.937+0000 7fb52ca00640 1 --2- 172.21.15.6:0/3475520774 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb504065150 0x7fb504067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb510034000 tx=0x7fb510032000 comp rx=0 tx=0).stop 2024-08-17T02:27:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.937+0000 7fb52ca00640 1 -- 172.21.15.6:0/3475520774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5280ad960 msgr2=0x7fb52814a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.937+0000 7fb52ca00640 1 --2- 172.21.15.6:0/3475520774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5280ad960 0x7fb52814a500 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb51800ea20 tx=0x7fb5180090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.937+0000 7fb52ca00640 1 -- 172.21.15.6:0/3475520774 shutdown_connections 2024-08-17T02:27:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.937+0000 7fb52ca00640 1 --2- 172.21.15.6:0/3475520774 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb504065150 0x7fb504067600 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.937+0000 7fb52ca00640 1 --2- 172.21.15.6:0/3475520774 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5280ca050 0x7fb528152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.937+0000 7fb52ca00640 1 --2- 172.21.15.6:0/3475520774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5280add30 0x7fb5280aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.937+0000 7fb52ca00640 1 --2- 172.21.15.6:0/3475520774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5280ad960 0x7fb52814a500 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.938+0000 7fb52ca00640 1 -- 172.21.15.6:0/3475520774 >> 172.21.15.6:0/3475520774 conn(0x7fb528066e60 msgr2=0x7fb5281561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.938+0000 7fb52ca00640 1 -- 172.21.15.6:0/3475520774 shutdown_connections 2024-08-17T02:27:18.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:18.938+0000 7fb52ca00640 1 -- 172.21.15.6:0/3475520774 wait complete. 2024-08-17T02:27:18.954 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:27:18.954 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:27:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.108+0000 7f2f64c00640 1 Processor -- start 2024-08-17T02:27:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.108+0000 7f2f64c00640 1 -- start start 2024-08-17T02:27:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.110+0000 7f2f64c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f601557e0 0x7f2f600af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.110+0000 7f2f64c00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2f600c7d20 0x7f2f600adb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.110+0000 7f2f64c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2f600ae060 0x7f2f600b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.110+0000 7f2f64c00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f600af920 con 0x7f2f600c7d20 2024-08-17T02:27:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.110+0000 7f2f64c00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f600acd60 con 0x7f2f600ae060 2024-08-17T02:27:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.110+0000 7f2f64c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f600ad040 con 0x7f2f601557e0 2024-08-17T02:27:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.110+0000 7f2f56a00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2f600c7d20 0x7f2f600adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.110+0000 7f2f56a00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2f600c7d20 0x7f2f600adb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53072/0 (socket says 172.21.15.6:53072) 2024-08-17T02:27:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.110+0000 7f2f56a00640 1 -- 172.21.15.6:0/1157733205 learned_addr learned my addr 172.21.15.6:0/1157733205 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.110+0000 7f2f5f400640 1 --2- 172.21.15.6:0/1157733205 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f601557e0 0x7f2f600af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.110+0000 7f2f5fe00640 1 --2- 172.21.15.6:0/1157733205 >> v2:172.21.15.136:3300/0 conn(0x7f2f600ae060 0x7f2f600b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.110+0000 7f2f56a00640 1 -- 172.21.15.6:0/1157733205 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f601557e0 msgr2=0x7f2f600af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.111+0000 7f2f56a00640 1 --2- 172.21.15.6:0/1157733205 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f601557e0 0x7f2f600af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.111+0000 7f2f56a00640 1 -- 172.21.15.6:0/1157733205 >> v2:172.21.15.136:3300/0 conn(0x7f2f600ae060 msgr2=0x7f2f600b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.111+0000 7f2f56a00640 1 --2- 172.21.15.6:0/1157733205 >> v2:172.21.15.136:3300/0 conn(0x7f2f600ae060 0x7f2f600b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.111+0000 7f2f56a00640 1 -- 172.21.15.6:0/1157733205 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f600ad320 con 0x7f2f600c7d20 2024-08-17T02:27:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.111+0000 7f2f5fe00640 1 --2- 172.21.15.6:0/1157733205 >> v2:172.21.15.136:3300/0 conn(0x7f2f600ae060 0x7f2f600b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:19.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.112+0000 7f2f56a00640 1 --2- 172.21.15.6:0/1157733205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f600c7d20 0x7f2f600adb20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2f6006d080 tx=0x7f2f480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9c2f677169727b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:19.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.112+0000 7f2f5ea00640 1 -- 172.21.15.6:0/1157733205 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48031510 con 0x7f2f600c7d20 2024-08-17T02:27:19.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.112+0000 7f2f5ea00640 1 -- 172.21.15.6:0/1157733205 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4802f050 con 0x7f2f600c7d20 2024-08-17T02:27:19.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.112+0000 7f2f5ea00640 1 -- 172.21.15.6:0/1157733205 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f480318e0 con 0x7f2f600c7d20 2024-08-17T02:27:19.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.112+0000 7f2f64c00640 1 -- 172.21.15.6:0/1157733205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f600c7d20 msgr2=0x7f2f600adb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.112+0000 7f2f64c00640 1 --2- 172.21.15.6:0/1157733205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f600c7d20 0x7f2f600adb20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2f6006d080 tx=0x7f2f480091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.112+0000 7f2f64c00640 1 -- 172.21.15.6:0/1157733205 shutdown_connections 2024-08-17T02:27:19.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.112+0000 7f2f64c00640 1 --2- 172.21.15.6:0/1157733205 >> v2:172.21.15.136:3300/0 conn(0x7f2f600ae060 0x7f2f600b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.112+0000 7f2f64c00640 1 --2- 172.21.15.6:0/1157733205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f600c7d20 0x7f2f600adb20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.112+0000 7f2f64c00640 1 --2- 172.21.15.6:0/1157733205 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f601557e0 0x7f2f600af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.113+0000 7f2f64c00640 1 -- 172.21.15.6:0/1157733205 >> 172.21.15.6:0/1157733205 conn(0x7f2f600cb750 msgr2=0x7f2f600cbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:19.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.113+0000 7f2f64c00640 1 -- 172.21.15.6:0/1157733205 shutdown_connections 2024-08-17T02:27:19.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.113+0000 7f2f64c00640 1 -- 172.21.15.6:0/1157733205 wait complete. 2024-08-17T02:27:19.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.114+0000 7f2f64c00640 1 Processor -- start 2024-08-17T02:27:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.114+0000 7f2f64c00640 1 -- start start 2024-08-17T02:27:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.115+0000 7f2f64c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f600ae060 0x7f2f6015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.115+0000 7f2f64c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f600c7d20 0x7f2f6015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.115+0000 7f2f64c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f601557e0 0x7f2f60157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.115+0000 7f2f64c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f60151520 con 0x7f2f601557e0 2024-08-17T02:27:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.115+0000 7f2f64c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6015b260 con 0x7f2f600c7d20 2024-08-17T02:27:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.115+0000 7f2f64c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6015b540 con 0x7f2f600ae060 2024-08-17T02:27:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.115+0000 7f2f5fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f601557e0 0x7f2f60157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.115+0000 7f2f5fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f601557e0 0x7f2f60157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53088/0 (socket says 172.21.15.6:53088) 2024-08-17T02:27:19.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.115+0000 7f2f5fe00640 1 -- 172.21.15.6:0/1721077032 learned_addr learned my addr 172.21.15.6:0/1721077032 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:19.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.115+0000 7f2f5f400640 1 --2- 172.21.15.6:0/1721077032 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f600ae060 0x7f2f6015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.115+0000 7f2f56a00640 1 --2- 172.21.15.6:0/1721077032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f600c7d20 0x7f2f6015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.116+0000 7f2f5fe00640 1 -- 172.21.15.6:0/1721077032 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f600ae060 msgr2=0x7f2f6015a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.116+0000 7f2f5fe00640 1 --2- 172.21.15.6:0/1721077032 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f600ae060 0x7f2f6015a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.116+0000 7f2f5fe00640 1 -- 172.21.15.6:0/1721077032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f600c7d20 msgr2=0x7f2f6015abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.116+0000 7f2f5fe00640 1 --2- 172.21.15.6:0/1721077032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f600c7d20 0x7f2f6015abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.116+0000 7f2f5fe00640 1 -- 172.21.15.6:0/1721077032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f48009450 con 0x7f2f601557e0 2024-08-17T02:27:19.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.116+0000 7f2f5fe00640 1 --2- 172.21.15.6:0/1721077032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f601557e0 0x7f2f60157990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800d150 tx=0x7f2f58009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:19.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.116+0000 7f2f57400640 1 -- 172.21.15.6:0/1721077032 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f58015400 con 0x7f2f601557e0 2024-08-17T02:27:19.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.116+0000 7f2f57400640 1 -- 172.21.15.6:0/1721077032 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5800f040 con 0x7f2f601557e0 2024-08-17T02:27:19.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.116+0000 7f2f57400640 1 -- 172.21.15.6:0/1721077032 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f580157b0 con 0x7f2f601557e0 2024-08-17T02:27:19.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.116+0000 7f2f64c00640 1 -- 172.21.15.6:0/1721077032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6015b820 con 0x7f2f601557e0 2024-08-17T02:27:19.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.116+0000 7f2f64c00640 1 -- 172.21.15.6:0/1721077032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6015bde0 con 0x7f2f601557e0 2024-08-17T02:27:19.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.118+0000 7f2f64c00640 1 -- 172.21.15.6:0/1721077032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f60063e70 con 0x7f2f601557e0 2024-08-17T02:27:19.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.118+0000 7f2f57400640 1 -- 172.21.15.6:0/1721077032 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2f58015ba0 con 0x7f2f601557e0 2024-08-17T02:27:19.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.119+0000 7f2f57400640 1 --2- 172.21.15.6:0/1721077032 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2f3c065150 0x7f2f3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.119+0000 7f2f57400640 1 -- 172.21.15.6:0/1721077032 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2f58082930 con 0x7f2f601557e0 2024-08-17T02:27:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.119+0000 7f2f5f400640 1 --2- 172.21.15.6:0/1721077032 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2f3c065150 0x7f2f3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.120+0000 7f2f5f400640 1 --2- 172.21.15.6:0/1721077032 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2f3c065150 0x7f2f3c067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009bf0 tx=0x7f2f500090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.123+0000 7f2f57400640 1 -- 172.21.15.6:0/1721077032 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2f58050d50 con 0x7f2f601557e0 2024-08-17T02:27:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.304+0000 7f2f64c00640 1 -- 172.21.15.6:0/1721077032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2f6015c000 con 0x7f2f601557e0 2024-08-17T02:27:19.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.777+0000 7f2f57400640 1 -- 172.21.15.6:0/1721077032 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2f58054370 con 0x7f2f601557e0 2024-08-17T02:27:19.778 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-08-17T02:27:19.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.780+0000 7f2f64c00640 1 -- 172.21.15.6:0/1721077032 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2f3c065150 msgr2=0x7f2f3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.780+0000 7f2f64c00640 1 --2- 172.21.15.6:0/1721077032 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2f3c065150 0x7f2f3c067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009bf0 tx=0x7f2f500090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.780+0000 7f2f64c00640 1 -- 172.21.15.6:0/1721077032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f601557e0 msgr2=0x7f2f60157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.780+0000 7f2f64c00640 1 --2- 172.21.15.6:0/1721077032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f601557e0 0x7f2f60157990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800d150 tx=0x7f2f58009a50 comp rx=0 tx=0).stop 2024-08-17T02:27:19.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.781+0000 7f2f64c00640 1 -- 172.21.15.6:0/1721077032 shutdown_connections 2024-08-17T02:27:19.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.781+0000 7f2f64c00640 1 --2- 172.21.15.6:0/1721077032 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2f3c065150 0x7f2f3c067600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.781+0000 7f2f64c00640 1 --2- 172.21.15.6:0/1721077032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f601557e0 0x7f2f60157990 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.781+0000 7f2f64c00640 1 --2- 172.21.15.6:0/1721077032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f600c7d20 0x7f2f6015abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.781+0000 7f2f64c00640 1 --2- 172.21.15.6:0/1721077032 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f600ae060 0x7f2f6015a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.781+0000 7f2f64c00640 1 -- 172.21.15.6:0/1721077032 >> 172.21.15.6:0/1721077032 conn(0x7f2f600cb750 msgr2=0x7f2f6006dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:19.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.781+0000 7f2f64c00640 1 -- 172.21.15.6:0/1721077032 shutdown_connections 2024-08-17T02:27:19.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.781+0000 7f2f64c00640 1 -- 172.21.15.6:0/1721077032 wait complete. 2024-08-17T02:27:19.799 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:27:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.956+0000 7f8db2400640 1 Processor -- start 2024-08-17T02:27:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.956+0000 7f8db2400640 1 -- start start 2024-08-17T02:27:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.957+0000 7f8db2400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8dac1556e0 0x7f8dac1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.957+0000 7f8db2400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dac155ab0 0x7f8dac0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.957+0000 7f8db2400640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dac0c9200 con 0x7f8dac1599e0 2024-08-17T02:27:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.957+0000 7f8db2400640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dac0c8bf0 con 0x7f8dac1556e0 2024-08-17T02:27:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.957+0000 7f8db2400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac159ef0 con 0x7f8dac155ab0 2024-08-17T02:27:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.958+0000 7f8db1000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8dac1556e0 0x7f8dac1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.958+0000 7f8db1000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8dac1556e0 0x7f8dac1594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53104/0 (socket says 172.21.15.6:53104) 2024-08-17T02:27:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.958+0000 7f8db1000640 1 -- 172.21.15.6:0/166043985 learned_addr learned my addr 172.21.15.6:0/166043985 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.958+0000 7f8dabe00640 1 --2- 172.21.15.6:0/166043985 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dac155ab0 0x7f8dac0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.958+0000 7f8db1000640 1 -- 172.21.15.6:0/166043985 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dac155ab0 msgr2=0x7f8dac0af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.958+0000 7f8db1000640 1 --2- 172.21.15.6:0/166043985 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dac155ab0 0x7f8dac0af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.958+0000 7f8db1000640 1 -- 172.21.15.6:0/166043985 >> v1:172.21.15.136:6789/0 conn(0x7f8dac1599e0 legacy=0x7f8dac06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.958+0000 7f8db1000640 1 -- 172.21.15.6:0/166043985 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac15a1d0 con 0x7f8dac1556e0 2024-08-17T02:27:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.958+0000 7f8dabe00640 1 --2- 172.21.15.6:0/166043985 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dac155ab0 0x7f8dac0af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:19.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.959+0000 7f8db1000640 1 --2- 172.21.15.6:0/166043985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dac1556e0 0x7f8dac1594a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8da0009910 tx=0x7f8da00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20236b58ea2bf558 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:19.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.960+0000 7f8dab400640 1 -- 172.21.15.6:0/166043985 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da002add0 con 0x7f8dac1556e0 2024-08-17T02:27:19.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.960+0000 7f8dab400640 1 -- 172.21.15.6:0/166043985 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da0032440 con 0x7f8dac1556e0 2024-08-17T02:27:19.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.960+0000 7f8dab400640 1 -- 172.21.15.6:0/166043985 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da0032820 con 0x7f8dac1556e0 2024-08-17T02:27:19.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.960+0000 7f8db2400640 1 -- 172.21.15.6:0/166043985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dac1556e0 msgr2=0x7f8dac1594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.960+0000 7f8db2400640 1 --2- 172.21.15.6:0/166043985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dac1556e0 0x7f8dac1594a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8da0009910 tx=0x7f8da00091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.960+0000 7f8db2400640 1 -- 172.21.15.6:0/166043985 shutdown_connections 2024-08-17T02:27:19.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.960+0000 7f8db2400640 1 --2- 172.21.15.6:0/166043985 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dac155ab0 0x7f8dac0af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.960+0000 7f8db2400640 1 --2- 172.21.15.6:0/166043985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dac1556e0 0x7f8dac1594a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.960+0000 7f8db2400640 1 -- 172.21.15.6:0/166043985 >> 172.21.15.6:0/166043985 conn(0x7f8dac066e60 msgr2=0x7f8dac067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:19.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.960+0000 7f8db2400640 1 -- 172.21.15.6:0/166043985 shutdown_connections 2024-08-17T02:27:19.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.960+0000 7f8db2400640 1 -- 172.21.15.6:0/166043985 wait complete. 2024-08-17T02:27:19.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.962+0000 7f8db2400640 1 Processor -- start 2024-08-17T02:27:19.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.962+0000 7f8db2400640 1 -- start start 2024-08-17T02:27:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.962+0000 7f8db2400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dac1556e0 0x7f8dac153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.963+0000 7f8db2400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dac155ab0 0x7f8dac0b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.963+0000 7f8db2400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dac1599e0 0x7f8dac144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.963+0000 7f8db2400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac0b0980 con 0x7f8dac1599e0 2024-08-17T02:27:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.963+0000 7f8db2400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac16c750 con 0x7f8dac1556e0 2024-08-17T02:27:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.963+0000 7f8db2400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac153af0 con 0x7f8dac155ab0 2024-08-17T02:27:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.963+0000 7f8db1a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dac1599e0 0x7f8dac144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.963+0000 7f8db1a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dac1599e0 0x7f8dac144bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53112/0 (socket says 172.21.15.6:53112) 2024-08-17T02:27:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.963+0000 7f8db1a00640 1 -- 172.21.15.6:0/2209474948 learned_addr learned my addr 172.21.15.6:0/2209474948 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.963+0000 7f8dabe00640 1 --2- 172.21.15.6:0/2209474948 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dac155ab0 0x7f8dac0b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.963+0000 7f8db1000640 1 --2- 172.21.15.6:0/2209474948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dac1556e0 0x7f8dac153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.963+0000 7f8db1a00640 1 -- 172.21.15.6:0/2209474948 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dac155ab0 msgr2=0x7f8dac0b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.963+0000 7f8db1a00640 1 --2- 172.21.15.6:0/2209474948 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dac155ab0 0x7f8dac0b0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.963+0000 7f8db1a00640 1 -- 172.21.15.6:0/2209474948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dac1556e0 msgr2=0x7f8dac153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.963+0000 7f8db1a00640 1 --2- 172.21.15.6:0/2209474948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dac1556e0 0x7f8dac153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.963+0000 7f8db1a00640 1 -- 172.21.15.6:0/2209474948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da0009450 con 0x7f8dac1599e0 2024-08-17T02:27:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.964+0000 7f8db1a00640 1 --2- 172.21.15.6:0/2209474948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dac1599e0 0x7f8dac144bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8da400c7c0 tx=0x7f8da4001590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.964+0000 7f8d9fe00640 1 -- 172.21.15.6:0/2209474948 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da400a5e0 con 0x7f8dac1599e0 2024-08-17T02:27:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.964+0000 7f8d9fe00640 1 -- 172.21.15.6:0/2209474948 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da400a760 con 0x7f8dac1599e0 2024-08-17T02:27:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.964+0000 7f8d9fe00640 1 -- 172.21.15.6:0/2209474948 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da400ab20 con 0x7f8dac1599e0 2024-08-17T02:27:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.964+0000 7f8db2400640 1 -- 172.21.15.6:0/2209474948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dac153dd0 con 0x7f8dac1599e0 2024-08-17T02:27:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.964+0000 7f8db2400640 1 -- 172.21.15.6:0/2209474948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dac1540b0 con 0x7f8dac1599e0 2024-08-17T02:27:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.965+0000 7f8db2400640 1 -- 172.21.15.6:0/2209474948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dac16cc10 con 0x7f8dac1599e0 2024-08-17T02:27:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.966+0000 7f8d9fe00640 1 -- 172.21.15.6:0/2209474948 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8da4003030 con 0x7f8dac1599e0 2024-08-17T02:27:19.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.967+0000 7f8d9fe00640 1 --2- 172.21.15.6:0/2209474948 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8d8c065150 0x7f8d8c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.967+0000 7f8d9fe00640 1 -- 172.21.15.6:0/2209474948 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f8da40820b0 con 0x7f8dac1599e0 2024-08-17T02:27:19.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.967+0000 7f8db1000640 1 --2- 172.21.15.6:0/2209474948 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8d8c065150 0x7f8d8c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.968+0000 7f8db1000640 1 --2- 172.21.15.6:0/2209474948 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8d8c065150 0x7f8d8c067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8da0034000 tx=0x7f8da0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:19.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:19.972+0000 7f8d9fe00640 1 -- 172.21.15.6:0/2209474948 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8da4050360 con 0x7f8dac1599e0 2024-08-17T02:27:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.153+0000 7f8db2400640 1 -- 172.21.15.6:0/2209474948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8dac070720 con 0x7f8dac1599e0 2024-08-17T02:27:20.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.782+0000 7f8d9fe00640 1 -- 172.21.15.6:0/2209474948 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8da4053980 con 0x7f8dac1599e0 2024-08-17T02:27:20.783 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-08-17T02:27:20.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.787+0000 7f8db2400640 1 -- 172.21.15.6:0/2209474948 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8d8c065150 msgr2=0x7f8d8c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.787+0000 7f8db2400640 1 --2- 172.21.15.6:0/2209474948 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8d8c065150 0x7f8d8c067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8da0034000 tx=0x7f8da0032000 comp rx=0 tx=0).stop 2024-08-17T02:27:20.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.787+0000 7f8db2400640 1 -- 172.21.15.6:0/2209474948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dac1599e0 msgr2=0x7f8dac144bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.787+0000 7f8db2400640 1 --2- 172.21.15.6:0/2209474948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dac1599e0 0x7f8dac144bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8da400c7c0 tx=0x7f8da4001590 comp rx=0 tx=0).stop 2024-08-17T02:27:20.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.788+0000 7f8db2400640 1 -- 172.21.15.6:0/2209474948 shutdown_connections 2024-08-17T02:27:20.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.788+0000 7f8db2400640 1 --2- 172.21.15.6:0/2209474948 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8d8c065150 0x7f8d8c067600 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8da0034000 tx=0x7f8da0032000 comp rx=0 tx=0).stop 2024-08-17T02:27:20.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.788+0000 7f8db2400640 1 --2- 172.21.15.6:0/2209474948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dac1599e0 0x7f8dac144bb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.788+0000 7f8db2400640 1 --2- 172.21.15.6:0/2209474948 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dac155ab0 0x7f8dac0b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.788+0000 7f8db2400640 1 --2- 172.21.15.6:0/2209474948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dac1556e0 0x7f8dac153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.788+0000 7f8db2400640 1 -- 172.21.15.6:0/2209474948 >> 172.21.15.6:0/2209474948 conn(0x7f8dac066e60 msgr2=0x7f8dac0c78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:20.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.789+0000 7f8db2400640 1 -- 172.21.15.6:0/2209474948 shutdown_connections 2024-08-17T02:27:20.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.790+0000 7f8db2400640 1 -- 172.21.15.6:0/2209474948 wait complete. 2024-08-17T02:27:20.816 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:27:20.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.969+0000 7fab97200640 1 Processor -- start 2024-08-17T02:27:20.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.970+0000 7fab97200640 1 -- start start 2024-08-17T02:27:20.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.971+0000 7fab97200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab98158a40 0x7fab980abe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.971+0000 7fab97200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fab980af9b0 0x7fab98068b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.971+0000 7fab97200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab980686f0 con 0x7fab980ac380 2024-08-17T02:27:20.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.971+0000 7fab97200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab980ac7d0 con 0x7fab980af9b0 2024-08-17T02:27:20.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.971+0000 7fab97200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab980b0270 con 0x7fab98158a40 2024-08-17T02:27:20.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.971+0000 7fab96800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fab980af9b0 0x7fab98068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.971+0000 7fab8fe00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fab980ac380 0x7fab980af2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60146/0 (socket says 172.21.15.6:60146) 2024-08-17T02:27:20.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.971+0000 7fab8fe00640 1 -- 172.21.15.6:0/1756319264 learned_addr learned my addr 172.21.15.6:0/1756319264 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:20.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.971+0000 7fab95e00640 1 --2- 172.21.15.6:0/1756319264 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab98158a40 0x7fab980abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.972+0000 7fab96800640 1 -- 172.21.15.6:0/1756319264 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab98158a40 msgr2=0x7fab980abe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:20.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.972+0000 7fab96800640 1 --2- 172.21.15.6:0/1756319264 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab98158a40 0x7fab980abe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.972+0000 7fab96800640 1 -- 172.21.15.6:0/1756319264 >> v1:172.21.15.6:6789/0 conn(0x7fab980ac380 legacy=0x7fab980af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.972+0000 7fab96800640 1 -- 172.21.15.6:0/1756319264 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab980aff90 con 0x7fab980af9b0 2024-08-17T02:27:20.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.972+0000 7fab95400640 1 -- 172.21.15.6:0/1756319264 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775842863 0 0) 0x7fab980686f0 con 0x7fab980ac380 2024-08-17T02:27:20.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.973+0000 7fab96800640 1 --2- 172.21.15.6:0/1756319264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980af9b0 0x7fab98068b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fab90009e60 tx=0x7fab90009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110e65f6cc57318c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:20.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.973+0000 7fab95400640 1 -- 172.21.15.6:0/1756319264 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90007550 con 0x7fab980af9b0 2024-08-17T02:27:20.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.973+0000 7fab95400640 1 -- 172.21.15.6:0/1756319264 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9002d050 con 0x7fab980af9b0 2024-08-17T02:27:20.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.973+0000 7fab95400640 1 -- 172.21.15.6:0/1756319264 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab900078e0 con 0x7fab980af9b0 2024-08-17T02:27:20.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.973+0000 7fab97200640 1 -- 172.21.15.6:0/1756319264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980af9b0 msgr2=0x7fab98068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.973+0000 7fab97200640 1 --2- 172.21.15.6:0/1756319264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980af9b0 0x7fab98068b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fab90009e60 tx=0x7fab90009780 comp rx=0 tx=0).stop 2024-08-17T02:27:20.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.974+0000 7fab97200640 1 -- 172.21.15.6:0/1756319264 shutdown_connections 2024-08-17T02:27:20.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.974+0000 7fab97200640 1 --2- 172.21.15.6:0/1756319264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980af9b0 0x7fab98068b80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.974+0000 7fab97200640 1 --2- 172.21.15.6:0/1756319264 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab98158a40 0x7fab980abe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.974+0000 7fab97200640 1 -- 172.21.15.6:0/1756319264 >> 172.21.15.6:0/1756319264 conn(0x7fab980ce400 msgr2=0x7fab98095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:20.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.974+0000 7fab97200640 1 -- 172.21.15.6:0/1756319264 shutdown_connections 2024-08-17T02:27:20.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.974+0000 7fab97200640 1 -- 172.21.15.6:0/1756319264 wait complete. 2024-08-17T02:27:20.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.975+0000 7fab97200640 1 Processor -- start 2024-08-17T02:27:20.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.975+0000 7fab97200640 1 -- start start 2024-08-17T02:27:20.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.976+0000 7fab97200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab980ac380 0x7fab980b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.976+0000 7fab97200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980af9b0 0x7fab98154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.976+0000 7fab97200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab98158a40 0x7fab98168980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.976+0000 7fab97200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab98169950 con 0x7fab980af9b0 2024-08-17T02:27:20.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.976+0000 7fab97200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9809a590 con 0x7fab980ac380 2024-08-17T02:27:20.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.976+0000 7fab97200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab98099fa0 con 0x7fab98158a40 2024-08-17T02:27:20.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.976+0000 7fab8fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980af9b0 0x7fab98154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.976+0000 7fab8fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980af9b0 0x7fab98154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53120/0 (socket says 172.21.15.6:53120) 2024-08-17T02:27:20.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.976+0000 7fab8fe00640 1 -- 172.21.15.6:0/2358905317 learned_addr learned my addr 172.21.15.6:0/2358905317 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:20.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.976+0000 7fab95e00640 1 --2- 172.21.15.6:0/2358905317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab980ac380 0x7fab980b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.976+0000 7fab96800640 1 --2- 172.21.15.6:0/2358905317 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab98158a40 0x7fab98168980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.977+0000 7fab8fe00640 1 -- 172.21.15.6:0/2358905317 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab98158a40 msgr2=0x7fab98168980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.977+0000 7fab8fe00640 1 --2- 172.21.15.6:0/2358905317 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab98158a40 0x7fab98168980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.977+0000 7fab8fe00640 1 -- 172.21.15.6:0/2358905317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab980ac380 msgr2=0x7fab980b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.977+0000 7fab8fe00640 1 --2- 172.21.15.6:0/2358905317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab980ac380 0x7fab980b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.977+0000 7fab8fe00640 1 -- 172.21.15.6:0/2358905317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab90009a20 con 0x7fab980af9b0 2024-08-17T02:27:20.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.977+0000 7fab8fe00640 1 --2- 172.21.15.6:0/2358905317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980af9b0 0x7fab98154e10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fab8000c5e0 tx=0x7fab80007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:20.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.977+0000 7fab8d600640 1 -- 172.21.15.6:0/2358905317 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab80005aa0 con 0x7fab980af9b0 2024-08-17T02:27:20.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.977+0000 7fab8d600640 1 -- 172.21.15.6:0/2358905317 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab80005c00 con 0x7fab980af9b0 2024-08-17T02:27:20.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.977+0000 7fab8d600640 1 -- 172.21.15.6:0/2358905317 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab800070f0 con 0x7fab980af9b0 2024-08-17T02:27:20.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.977+0000 7fab97200640 1 -- 172.21.15.6:0/2358905317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab98169390 con 0x7fab980af9b0 2024-08-17T02:27:20.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.978+0000 7fab97200640 1 -- 172.21.15.6:0/2358905317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9809a2a0 con 0x7fab980af9b0 2024-08-17T02:27:20.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.978+0000 7fab97200640 1 -- 172.21.15.6:0/2358905317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab9809a720 con 0x7fab980af9b0 2024-08-17T02:27:20.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.980+0000 7fab8d600640 1 -- 172.21.15.6:0/2358905317 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fab80007520 con 0x7fab980af9b0 2024-08-17T02:27:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.980+0000 7fab8d600640 1 --2- 172.21.15.6:0/2358905317 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fab74065150 0x7fab74067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.981+0000 7fab8d600640 1 -- 172.21.15.6:0/2358905317 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fab80081e40 con 0x7fab980af9b0 2024-08-17T02:27:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.981+0000 7fab95e00640 1 --2- 172.21.15.6:0/2358905317 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fab74065150 0x7fab74067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.982+0000 7fab95e00640 1 --2- 172.21.15.6:0/2358905317 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fab74065150 0x7fab74067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fab88009c80 tx=0x7fab880090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:20.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:20.985+0000 7fab8d600640 1 -- 172.21.15.6:0/2358905317 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fab8004fff0 con 0x7fab980af9b0 2024-08-17T02:27:21.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.206+0000 7fab97200640 1 -- 172.21.15.6:0/2358905317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fab98070720 con 0x7fab980af9b0 2024-08-17T02:27:21.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.805+0000 7fab8d600640 1 -- 172.21.15.6:0/2358905317 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fab80053610 con 0x7fab980af9b0 2024-08-17T02:27:21.807 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:27:21.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.816+0000 7fab97200640 1 -- 172.21.15.6:0/2358905317 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fab74065150 msgr2=0x7fab74067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.816+0000 7fab97200640 1 --2- 172.21.15.6:0/2358905317 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fab74065150 0x7fab74067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fab88009c80 tx=0x7fab880090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.816+0000 7fab97200640 1 -- 172.21.15.6:0/2358905317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980af9b0 msgr2=0x7fab98154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.816+0000 7fab97200640 1 --2- 172.21.15.6:0/2358905317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980af9b0 0x7fab98154e10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fab8000c5e0 tx=0x7fab80007d60 comp rx=0 tx=0).stop 2024-08-17T02:27:21.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.816+0000 7fab97200640 1 -- 172.21.15.6:0/2358905317 shutdown_connections 2024-08-17T02:27:21.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.816+0000 7fab97200640 1 --2- 172.21.15.6:0/2358905317 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fab74065150 0x7fab74067600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.816+0000 7fab97200640 1 --2- 172.21.15.6:0/2358905317 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab98158a40 0x7fab98168980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.816+0000 7fab97200640 1 --2- 172.21.15.6:0/2358905317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980af9b0 0x7fab98154e10 secure :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fab8000c5e0 tx=0x7fab80007d60 comp rx=0 tx=0).stop 2024-08-17T02:27:21.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.816+0000 7fab97200640 1 --2- 172.21.15.6:0/2358905317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab980ac380 0x7fab980b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.816+0000 7fab97200640 1 -- 172.21.15.6:0/2358905317 >> 172.21.15.6:0/2358905317 conn(0x7fab980ce400 msgr2=0x7fab9806b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:21.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.817+0000 7fab97200640 1 -- 172.21.15.6:0/2358905317 shutdown_connections 2024-08-17T02:27:21.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.817+0000 7fab97200640 1 -- 172.21.15.6:0/2358905317 wait complete. 2024-08-17T02:27:21.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.996+0000 7fb51fe00640 1 Processor -- start 2024-08-17T02:27:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.997+0000 7fb51fe00640 1 -- start start 2024-08-17T02:27:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.998+0000 7fb51fe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb520158990 0x7fb5200ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.998+0000 7fb51fe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb520158d60 0x7fb5200af590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.998+0000 7fb51fe00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5200ce930 con 0x7fb5200cd810 2024-08-17T02:27:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.998+0000 7fb51fe00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5200cdd20 con 0x7fb520158d60 2024-08-17T02:27:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.998+0000 7fb51fe00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5200ce000 con 0x7fb520158990 2024-08-17T02:27:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.998+0000 7fb516000640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb5200cd810 0x7fb5200cc520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60160/0 (socket says 172.21.15.6:60160) 2024-08-17T02:27:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.998+0000 7fb516000640 1 -- 172.21.15.6:0/480676722 learned_addr learned my addr 172.21.15.6:0/480676722 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.998+0000 7fb51f400640 1 --2- 172.21.15.6:0/480676722 >> v2:172.21.15.6:3300/0 conn(0x7fb520158d60 0x7fb5200af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.998+0000 7fb51ea00640 1 --2- 172.21.15.6:0/480676722 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb520158990 0x7fb5200ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.999+0000 7fb51e000640 1 -- 172.21.15.6:0/480676722 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373353424 0 0) 0x7fb5200ce930 con 0x7fb5200cd810 2024-08-17T02:27:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.999+0000 7fb51e000640 1 -- 172.21.15.6:0/480676722 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5040034e0 con 0x7fb5200cd810 2024-08-17T02:27:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.999+0000 7fb51f400640 1 -- 172.21.15.6:0/480676722 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb520158990 msgr2=0x7fb5200ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.999+0000 7fb51f400640 1 --2- 172.21.15.6:0/480676722 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb520158990 0x7fb5200ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.999+0000 7fb51f400640 1 -- 172.21.15.6:0/480676722 >> v1:172.21.15.6:6789/0 conn(0x7fb5200cd810 legacy=0x7fb5200cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.999+0000 7fb51f400640 1 -- 172.21.15.6:0/480676722 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5200ce2e0 con 0x7fb520158d60 2024-08-17T02:27:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:21.999+0000 7fb51ea00640 1 --2- 172.21.15.6:0/480676722 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb520158990 0x7fb5200ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.000+0000 7fb51f400640 1 --2- 172.21.15.6:0/480676722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb520158d60 0x7fb5200af590 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb518009e60 tx=0x7fb518009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376a5b1ff1607364 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.000+0000 7fb51e000640 1 -- 172.21.15.6:0/480676722 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb518007550 con 0x7fb520158d60 2024-08-17T02:27:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.000+0000 7fb51e000640 1 -- 172.21.15.6:0/480676722 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51802d050 con 0x7fb520158d60 2024-08-17T02:27:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.000+0000 7fb51e000640 1 -- 172.21.15.6:0/480676722 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb518007900 con 0x7fb520158d60 2024-08-17T02:27:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.000+0000 7fb51fe00640 1 -- 172.21.15.6:0/480676722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb520158d60 msgr2=0x7fb5200af590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.000+0000 7fb51fe00640 1 --2- 172.21.15.6:0/480676722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb520158d60 0x7fb5200af590 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb518009e60 tx=0x7fb518009780 comp rx=0 tx=0).stop 2024-08-17T02:27:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.001+0000 7fb51fe00640 1 -- 172.21.15.6:0/480676722 shutdown_connections 2024-08-17T02:27:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.001+0000 7fb51fe00640 1 --2- 172.21.15.6:0/480676722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb520158d60 0x7fb5200af590 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.001+0000 7fb51fe00640 1 --2- 172.21.15.6:0/480676722 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb520158990 0x7fb5200ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.001+0000 7fb51fe00640 1 -- 172.21.15.6:0/480676722 >> 172.21.15.6:0/480676722 conn(0x7fb52006e590 msgr2=0x7fb52006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.001+0000 7fb51fe00640 1 -- 172.21.15.6:0/480676722 shutdown_connections 2024-08-17T02:27:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.001+0000 7fb51fe00640 1 -- 172.21.15.6:0/480676722 wait complete. 2024-08-17T02:27:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.002+0000 7fb51fe00640 1 Processor -- start 2024-08-17T02:27:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.002+0000 7fb51fe00640 1 -- start start 2024-08-17T02:27:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.003+0000 7fb51fe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5200cd810 0x7fb52014ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.003+0000 7fb51fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb520158990 0x7fb5200c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.003+0000 7fb51fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb520158d60 0x7fb5201687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.003+0000 7fb51fe00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb520169840 con 0x7fb520158d60 2024-08-17T02:27:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.003+0000 7fb51fe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52014f0f0 con 0x7fb520158990 2024-08-17T02:27:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.003+0000 7fb51fe00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb520169280 con 0x7fb5200cd810 2024-08-17T02:27:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.003+0000 7fb51f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb520158d60 0x7fb5201687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.003+0000 7fb51f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb520158d60 0x7fb5201687f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53144/0 (socket says 172.21.15.6:53144) 2024-08-17T02:27:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.003+0000 7fb51f400640 1 -- 172.21.15.6:0/1332375760 learned_addr learned my addr 172.21.15.6:0/1332375760 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.003+0000 7fb51ea00640 1 --2- 172.21.15.6:0/1332375760 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5200cd810 0x7fb52014ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.003+0000 7fb516000640 1 --2- 172.21.15.6:0/1332375760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb520158990 0x7fb5200c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.004+0000 7fb51f400640 1 -- 172.21.15.6:0/1332375760 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5200cd810 msgr2=0x7fb52014ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.004+0000 7fb51f400640 1 --2- 172.21.15.6:0/1332375760 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5200cd810 0x7fb52014ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.004+0000 7fb51f400640 1 -- 172.21.15.6:0/1332375760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb520158990 msgr2=0x7fb5200c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.004+0000 7fb51f400640 1 --2- 172.21.15.6:0/1332375760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb520158990 0x7fb5200c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.004+0000 7fb51f400640 1 -- 172.21.15.6:0/1332375760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb518009a20 con 0x7fb520158d60 2024-08-17T02:27:22.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.004+0000 7fb51f400640 1 --2- 172.21.15.6:0/1332375760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb520158d60 0x7fb5201687f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb518009e60 tx=0x7fb518037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.004+0000 7fb516a00640 1 -- 172.21.15.6:0/1332375760 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb518041070 con 0x7fb520158d60 2024-08-17T02:27:22.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.004+0000 7fb516a00640 1 -- 172.21.15.6:0/1332375760 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb518031aa0 con 0x7fb520158d60 2024-08-17T02:27:22.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.004+0000 7fb51fe00640 1 -- 172.21.15.6:0/1332375760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb520169560 con 0x7fb520158d60 2024-08-17T02:27:22.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.004+0000 7fb516a00640 1 -- 172.21.15.6:0/1332375760 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb518031e80 con 0x7fb520158d60 2024-08-17T02:27:22.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.004+0000 7fb51fe00640 1 -- 172.21.15.6:0/1332375760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5200b2df0 con 0x7fb520158d60 2024-08-17T02:27:22.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.005+0000 7fb51fe00640 1 -- 172.21.15.6:0/1332375760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5200b2fe0 con 0x7fb520158d60 2024-08-17T02:27:22.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.006+0000 7fb516a00640 1 -- 172.21.15.6:0/1332375760 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb518003040 con 0x7fb520158d60 2024-08-17T02:27:22.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.007+0000 7fb516a00640 1 --2- 172.21.15.6:0/1332375760 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb4fc065150 0x7fb4fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.007+0000 7fb516a00640 1 -- 172.21.15.6:0/1332375760 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb5180a3350 con 0x7fb520158d60 2024-08-17T02:27:22.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.007+0000 7fb51ea00640 1 --2- 172.21.15.6:0/1332375760 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb4fc065150 0x7fb4fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.008+0000 7fb51ea00640 1 --2- 172.21.15.6:0/1332375760 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb4fc065150 0x7fb4fc067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb510006e70 tx=0x7fb510008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.011+0000 7fb516a00640 1 -- 172.21.15.6:0/1332375760 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb518071420 con 0x7fb520158d60 2024-08-17T02:27:22.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.196+0000 7fb51fe00640 1 -- 172.21.15.6:0/1332375760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb520070720 con 0x7fb520158d60 2024-08-17T02:27:22.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.197+0000 7fb516a00640 1 -- 172.21.15.6:0/1332375760 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15315 (secure 0 0 0) 0x7fb518074a40 con 0x7fb520158d60 2024-08-17T02:27:22.198 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:22.198 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":31,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:27:21.207928+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:19.345254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:20.195251+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:22.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.199+0000 7fb51fe00640 1 -- 172.21.15.6:0/1332375760 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb4fc065150 msgr2=0x7fb4fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.199+0000 7fb51fe00640 1 --2- 172.21.15.6:0/1332375760 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb4fc065150 0x7fb4fc067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb510006e70 tx=0x7fb510008040 comp rx=0 tx=0).stop 2024-08-17T02:27:22.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.199+0000 7fb51fe00640 1 -- 172.21.15.6:0/1332375760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb520158d60 msgr2=0x7fb5201687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.199+0000 7fb51fe00640 1 --2- 172.21.15.6:0/1332375760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb520158d60 0x7fb5201687f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb518009e60 tx=0x7fb518037000 comp rx=0 tx=0).stop 2024-08-17T02:27:22.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.200+0000 7fb51fe00640 1 -- 172.21.15.6:0/1332375760 shutdown_connections 2024-08-17T02:27:22.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.200+0000 7fb51fe00640 1 --2- 172.21.15.6:0/1332375760 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb4fc065150 0x7fb4fc067600 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.200+0000 7fb51fe00640 1 --2- 172.21.15.6:0/1332375760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb520158d60 0x7fb5201687f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.200+0000 7fb51fe00640 1 --2- 172.21.15.6:0/1332375760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb520158990 0x7fb5200c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.200+0000 7fb51fe00640 1 --2- 172.21.15.6:0/1332375760 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5200cd810 0x7fb52014ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.200+0000 7fb51fe00640 1 -- 172.21.15.6:0/1332375760 >> 172.21.15.6:0/1332375760 conn(0x7fb52006e590 msgr2=0x7fb5200c4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.200+0000 7fb51fe00640 1 -- 172.21.15.6:0/1332375760 shutdown_connections 2024-08-17T02:27:22.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.200+0000 7fb51fe00640 1 -- 172.21.15.6:0/1332375760 wait complete. 2024-08-17T02:27:22.215 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:22.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.367+0000 7f176ac00640 1 Processor -- start 2024-08-17T02:27:22.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.367+0000 7f176ac00640 1 -- start start 2024-08-17T02:27:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.368+0000 7f176ac00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f17640ae860 0x7f176406d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.368+0000 7f176ac00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1764158df0 0x7f176406dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.368+0000 7f176ac00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17640aed90 con 0x7f1764158a20 2024-08-17T02:27:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.368+0000 7f176ac00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17640af070 con 0x7f17640ae860 2024-08-17T02:27:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.368+0000 7f176ac00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17640af350 con 0x7f1764158df0 2024-08-17T02:27:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.368+0000 7f1763e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1764158a20 0x7f17640a89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60162/0 (socket says 172.21.15.6:60162) 2024-08-17T02:27:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.369+0000 7f1763e00640 1 -- 172.21.15.6:0/1451272269 learned_addr learned my addr 172.21.15.6:0/1451272269 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.369+0000 7f1763400640 1 --2- 172.21.15.6:0/1451272269 >> v2:172.21.15.136:3300/0 conn(0x7f17640ae860 0x7f176406d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.369+0000 7f1768c00640 1 --2- 172.21.15.6:0/1451272269 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1764158df0 0x7f176406dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.369+0000 7f1762a00640 1 -- 172.21.15.6:0/1451272269 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721408184 0 0) 0x7f17640aed90 con 0x7f1764158a20 2024-08-17T02:27:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.369+0000 7f1762a00640 1 -- 172.21.15.6:0/1451272269 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17480034e0 con 0x7f1764158a20 2024-08-17T02:27:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.369+0000 7f1763400640 1 -- 172.21.15.6:0/1451272269 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1764158df0 msgr2=0x7f176406dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.369+0000 7f1763400640 1 --2- 172.21.15.6:0/1451272269 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1764158df0 0x7f176406dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.369+0000 7f1763400640 1 -- 172.21.15.6:0/1451272269 >> v1:172.21.15.6:6789/0 conn(0x7f1764158a20 legacy=0x7f17640a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.369+0000 7f1763400640 1 -- 172.21.15.6:0/1451272269 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17640af630 con 0x7f17640ae860 2024-08-17T02:27:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.370+0000 7f1763400640 1 --2- 172.21.15.6:0/1451272269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17640ae860 0x7f176406d7d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1750009850 tx=0x7f17500090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=625ac914632508e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.371+0000 7f1762a00640 1 -- 172.21.15.6:0/1451272269 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175002ad90 con 0x7f17640ae860 2024-08-17T02:27:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.371+0000 7f1762a00640 1 -- 172.21.15.6:0/1451272269 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1750032440 con 0x7f17640ae860 2024-08-17T02:27:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.371+0000 7f1762a00640 1 -- 172.21.15.6:0/1451272269 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750032800 con 0x7f17640ae860 2024-08-17T02:27:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.371+0000 7f176ac00640 1 -- 172.21.15.6:0/1451272269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17640ae860 msgr2=0x7f176406d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.371+0000 7f176ac00640 1 --2- 172.21.15.6:0/1451272269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17640ae860 0x7f176406d7d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1750009850 tx=0x7f17500090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.371+0000 7f176ac00640 1 -- 172.21.15.6:0/1451272269 shutdown_connections 2024-08-17T02:27:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.371+0000 7f176ac00640 1 --2- 172.21.15.6:0/1451272269 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1764158df0 0x7f176406dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.371+0000 7f176ac00640 1 --2- 172.21.15.6:0/1451272269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17640ae860 0x7f176406d7d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.371+0000 7f176ac00640 1 -- 172.21.15.6:0/1451272269 >> 172.21.15.6:0/1451272269 conn(0x7f1764066e60 msgr2=0x7f1764067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.372+0000 7f176ac00640 1 -- 172.21.15.6:0/1451272269 shutdown_connections 2024-08-17T02:27:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.372+0000 7f176ac00640 1 -- 172.21.15.6:0/1451272269 wait complete. 2024-08-17T02:27:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.373+0000 7f176ac00640 1 Processor -- start 2024-08-17T02:27:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.373+0000 7f176ac00640 1 -- start start 2024-08-17T02:27:22.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.374+0000 7f176ac00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17640ae860 0x7f17640ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.374+0000 7f176ac00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1764158a20 0x7f176415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.374+0000 7f176ac00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1764158df0 0x7f176415c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.374+0000 7f176ac00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17640ca8b0 con 0x7f17640ae860 2024-08-17T02:27:22.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.374+0000 7f176ac00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1764159a00 con 0x7f1764158a20 2024-08-17T02:27:22.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.374+0000 7f176ac00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1764157920 con 0x7f1764158df0 2024-08-17T02:27:22.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.374+0000 7f1763e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17640ae860 0x7f17640ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.374+0000 7f1763e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17640ae860 0x7f17640ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53160/0 (socket says 172.21.15.6:53160) 2024-08-17T02:27:22.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.374+0000 7f1763e00640 1 -- 172.21.15.6:0/1931127445 learned_addr learned my addr 172.21.15.6:0/1931127445 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:22.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.375+0000 7f1768c00640 1 --2- 172.21.15.6:0/1931127445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1764158df0 0x7f176415c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.375+0000 7f1763e00640 1 -- 172.21.15.6:0/1931127445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1764158df0 msgr2=0x7f176415c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.375+0000 7f1763400640 1 --2- 172.21.15.6:0/1931127445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1764158a20 0x7f176415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.375+0000 7f1763e00640 1 --2- 172.21.15.6:0/1931127445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1764158df0 0x7f176415c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.375+0000 7f1763e00640 1 -- 172.21.15.6:0/1931127445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1764158a20 msgr2=0x7f176415bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.375+0000 7f1763e00640 1 --2- 172.21.15.6:0/1931127445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1764158a20 0x7f176415bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.375+0000 7f1763e00640 1 -- 172.21.15.6:0/1931127445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1750009390 con 0x7f17640ae860 2024-08-17T02:27:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.375+0000 7f1763400640 1 --2- 172.21.15.6:0/1931127445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1764158a20 0x7f176415bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.375+0000 7f1763e00640 1 --2- 172.21.15.6:0/1931127445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17640ae860 0x7f17640ca370 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f175400c560 tx=0x7f1754007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.375+0000 7f175b400640 1 -- 172.21.15.6:0/1931127445 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754005aa0 con 0x7f17640ae860 2024-08-17T02:27:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.375+0000 7f175b400640 1 -- 172.21.15.6:0/1931127445 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1754005c00 con 0x7f17640ae860 2024-08-17T02:27:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.375+0000 7f176ac00640 1 -- 172.21.15.6:0/1931127445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17641593b0 con 0x7f17640ae860 2024-08-17T02:27:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.375+0000 7f175b400640 1 -- 172.21.15.6:0/1931127445 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17540070d0 con 0x7f17640ae860 2024-08-17T02:27:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.376+0000 7f176ac00640 1 -- 172.21.15.6:0/1931127445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1764156b90 con 0x7f17640ae860 2024-08-17T02:27:22.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.376+0000 7f176ac00640 1 -- 172.21.15.6:0/1931127445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1764159210 con 0x7f17640ae860 2024-08-17T02:27:22.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.377+0000 7f175b400640 1 -- 172.21.15.6:0/1931127445 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f17540074c0 con 0x7f17640ae860 2024-08-17T02:27:22.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.378+0000 7f175b400640 1 --2- 172.21.15.6:0/1931127445 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1744065180 0x7f1744067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.378+0000 7f175b400640 1 -- 172.21.15.6:0/1931127445 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f17540819a0 con 0x7f17640ae860 2024-08-17T02:27:22.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.379+0000 7f1763400640 1 --2- 172.21.15.6:0/1931127445 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1744065180 0x7f1744067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.379+0000 7f1763400640 1 --2- 172.21.15.6:0/1931127445 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1744065180 0x7f1744067630 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1750034000 tx=0x7f1750032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.382+0000 7f175b400640 1 -- 172.21.15.6:0/1931127445 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1764159210 con 0x7f17640ae860 2024-08-17T02:27:22.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.565+0000 7f176ac00640 1 -- 172.21.15.6:0/1931127445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1764159210 con 0x7f17640ae860 2024-08-17T02:27:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.566+0000 7f175b400640 1 -- 172.21.15.6:0/1931127445 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f1764159210 con 0x7f17640ae860 2024-08-17T02:27:22.567 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:22.567 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":31,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:27:21.207928+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:19.345254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:20.195251+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.568+0000 7f176ac00640 1 -- 172.21.15.6:0/1931127445 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1744065180 msgr2=0x7f1744067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.568+0000 7f176ac00640 1 --2- 172.21.15.6:0/1931127445 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1744065180 0x7f1744067630 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1750034000 tx=0x7f1750032000 comp rx=0 tx=0).stop 2024-08-17T02:27:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.568+0000 7f176ac00640 1 -- 172.21.15.6:0/1931127445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17640ae860 msgr2=0x7f17640ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.568+0000 7f176ac00640 1 --2- 172.21.15.6:0/1931127445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17640ae860 0x7f17640ca370 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f175400c560 tx=0x7f1754007d60 comp rx=0 tx=0).stop 2024-08-17T02:27:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.568+0000 7f176ac00640 1 -- 172.21.15.6:0/1931127445 shutdown_connections 2024-08-17T02:27:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.568+0000 7f176ac00640 1 --2- 172.21.15.6:0/1931127445 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1744065180 0x7f1744067630 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.568+0000 7f176ac00640 1 --2- 172.21.15.6:0/1931127445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1764158df0 0x7f176415c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.568+0000 7f176ac00640 1 --2- 172.21.15.6:0/1931127445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1764158a20 0x7f176415bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.568+0000 7f176ac00640 1 --2- 172.21.15.6:0/1931127445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17640ae860 0x7f17640ca370 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.568+0000 7f176ac00640 1 -- 172.21.15.6:0/1931127445 >> 172.21.15.6:0/1931127445 conn(0x7f1764066e60 msgr2=0x7f1764155690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.568+0000 7f176ac00640 1 -- 172.21.15.6:0/1931127445 shutdown_connections 2024-08-17T02:27:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.568+0000 7f176ac00640 1 -- 172.21.15.6:0/1931127445 wait complete. 2024-08-17T02:27:22.584 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:27:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.738+0000 7fd77ce00640 1 Processor -- start 2024-08-17T02:27:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.739+0000 7fd77ce00640 1 -- start start 2024-08-17T02:27:22.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.740+0000 7fd77ce00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd7780af040 0x7fd77806c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.740+0000 7fd77ce00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7780b00c0 con 0x7fd778158b80 2024-08-17T02:27:22.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.740+0000 7fd77ce00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7780af7d0 con 0x7fd778158f50 2024-08-17T02:27:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.740+0000 7fd77ce00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7780afa70 con 0x7fd7780af040 2024-08-17T02:27:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.740+0000 7fd777400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd778158b80 0x7fd7780ae930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60164/0 (socket says 172.21.15.6:60164) 2024-08-17T02:27:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.740+0000 7fd777400640 1 -- 172.21.15.6:0/3214193819 learned_addr learned my addr 172.21.15.6:0/3214193819 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.740+0000 7fd76fe00640 1 --2- 172.21.15.6:0/3214193819 >> v2:172.21.15.136:3300/0 conn(0x7fd7780af040 0x7fd77806c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.741+0000 7fd776a00640 1 -- 172.21.15.6:0/3214193819 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475374600 0 0) 0x7fd7780b00c0 con 0x7fd778158b80 2024-08-17T02:27:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.741+0000 7fd776a00640 1 -- 172.21.15.6:0/3214193819 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd75c0034e0 con 0x7fd778158b80 2024-08-17T02:27:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.741+0000 7fd776a00640 1 -- 172.21.15.6:0/3214193819 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609456131 0 0) 0x7fd7780af7d0 con 0x7fd778158f50 2024-08-17T02:27:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.741+0000 7fd776a00640 1 -- 172.21.15.6:0/3214193819 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7780b00c0 con 0x7fd778158f50 2024-08-17T02:27:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.741+0000 7fd76fe00640 1 -- 172.21.15.6:0/3214193819 >> v1:172.21.15.136:6789/0 conn(0x7fd778158f50 legacy=0x7fd7780b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.741+0000 7fd76fe00640 1 -- 172.21.15.6:0/3214193819 >> v1:172.21.15.6:6789/0 conn(0x7fd778158b80 legacy=0x7fd7780ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.741+0000 7fd76fe00640 1 -- 172.21.15.6:0/3214193819 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7780afd50 con 0x7fd7780af040 2024-08-17T02:27:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.742+0000 7fd76fe00640 1 --2- 172.21.15.6:0/3214193819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7780af040 0x7fd77806c400 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd760009850 tx=0x7fd7600090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=597cad8a2ad96bed server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.742+0000 7fd776a00640 1 -- 172.21.15.6:0/3214193819 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76002ad90 con 0x7fd7780af040 2024-08-17T02:27:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.742+0000 7fd776a00640 1 -- 172.21.15.6:0/3214193819 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd760032440 con 0x7fd7780af040 2024-08-17T02:27:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.742+0000 7fd776a00640 1 -- 172.21.15.6:0/3214193819 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7600327e0 con 0x7fd7780af040 2024-08-17T02:27:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.743+0000 7fd77ce00640 1 -- 172.21.15.6:0/3214193819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7780af040 msgr2=0x7fd77806c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.743+0000 7fd77ce00640 1 --2- 172.21.15.6:0/3214193819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7780af040 0x7fd77806c400 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd760009850 tx=0x7fd7600090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.743+0000 7fd77ce00640 1 -- 172.21.15.6:0/3214193819 shutdown_connections 2024-08-17T02:27:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.743+0000 7fd77ce00640 1 --2- 172.21.15.6:0/3214193819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7780af040 0x7fd77806c400 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.743+0000 7fd77ce00640 1 -- 172.21.15.6:0/3214193819 >> 172.21.15.6:0/3214193819 conn(0x7fd778095a70 msgr2=0x7fd778095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.743+0000 7fd77ce00640 1 -- 172.21.15.6:0/3214193819 shutdown_connections 2024-08-17T02:27:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.743+0000 7fd77ce00640 1 -- 172.21.15.6:0/3214193819 wait complete. 2024-08-17T02:27:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.744+0000 7fd77ce00640 1 Processor -- start 2024-08-17T02:27:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.745+0000 7fd77ce00640 1 -- start start 2024-08-17T02:27:22.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.745+0000 7fd77ce00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7780af040 0x7fd77815a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.745+0000 7fd77ce00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd778158b80 0x7fd778099fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.745+0000 7fd77ce00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd778158f50 0x7fd7780abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.745+0000 7fd77ce00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77809a520 con 0x7fd778158f50 2024-08-17T02:27:22.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.745+0000 7fd77ce00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77815b870 con 0x7fd7780af040 2024-08-17T02:27:22.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.745+0000 7fd77ce00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77815ac60 con 0x7fd778158b80 2024-08-17T02:27:22.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.746+0000 7fd777e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd778158f50 0x7fd7780abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.746+0000 7fd777e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd778158f50 0x7fd7780abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53170/0 (socket says 172.21.15.6:53170) 2024-08-17T02:27:22.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.746+0000 7fd777e00640 1 -- 172.21.15.6:0/4061150934 learned_addr learned my addr 172.21.15.6:0/4061150934 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:22.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.746+0000 7fd777400640 1 --2- 172.21.15.6:0/4061150934 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7780af040 0x7fd77815a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.746+0000 7fd76fe00640 1 --2- 172.21.15.6:0/4061150934 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd778158b80 0x7fd778099fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.746+0000 7fd777e00640 1 -- 172.21.15.6:0/4061150934 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd778158b80 msgr2=0x7fd778099fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.746+0000 7fd777e00640 1 --2- 172.21.15.6:0/4061150934 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd778158b80 0x7fd778099fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.746+0000 7fd777e00640 1 -- 172.21.15.6:0/4061150934 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7780af040 msgr2=0x7fd77815a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.746+0000 7fd777e00640 1 --2- 172.21.15.6:0/4061150934 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7780af040 0x7fd77815a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.746+0000 7fd777e00640 1 -- 172.21.15.6:0/4061150934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd760009390 con 0x7fd778158f50 2024-08-17T02:27:22.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.746+0000 7fd76fe00640 1 --2- 172.21.15.6:0/4061150934 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd778158b80 0x7fd778099fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:22.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.746+0000 7fd777e00640 1 --2- 172.21.15.6:0/4061150934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd778158f50 0x7fd7780abbb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd77000c910 tx=0x7fd7700026f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.747+0000 7fd76ea00640 1 -- 172.21.15.6:0/4061150934 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77000cea0 con 0x7fd778158f50 2024-08-17T02:27:22.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.747+0000 7fd76ea00640 1 -- 172.21.15.6:0/4061150934 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77000a850 con 0x7fd778158f50 2024-08-17T02:27:22.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.747+0000 7fd76ea00640 1 -- 172.21.15.6:0/4061150934 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77000ac70 con 0x7fd778158f50 2024-08-17T02:27:22.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.747+0000 7fd77ce00640 1 -- 172.21.15.6:0/4061150934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd77815af40 con 0x7fd778158f50 2024-08-17T02:27:22.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.747+0000 7fd77ce00640 1 -- 172.21.15.6:0/4061150934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77815b500 con 0x7fd778158f50 2024-08-17T02:27:22.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.748+0000 7fd77ce00640 1 -- 172.21.15.6:0/4061150934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77815b9e0 con 0x7fd778158f50 2024-08-17T02:27:22.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.749+0000 7fd76ea00640 1 -- 172.21.15.6:0/4061150934 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd770012630 con 0x7fd778158f50 2024-08-17T02:27:22.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.749+0000 7fd76ea00640 1 --2- 172.21.15.6:0/4061150934 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd754065150 0x7fd754067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.750+0000 7fd76ea00640 1 -- 172.21.15.6:0/4061150934 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd770082790 con 0x7fd778158f50 2024-08-17T02:27:22.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.750+0000 7fd777400640 1 --2- 172.21.15.6:0/4061150934 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd754065150 0x7fd754067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.751+0000 7fd777400640 1 --2- 172.21.15.6:0/4061150934 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd754065150 0x7fd754067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd768005840 tx=0x7fd768009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.753+0000 7fd76ea00640 1 -- 172.21.15.6:0/4061150934 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd7700507b0 con 0x7fd778158f50 2024-08-17T02:27:22.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:22.983+0000 7fd77ce00640 1 -- 172.21.15.6:0/4061150934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd778070720 con 0x7fd778158f50 2024-08-17T02:27:23.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:23.819+0000 7fd76ea00640 1 -- 172.21.15.6:0/4061150934 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd770053dd0 con 0x7fd778158f50 2024-08-17T02:27:23.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:23.822+0000 7fd77ce00640 1 -- 172.21.15.6:0/4061150934 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd754065150 msgr2=0x7fd754067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:23.822+0000 7fd77ce00640 1 --2- 172.21.15.6:0/4061150934 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd754065150 0x7fd754067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd768005840 tx=0x7fd768009040 comp rx=0 tx=0).stop 2024-08-17T02:27:23.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:23.822+0000 7fd77ce00640 1 -- 172.21.15.6:0/4061150934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd778158f50 msgr2=0x7fd7780abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:23.822+0000 7fd77ce00640 1 --2- 172.21.15.6:0/4061150934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd778158f50 0x7fd7780abbb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd77000c910 tx=0x7fd7700026f0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:23.822+0000 7fd77ce00640 1 -- 172.21.15.6:0/4061150934 shutdown_connections 2024-08-17T02:27:23.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:23.822+0000 7fd77ce00640 1 --2- 172.21.15.6:0/4061150934 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd754065150 0x7fd754067600 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:23.822+0000 7fd77ce00640 1 --2- 172.21.15.6:0/4061150934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd778158f50 0x7fd7780abbb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:23.822+0000 7fd77ce00640 1 --2- 172.21.15.6:0/4061150934 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd778158b80 0x7fd778099fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:23.822+0000 7fd77ce00640 1 --2- 172.21.15.6:0/4061150934 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7780af040 0x7fd77815a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:23.822+0000 7fd77ce00640 1 -- 172.21.15.6:0/4061150934 >> 172.21.15.6:0/4061150934 conn(0x7fd778095a70 msgr2=0x7fd7780b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:23.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:23.822+0000 7fd77ce00640 1 -- 172.21.15.6:0/4061150934 shutdown_connections 2024-08-17T02:27:23.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:23.822+0000 7fd77ce00640 1 -- 172.21.15.6:0/4061150934 wait complete. 2024-08-17T02:27:23.841 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:27:24.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.000+0000 7f4fd2a00640 1 Processor -- start 2024-08-17T02:27:24.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.000+0000 7f4fd2a00640 1 -- start start 2024-08-17T02:27:24.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.001+0000 7f4fd2a00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fcc0ad960 0x7f4fcc15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.001+0000 7f4fd2a00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fcc15b5e0 con 0x7f4fcc0add30 2024-08-17T02:27:24.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.002+0000 7f4fd2a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fcc0cb160 con 0x7f4fcc0ca050 2024-08-17T02:27:24.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.002+0000 7f4fd2a00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fcc0b0d10 con 0x7f4fcc0ad960 2024-08-17T02:27:24.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.002+0000 7f4fd0a00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4fcc0add30 0x7f4fcc0aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60178/0 (socket says 172.21.15.6:60178) 2024-08-17T02:27:24.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.002+0000 7f4fd0a00640 1 -- 172.21.15.6:0/704469251 learned_addr learned my addr 172.21.15.6:0/704469251 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:24.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.002+0000 7f4fcbe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fcc0ad960 0x7f4fcc15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.002+0000 7f4fcbe00640 1 -- 172.21.15.6:0/704469251 >> v1:172.21.15.136:6789/0 conn(0x7f4fcc0ca050 legacy=0x7f4fcc156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:24.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.002+0000 7f4fcbe00640 1 -- 172.21.15.6:0/704469251 >> v1:172.21.15.6:6789/0 conn(0x7f4fcc0add30 legacy=0x7f4fcc0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.002+0000 7f4fcbe00640 1 -- 172.21.15.6:0/704469251 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc0ca550 con 0x7f4fcc0ad960 2024-08-17T02:27:24.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.002+0000 7f4fcb400640 1 -- 172.21.15.6:0/704469251 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734395749 0 0) 0x7f4fc4001490 con 0x7f4fcc0add30 2024-08-17T02:27:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.003+0000 7f4fcbe00640 1 --2- 172.21.15.6:0/704469251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fcc0ad960 0x7f4fcc15b0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009850 tx=0x7f4fbc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22cf115209318 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.004+0000 7f4fcb400640 1 -- 172.21.15.6:0/704469251 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc02ae40 con 0x7f4fcc0ad960 2024-08-17T02:27:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.004+0000 7f4fcb400640 1 -- 172.21.15.6:0/704469251 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc032440 con 0x7f4fcc0ad960 2024-08-17T02:27:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.004+0000 7f4fcb400640 1 -- 172.21.15.6:0/704469251 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0327e0 con 0x7f4fcc0ad960 2024-08-17T02:27:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.004+0000 7f4fd2a00640 1 -- 172.21.15.6:0/704469251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fcc0ad960 msgr2=0x7f4fcc15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.004+0000 7f4fd2a00640 1 --2- 172.21.15.6:0/704469251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fcc0ad960 0x7f4fcc15b0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009850 tx=0x7f4fbc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.004+0000 7f4fd2a00640 1 -- 172.21.15.6:0/704469251 shutdown_connections 2024-08-17T02:27:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.004+0000 7f4fd2a00640 1 --2- 172.21.15.6:0/704469251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fcc0ad960 0x7f4fcc15b0a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.004+0000 7f4fd2a00640 1 -- 172.21.15.6:0/704469251 >> 172.21.15.6:0/704469251 conn(0x7f4fcc066e60 msgr2=0x7f4fcc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.004+0000 7f4fd2a00640 1 -- 172.21.15.6:0/704469251 shutdown_connections 2024-08-17T02:27:24.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.004+0000 7f4fd2a00640 1 -- 172.21.15.6:0/704469251 wait complete. 2024-08-17T02:27:24.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.006+0000 7f4fd2a00640 1 Processor -- start 2024-08-17T02:27:24.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.006+0000 7f4fd2a00640 1 -- start start 2024-08-17T02:27:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.007+0000 7f4fd2a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fcc0ad960 0x7f4fcc0aa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.007+0000 7f4fd2a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4fcc0add30 0x7f4fcc154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.007+0000 7f4fd2a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fcc0ca050 0x7f4fcc0a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.007+0000 7f4fd2a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc16b5e0 con 0x7f4fcc0ca050 2024-08-17T02:27:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.007+0000 7f4fd2a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc0a92d0 con 0x7f4fcc0ad960 2024-08-17T02:27:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.007+0000 7f4fd2a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc0a9550 con 0x7f4fcc0add30 2024-08-17T02:27:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.007+0000 7f4fd0a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fcc0ca050 0x7f4fcc0a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.007+0000 7f4fd0a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fcc0ca050 0x7f4fcc0a72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53188/0 (socket says 172.21.15.6:53188) 2024-08-17T02:27:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.007+0000 7f4fd0a00640 1 -- 172.21.15.6:0/3436665592 learned_addr learned my addr 172.21.15.6:0/3436665592 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.007+0000 7f4fcbe00640 1 --2- 172.21.15.6:0/3436665592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fcc0ad960 0x7f4fcc0aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.007+0000 7f4fc3400640 1 --2- 172.21.15.6:0/3436665592 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4fcc0add30 0x7f4fcc154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.007+0000 7f4fd0a00640 1 -- 172.21.15.6:0/3436665592 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4fcc0add30 msgr2=0x7f4fcc154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.007+0000 7f4fd0a00640 1 --2- 172.21.15.6:0/3436665592 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4fcc0add30 0x7f4fcc154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.008+0000 7f4fd0a00640 1 -- 172.21.15.6:0/3436665592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fcc0ad960 msgr2=0x7f4fcc0aa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.008+0000 7f4fd0a00640 1 --2- 172.21.15.6:0/3436665592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fcc0ad960 0x7f4fcc0aa310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.008+0000 7f4fd0a00640 1 -- 172.21.15.6:0/3436665592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc009390 con 0x7f4fcc0ca050 2024-08-17T02:27:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.008+0000 7f4fcbe00640 1 --2- 172.21.15.6:0/3436665592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fcc0ad960 0x7f4fcc0aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.008+0000 7f4fd0a00640 1 --2- 172.21.15.6:0/3436665592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fcc0ca050 0x7f4fcc0a72e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400ccc0 tx=0x7f4fc4001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.008+0000 7f4fc3e00640 1 -- 172.21.15.6:0/3436665592 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc400ce80 con 0x7f4fcc0ca050 2024-08-17T02:27:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.008+0000 7f4fc3e00640 1 -- 172.21.15.6:0/3436665592 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc400a850 con 0x7f4fcc0ca050 2024-08-17T02:27:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.008+0000 7f4fd2a00640 1 -- 172.21.15.6:0/3436665592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fcc0a9830 con 0x7f4fcc0ca050 2024-08-17T02:27:24.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.008+0000 7f4fc3e00640 1 -- 172.21.15.6:0/3436665592 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc400ac50 con 0x7f4fcc0ca050 2024-08-17T02:27:24.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.008+0000 7f4fd2a00640 1 -- 172.21.15.6:0/3436665592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fcc0a9df0 con 0x7f4fcc0ca050 2024-08-17T02:27:24.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.009+0000 7f4fd2a00640 1 -- 172.21.15.6:0/3436665592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fcc0aa040 con 0x7f4fcc0ca050 2024-08-17T02:27:24.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.010+0000 7f4fc3e00640 1 -- 172.21.15.6:0/3436665592 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4fc4007300 con 0x7f4fcc0ca050 2024-08-17T02:27:24.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.011+0000 7f4fc3e00640 1 --2- 172.21.15.6:0/3436665592 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4fa8065150 0x7f4fa8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.011+0000 7f4fc3e00640 1 -- 172.21.15.6:0/3436665592 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4fc40825e0 con 0x7f4fcc0ca050 2024-08-17T02:27:24.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.012+0000 7f4fcbe00640 1 --2- 172.21.15.6:0/3436665592 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4fa8065150 0x7f4fa8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.013+0000 7f4fcbe00640 1 --2- 172.21.15.6:0/3436665592 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4fa8065150 0x7f4fa8067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc034000 tx=0x7f4fbc032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.015+0000 7f4fc3e00640 1 -- 172.21.15.6:0/3436665592 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4fc40505f0 con 0x7f4fcc0ca050 2024-08-17T02:27:24.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.234+0000 7f4fd2a00640 1 -- 172.21.15.6:0/3436665592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4fcc15b5e0 con 0x7f4fcc0ca050 2024-08-17T02:27:24.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.822+0000 7f4fc3e00640 1 -- 172.21.15.6:0/3436665592 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4fcc15b5e0 con 0x7f4fcc0ca050 2024-08-17T02:27:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.824+0000 7f4fd2a00640 1 -- 172.21.15.6:0/3436665592 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4fa8065150 msgr2=0x7f4fa8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.824+0000 7f4fd2a00640 1 --2- 172.21.15.6:0/3436665592 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4fa8065150 0x7f4fa8067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc034000 tx=0x7f4fbc032000 comp rx=0 tx=0).stop 2024-08-17T02:27:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.824+0000 7f4fd2a00640 1 -- 172.21.15.6:0/3436665592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fcc0ca050 msgr2=0x7f4fcc0a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.824+0000 7f4fd2a00640 1 --2- 172.21.15.6:0/3436665592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fcc0ca050 0x7f4fcc0a72e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400ccc0 tx=0x7f4fc4001a10 comp rx=0 tx=0).stop 2024-08-17T02:27:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.825+0000 7f4fd2a00640 1 -- 172.21.15.6:0/3436665592 shutdown_connections 2024-08-17T02:27:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.825+0000 7f4fd2a00640 1 --2- 172.21.15.6:0/3436665592 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4fa8065150 0x7f4fa8067600 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.825+0000 7f4fd2a00640 1 --2- 172.21.15.6:0/3436665592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fcc0ca050 0x7f4fcc0a72e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.825+0000 7f4fd2a00640 1 --2- 172.21.15.6:0/3436665592 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4fcc0add30 0x7f4fcc154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.825+0000 7f4fd2a00640 1 --2- 172.21.15.6:0/3436665592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fcc0ad960 0x7f4fcc0aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.825+0000 7f4fd2a00640 1 -- 172.21.15.6:0/3436665592 >> 172.21.15.6:0/3436665592 conn(0x7f4fcc066e60 msgr2=0x7f4fcc152440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.825+0000 7f4fd2a00640 1 -- 172.21.15.6:0/3436665592 shutdown_connections 2024-08-17T02:27:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.825+0000 7f4fd2a00640 1 -- 172.21.15.6:0/3436665592 wait complete. 2024-08-17T02:27:24.843 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:24.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.996+0000 7fb47f800640 1 Processor -- start 2024-08-17T02:27:24.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.996+0000 7fb47f800640 1 -- start start 2024-08-17T02:27:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.998+0000 7fb47f800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4780afca0 0x7fb4780b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.998+0000 7fb47f800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4780acf10 0x7fb478159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.998+0000 7fb47f800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47815a4e0 con 0x7fb4781589a0 2024-08-17T02:27:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.998+0000 7fb47f800640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4780b0980 con 0x7fb4780afca0 2024-08-17T02:27:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.998+0000 7fb47f800640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4780c92b0 con 0x7fb4780acf10 2024-08-17T02:27:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.998+0000 7fb47ce00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4780afca0 0x7fb4780b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.998+0000 7fb47ce00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4780afca0 0x7fb4780b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41064/0 (socket says 172.21.15.6:41064) 2024-08-17T02:27:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.998+0000 7fb47ce00640 1 -- 172.21.15.6:0/2325602015 learned_addr learned my addr 172.21.15.6:0/2325602015 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.998+0000 7fb477e00640 1 --2- 172.21.15.6:0/2325602015 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4780acf10 0x7fb478159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.998+0000 7fb47ce00640 1 -- 172.21.15.6:0/2325602015 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4780acf10 msgr2=0x7fb478159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.998+0000 7fb47ce00640 1 --2- 172.21.15.6:0/2325602015 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4780acf10 0x7fb478159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.998+0000 7fb47ce00640 1 -- 172.21.15.6:0/2325602015 >> v1:172.21.15.136:6789/0 conn(0x7fb4781589a0 legacy=0x7fb47806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.998+0000 7fb47ce00640 1 -- 172.21.15.6:0/2325602015 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4780ad480 con 0x7fb4780afca0 2024-08-17T02:27:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.998+0000 7fb477e00640 1 --2- 172.21.15.6:0/2325602015 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4780acf10 0x7fb478159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:24.999+0000 7fb47ce00640 1 --2- 172.21.15.6:0/2325602015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4780afca0 0x7fb4780b0070 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb46c009940 tx=0x7fb46c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741a66a4122956be server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.000+0000 7fb477400640 1 -- 172.21.15.6:0/2325602015 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c02ade0 con 0x7fb4780afca0 2024-08-17T02:27:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.000+0000 7fb477400640 1 -- 172.21.15.6:0/2325602015 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c032440 con 0x7fb4780afca0 2024-08-17T02:27:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.000+0000 7fb477400640 1 -- 172.21.15.6:0/2325602015 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0327e0 con 0x7fb4780afca0 2024-08-17T02:27:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.000+0000 7fb47f800640 1 -- 172.21.15.6:0/2325602015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4780afca0 msgr2=0x7fb4780b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.000+0000 7fb47f800640 1 --2- 172.21.15.6:0/2325602015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4780afca0 0x7fb4780b0070 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb46c009940 tx=0x7fb46c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.000+0000 7fb47f800640 1 -- 172.21.15.6:0/2325602015 shutdown_connections 2024-08-17T02:27:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.000+0000 7fb47f800640 1 --2- 172.21.15.6:0/2325602015 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4780acf10 0x7fb478159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.000+0000 7fb47f800640 1 --2- 172.21.15.6:0/2325602015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4780afca0 0x7fb4780b0070 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.000+0000 7fb47f800640 1 -- 172.21.15.6:0/2325602015 >> 172.21.15.6:0/2325602015 conn(0x7fb478066e60 msgr2=0x7fb478067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.000+0000 7fb47f800640 1 -- 172.21.15.6:0/2325602015 shutdown_connections 2024-08-17T02:27:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.000+0000 7fb47f800640 1 -- 172.21.15.6:0/2325602015 wait complete. 2024-08-17T02:27:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.002+0000 7fb47f800640 1 Processor -- start 2024-08-17T02:27:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.002+0000 7fb47f800640 1 -- start start 2024-08-17T02:27:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.003+0000 7fb47f800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4780acf10 0x7fb47814ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.003+0000 7fb47f800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4780afca0 0x7fb4781480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.003+0000 7fb47f800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4781589a0 0x7fb47814ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.003+0000 7fb47f800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb478167e30 con 0x7fb4780afca0 2024-08-17T02:27:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.003+0000 7fb47f800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4781689b0 con 0x7fb4781589a0 2024-08-17T02:27:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.003+0000 7fb47f800640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb478168080 con 0x7fb4780acf10 2024-08-17T02:27:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.003+0000 7fb477e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4780afca0 0x7fb4781480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.003+0000 7fb477e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4780afca0 0x7fb4781480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41080/0 (socket says 172.21.15.6:41080) 2024-08-17T02:27:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.003+0000 7fb477e00640 1 -- 172.21.15.6:0/2760461982 learned_addr learned my addr 172.21.15.6:0/2760461982 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.003+0000 7fb47ce00640 1 --2- 172.21.15.6:0/2760461982 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4780acf10 0x7fb47814ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.003+0000 7fb47d800640 1 --2- 172.21.15.6:0/2760461982 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4781589a0 0x7fb47814ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.004+0000 7fb477e00640 1 -- 172.21.15.6:0/2760461982 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4780acf10 msgr2=0x7fb47814ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.004+0000 7fb477e00640 1 --2- 172.21.15.6:0/2760461982 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4780acf10 0x7fb47814ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.004+0000 7fb477e00640 1 -- 172.21.15.6:0/2760461982 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4781589a0 msgr2=0x7fb47814ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.004+0000 7fb477e00640 1 --2- 172.21.15.6:0/2760461982 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4781589a0 0x7fb47814ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.004+0000 7fb477e00640 1 -- 172.21.15.6:0/2760461982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c009450 con 0x7fb4780afca0 2024-08-17T02:27:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.004+0000 7fb47d800640 1 --2- 172.21.15.6:0/2760461982 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4781589a0 0x7fb47814ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.004+0000 7fb477e00640 1 --2- 172.21.15.6:0/2760461982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4780afca0 0x7fb4781480a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb46400c8b0 tx=0x7fb464008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.004+0000 7fb46be00640 1 -- 172.21.15.6:0/2760461982 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46400ce40 con 0x7fb4780afca0 2024-08-17T02:27:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.004+0000 7fb46be00640 1 -- 172.21.15.6:0/2760461982 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb464007890 con 0x7fb4780afca0 2024-08-17T02:27:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.004+0000 7fb46be00640 1 -- 172.21.15.6:0/2760461982 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464007c10 con 0x7fb4780afca0 2024-08-17T02:27:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.004+0000 7fb47f800640 1 -- 172.21.15.6:0/2760461982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb478168360 con 0x7fb4780afca0 2024-08-17T02:27:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.004+0000 7fb47f800640 1 -- 172.21.15.6:0/2760461982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47814d3f0 con 0x7fb4780afca0 2024-08-17T02:27:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.005+0000 7fb47f800640 1 -- 172.21.15.6:0/2760461982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb478063fb0 con 0x7fb4780afca0 2024-08-17T02:27:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.006+0000 7fb46be00640 1 -- 172.21.15.6:0/2760461982 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb4640113f0 con 0x7fb4780afca0 2024-08-17T02:27:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.007+0000 7fb46be00640 1 --2- 172.21.15.6:0/2760461982 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb458065150 0x7fb458067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.007+0000 7fb46be00640 1 -- 172.21.15.6:0/2760461982 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb464082420 con 0x7fb4780afca0 2024-08-17T02:27:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.007+0000 7fb47ce00640 1 --2- 172.21.15.6:0/2760461982 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb458065150 0x7fb458067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.008+0000 7fb47ce00640 1 --2- 172.21.15.6:0/2760461982 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb458065150 0x7fb458067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb46c034000 tx=0x7fb46c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.011+0000 7fb46be00640 1 -- 172.21.15.6:0/2760461982 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb464053f80 con 0x7fb4780afca0 2024-08-17T02:27:25.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.229+0000 7fb47f800640 1 -- 172.21.15.6:0/2760461982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb478067b70 con 0x7fb4780afca0 2024-08-17T02:27:25.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.230+0000 7fb46be00640 1 -- 172.21.15.6:0/2760461982 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fb464053b10 con 0x7fb4780afca0 2024-08-17T02:27:25.230 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:25.231 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/4280185456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":4280185456},{"type":"v1","addr":"172.21.15.136:6836","nonce":4280185456}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2517061869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":2517061869},{"type":"v1","addr":"172.21.15.136:6837","nonce":2517061869}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4935,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2620799775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2620799775},{"type":"v1","addr":"172.21.15.6:6834","nonce":2620799775}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:21.208240+0000","modified":"2024-08-17T02:27:24.818513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/285178879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":285178879},{"type":"v1","addr":"172.21.15.6:6835","nonce":285178879}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:27:25.231 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 15 2024-08-17T02:27:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.232+0000 7fb47f800640 1 -- 172.21.15.6:0/2760461982 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb458065150 msgr2=0x7fb458067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.232+0000 7fb47f800640 1 --2- 172.21.15.6:0/2760461982 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb458065150 0x7fb458067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb46c034000 tx=0x7fb46c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.232+0000 7fb47f800640 1 -- 172.21.15.6:0/2760461982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4780afca0 msgr2=0x7fb4781480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.232+0000 7fb47f800640 1 --2- 172.21.15.6:0/2760461982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4780afca0 0x7fb4781480a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb46400c8b0 tx=0x7fb464008040 comp rx=0 tx=0).stop 2024-08-17T02:27:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.232+0000 7fb47f800640 1 -- 172.21.15.6:0/2760461982 shutdown_connections 2024-08-17T02:27:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.232+0000 7fb47f800640 1 --2- 172.21.15.6:0/2760461982 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb458065150 0x7fb458067600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.232+0000 7fb47f800640 1 --2- 172.21.15.6:0/2760461982 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4781589a0 0x7fb47814ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.232+0000 7fb47f800640 1 --2- 172.21.15.6:0/2760461982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4780afca0 0x7fb4781480a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.232+0000 7fb47f800640 1 --2- 172.21.15.6:0/2760461982 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4780acf10 0x7fb47814ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.232+0000 7fb47f800640 1 -- 172.21.15.6:0/2760461982 >> 172.21.15.6:0/2760461982 conn(0x7fb478066e60 msgr2=0x7fb478153520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.232+0000 7fb47f800640 1 -- 172.21.15.6:0/2760461982 shutdown_connections 2024-08-17T02:27:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.232+0000 7fb47f800640 1 -- 172.21.15.6:0/2760461982 wait complete. 2024-08-17T02:27:25.248 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:25.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.398+0000 7fa0a2e00640 1 Processor -- start 2024-08-17T02:27:25.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.398+0000 7fa0a2e00640 1 -- start start 2024-08-17T02:27:25.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.400+0000 7fa0a2e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa09c158a20 0x7fa09c0a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.400+0000 7fa0a2e00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa09c0aed90 con 0x7fa09c0ae860 2024-08-17T02:27:25.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.400+0000 7fa0a2e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa09c0af070 con 0x7fa09c06dee0 2024-08-17T02:27:25.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.400+0000 7fa0a2e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09c0af350 con 0x7fa09c158a20 2024-08-17T02:27:25.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.400+0000 7fa093e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa09c0ae860 0x7fa09c06d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56638/0 (socket says 172.21.15.6:56638) 2024-08-17T02:27:25.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.400+0000 7fa093e00640 1 -- 172.21.15.6:0/3035372761 learned_addr learned my addr 172.21.15.6:0/3035372761 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:25.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.400+0000 7fa09be00640 1 --2- 172.21.15.6:0/3035372761 >> v2:172.21.15.136:3300/0 conn(0x7fa09c158a20 0x7fa09c0a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.401+0000 7fa09b400640 1 -- 172.21.15.6:0/3035372761 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984366987 0 0) 0x7fa09c0aed90 con 0x7fa09c0ae860 2024-08-17T02:27:25.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.401+0000 7fa09b400640 1 -- 172.21.15.6:0/3035372761 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0800034e0 con 0x7fa09c0ae860 2024-08-17T02:27:25.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.401+0000 7fa09b400640 1 -- 172.21.15.6:0/3035372761 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407831137 0 0) 0x7fa09c0af070 con 0x7fa09c06dee0 2024-08-17T02:27:25.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.401+0000 7fa09b400640 1 -- 172.21.15.6:0/3035372761 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa09c0aed90 con 0x7fa09c06dee0 2024-08-17T02:27:25.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.401+0000 7fa09be00640 1 -- 172.21.15.6:0/3035372761 >> v1:172.21.15.136:6789/0 conn(0x7fa09c06dee0 legacy=0x7fa09c0afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.401+0000 7fa09be00640 1 -- 172.21.15.6:0/3035372761 >> v1:172.21.15.6:6789/0 conn(0x7fa09c0ae860 legacy=0x7fa09c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.401+0000 7fa09b400640 1 -- 172.21.15.6:0/3035372761 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1877360689 0 0) 0x7fa0800034e0 con 0x7fa09c0ae860 2024-08-17T02:27:25.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.401+0000 7fa09be00640 1 -- 172.21.15.6:0/3035372761 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c0af630 con 0x7fa09c158a20 2024-08-17T02:27:25.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.402+0000 7fa09be00640 1 --2- 172.21.15.6:0/3035372761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa09c158a20 0x7fa09c0a89c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009850 tx=0x7fa08c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d36ba15cb0b26397 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.402+0000 7fa09b400640 1 -- 172.21.15.6:0/3035372761 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c02ae20 con 0x7fa09c158a20 2024-08-17T02:27:25.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.402+0000 7fa09b400640 1 -- 172.21.15.6:0/3035372761 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c032440 con 0x7fa09c158a20 2024-08-17T02:27:25.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.402+0000 7fa09b400640 1 -- 172.21.15.6:0/3035372761 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c0327c0 con 0x7fa09c158a20 2024-08-17T02:27:25.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.403+0000 7fa0a2e00640 1 -- 172.21.15.6:0/3035372761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa09c158a20 msgr2=0x7fa09c0a89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.403+0000 7fa0a2e00640 1 --2- 172.21.15.6:0/3035372761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa09c158a20 0x7fa09c0a89c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009850 tx=0x7fa08c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.403+0000 7fa0a2e00640 1 -- 172.21.15.6:0/3035372761 shutdown_connections 2024-08-17T02:27:25.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.403+0000 7fa0a2e00640 1 --2- 172.21.15.6:0/3035372761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa09c158a20 0x7fa09c0a89c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.403+0000 7fa0a2e00640 1 -- 172.21.15.6:0/3035372761 >> 172.21.15.6:0/3035372761 conn(0x7fa09c066e60 msgr2=0x7fa09c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.403+0000 7fa0a2e00640 1 -- 172.21.15.6:0/3035372761 shutdown_connections 2024-08-17T02:27:25.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.403+0000 7fa0a2e00640 1 -- 172.21.15.6:0/3035372761 wait complete. 2024-08-17T02:27:25.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.405+0000 7fa0a2e00640 1 Processor -- start 2024-08-17T02:27:25.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.405+0000 7fa0a2e00640 1 -- start start 2024-08-17T02:27:25.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.406+0000 7fa0a2e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09c06dee0 0x7fa09c156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.406+0000 7fa0a2e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa09c0ae860 0x7fa09c1512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.406+0000 7fa0a2e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa09c158a20 0x7fa09c158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.406+0000 7fa0a2e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c15a130 con 0x7fa09c06dee0 2024-08-17T02:27:25.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.406+0000 7fa0a2e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c15a4c0 con 0x7fa09c158a20 2024-08-17T02:27:25.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.406+0000 7fa0a2e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c159890 con 0x7fa09c0ae860 2024-08-17T02:27:25.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.406+0000 7fa09be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09c06dee0 0x7fa09c156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.406+0000 7fa09be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09c06dee0 0x7fa09c156520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41092/0 (socket says 172.21.15.6:41092) 2024-08-17T02:27:25.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.406+0000 7fa09be00640 1 -- 172.21.15.6:0/1601537575 learned_addr learned my addr 172.21.15.6:0/1601537575 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:25.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.406+0000 7fa093e00640 1 --2- 172.21.15.6:0/1601537575 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa09c0ae860 0x7fa09c1512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.406+0000 7fa0a0e00640 1 --2- 172.21.15.6:0/1601537575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa09c158a20 0x7fa09c158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.406+0000 7fa09be00640 1 -- 172.21.15.6:0/1601537575 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa09c0ae860 msgr2=0x7fa09c1512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.406+0000 7fa09be00640 1 --2- 172.21.15.6:0/1601537575 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa09c0ae860 0x7fa09c1512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.406+0000 7fa09be00640 1 -- 172.21.15.6:0/1601537575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa09c158a20 msgr2=0x7fa09c158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.406+0000 7fa09be00640 1 --2- 172.21.15.6:0/1601537575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa09c158a20 0x7fa09c158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.406+0000 7fa09be00640 1 -- 172.21.15.6:0/1601537575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c009390 con 0x7fa09c06dee0 2024-08-17T02:27:25.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.407+0000 7fa09be00640 1 --2- 172.21.15.6:0/1601537575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09c06dee0 0x7fa09c156520 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009360 tx=0x7fa08c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.407+0000 7fa093400640 1 -- 172.21.15.6:0/1601537575 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c031900 con 0x7fa09c06dee0 2024-08-17T02:27:25.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.407+0000 7fa093400640 1 -- 172.21.15.6:0/1601537575 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c031a60 con 0x7fa09c06dee0 2024-08-17T02:27:25.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.407+0000 7fa0a2e00640 1 -- 172.21.15.6:0/1601537575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09c159b70 con 0x7fa09c06dee0 2024-08-17T02:27:25.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.407+0000 7fa093400640 1 -- 172.21.15.6:0/1601537575 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c031e20 con 0x7fa09c06dee0 2024-08-17T02:27:25.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.407+0000 7fa0a2e00640 1 -- 172.21.15.6:0/1601537575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09c15bce0 con 0x7fa09c06dee0 2024-08-17T02:27:25.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.408+0000 7fa0a2e00640 1 -- 172.21.15.6:0/1601537575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09c15a290 con 0x7fa09c06dee0 2024-08-17T02:27:25.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.409+0000 7fa093400640 1 -- 172.21.15.6:0/1601537575 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa08c03c400 con 0x7fa09c06dee0 2024-08-17T02:27:25.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.410+0000 7fa093400640 1 --2- 172.21.15.6:0/1601537575 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa078065150 0x7fa078067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.410+0000 7fa093400640 1 -- 172.21.15.6:0/1601537575 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa08c0a2970 con 0x7fa09c06dee0 2024-08-17T02:27:25.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.410+0000 7fa093e00640 1 --2- 172.21.15.6:0/1601537575 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa078065150 0x7fa078067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.411+0000 7fa093e00640 1 --2- 172.21.15.6:0/1601537575 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa078065150 0x7fa078067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0cad70 tx=0x7fa084005880 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.414+0000 7fa093400640 1 -- 172.21.15.6:0/1601537575 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa08c070990 con 0x7fa09c06dee0 2024-08-17T02:27:25.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.598+0000 7fa0a2e00640 1 -- 172.21.15.6:0/1601537575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa09c063fb0 con 0x7fa09c06dee0 2024-08-17T02:27:25.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.599+0000 7fa093400640 1 -- 172.21.15.6:0/1601537575 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fa08c043090 con 0x7fa09c06dee0 2024-08-17T02:27:25.600 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:25.600 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":32,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:27:22.800638+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:19.345254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:20.195251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:25.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.601+0000 7fa0a2e00640 1 -- 172.21.15.6:0/1601537575 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa078065150 msgr2=0x7fa078067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.601+0000 7fa0a2e00640 1 --2- 172.21.15.6:0/1601537575 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa078065150 0x7fa078067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0cad70 tx=0x7fa084005880 comp rx=0 tx=0).stop 2024-08-17T02:27:25.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.601+0000 7fa0a2e00640 1 -- 172.21.15.6:0/1601537575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09c06dee0 msgr2=0x7fa09c156520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.601+0000 7fa0a2e00640 1 --2- 172.21.15.6:0/1601537575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09c06dee0 0x7fa09c156520 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009360 tx=0x7fa08c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:25.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.601+0000 7fa0a2e00640 1 -- 172.21.15.6:0/1601537575 shutdown_connections 2024-08-17T02:27:25.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.601+0000 7fa0a2e00640 1 --2- 172.21.15.6:0/1601537575 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa078065150 0x7fa078067600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.601+0000 7fa0a2e00640 1 --2- 172.21.15.6:0/1601537575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa09c158a20 0x7fa09c158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.601+0000 7fa0a2e00640 1 --2- 172.21.15.6:0/1601537575 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa09c0ae860 0x7fa09c1512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.601+0000 7fa0a2e00640 1 --2- 172.21.15.6:0/1601537575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09c06dee0 0x7fa09c156520 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.601+0000 7fa0a2e00640 1 -- 172.21.15.6:0/1601537575 >> 172.21.15.6:0/1601537575 conn(0x7fa09c066e60 msgr2=0x7fa09c0afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.601+0000 7fa0a2e00640 1 -- 172.21.15.6:0/1601537575 shutdown_connections 2024-08-17T02:27:25.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.601+0000 7fa0a2e00640 1 -- 172.21.15.6:0/1601537575 wait complete. 2024-08-17T02:27:25.617 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:27:25.617 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:25.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.767+0000 7fa8bee00640 1 Processor -- start 2024-08-17T02:27:25.768 INFO:tasks.ceph.mds.a.smithi006.stderr:2024-08-17T02:27:25.767+0000 7fd462400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:27:25.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.767+0000 7fa8bee00640 1 -- start start 2024-08-17T02:27:25.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.768+0000 7fa8bee00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8b80afca0 0x7fa8b80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.769+0000 7fa8bee00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b80c92b0 con 0x7fa8b80acf10 2024-08-17T02:27:25.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.769+0000 7fa8bee00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b80ad480 con 0x7fa8b81590b0 2024-08-17T02:27:25.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.769+0000 7fa8bee00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b80b0980 con 0x7fa8b80afca0 2024-08-17T02:27:25.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.769+0000 7fa8b7e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8b80afca0 0x7fa8b80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.769+0000 7fa8af400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa8b80acf10 0x7fa8b81589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56642/0 (socket says 172.21.15.6:56642) 2024-08-17T02:27:25.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.769+0000 7fa8af400640 1 -- 172.21.15.6:0/2277157772 learned_addr learned my addr 172.21.15.6:0/2277157772 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:25.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.769+0000 7fa8b7e00640 1 -- 172.21.15.6:0/2277157772 >> v1:172.21.15.136:6789/0 conn(0x7fa8b81590b0 legacy=0x7fa8b80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.769+0000 7fa8b7e00640 1 -- 172.21.15.6:0/2277157772 >> v1:172.21.15.6:6789/0 conn(0x7fa8b80acf10 legacy=0x7fa8b81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.769+0000 7fa8b7e00640 1 -- 172.21.15.6:0/2277157772 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b80ad760 con 0x7fa8b80afca0 2024-08-17T02:27:25.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.769+0000 7fa8b7400640 1 -- 172.21.15.6:0/2277157772 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448799552 0 0) 0x7fa8b80c92b0 con 0x7fa8b80acf10 2024-08-17T02:27:25.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.770+0000 7fa8b7e00640 1 --2- 172.21.15.6:0/2277157772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b80afca0 0x7fa8b80b0070 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009850 tx=0x7fa8a80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2248c57b2617ad05 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.771+0000 7fa8b7400640 1 -- 172.21.15.6:0/2277157772 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a802ae20 con 0x7fa8b80afca0 2024-08-17T02:27:25.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.771+0000 7fa8b7400640 1 -- 172.21.15.6:0/2277157772 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a8032440 con 0x7fa8b80afca0 2024-08-17T02:27:25.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.771+0000 7fa8b7400640 1 -- 172.21.15.6:0/2277157772 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80327e0 con 0x7fa8b80afca0 2024-08-17T02:27:25.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.771+0000 7fa8bee00640 1 -- 172.21.15.6:0/2277157772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b80afca0 msgr2=0x7fa8b80b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.771+0000 7fa8bee00640 1 --2- 172.21.15.6:0/2277157772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b80afca0 0x7fa8b80b0070 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009850 tx=0x7fa8a80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.771+0000 7fa8bee00640 1 -- 172.21.15.6:0/2277157772 shutdown_connections 2024-08-17T02:27:25.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.771+0000 7fa8bee00640 1 --2- 172.21.15.6:0/2277157772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b80afca0 0x7fa8b80b0070 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.771+0000 7fa8bee00640 1 -- 172.21.15.6:0/2277157772 >> 172.21.15.6:0/2277157772 conn(0x7fa8b8066e60 msgr2=0x7fa8b8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.771+0000 7fa8bee00640 1 -- 172.21.15.6:0/2277157772 shutdown_connections 2024-08-17T02:27:25.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.771+0000 7fa8bee00640 1 -- 172.21.15.6:0/2277157772 wait complete. 2024-08-17T02:27:25.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.773+0000 7fa8bee00640 1 Processor -- start 2024-08-17T02:27:25.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.773+0000 7fa8bee00640 1 -- start start 2024-08-17T02:27:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.774+0000 7fa8bee00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa8b80acf10 0x7fa8b814b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.774+0000 7fa8bee00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa8b80afca0 0x7fa8b8157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.774+0000 7fa8bee00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b81590b0 0x7fa8b8157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.774+0000 7fa8bee00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b81502f0 con 0x7fa8b81590b0 2024-08-17T02:27:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.774+0000 7fa8bee00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b8151610 con 0x7fa8b80afca0 2024-08-17T02:27:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.774+0000 7fa8bee00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b8150570 con 0x7fa8b80acf10 2024-08-17T02:27:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.774+0000 7fa8bce00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b81590b0 0x7fa8b8157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.774+0000 7fa8bce00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b81590b0 0x7fa8b8157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41122/0 (socket says 172.21.15.6:41122) 2024-08-17T02:27:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.774+0000 7fa8bce00640 1 -- 172.21.15.6:0/3102965251 learned_addr learned my addr 172.21.15.6:0/3102965251 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.774+0000 7fa8af400640 1 --2- 172.21.15.6:0/3102965251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa8b80afca0 0x7fa8b8157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.774+0000 7fa8b7e00640 1 --2- 172.21.15.6:0/3102965251 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa8b80acf10 0x7fa8b814b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.774+0000 7fa8bce00640 1 -- 172.21.15.6:0/3102965251 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa8b80acf10 msgr2=0x7fa8b814b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.774+0000 7fa8bce00640 1 --2- 172.21.15.6:0/3102965251 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa8b80acf10 0x7fa8b814b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.774+0000 7fa8bce00640 1 -- 172.21.15.6:0/3102965251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa8b80afca0 msgr2=0x7fa8b8157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.774+0000 7fa8bce00640 1 --2- 172.21.15.6:0/3102965251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa8b80afca0 0x7fa8b8157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.774+0000 7fa8bce00640 1 -- 172.21.15.6:0/3102965251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a8009390 con 0x7fa8b81590b0 2024-08-17T02:27:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.775+0000 7fa8b7e00640 1 --2- 172.21.15.6:0/3102965251 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa8b80acf10 0x7fa8b814b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.775+0000 7fa8af400640 1 --2- 172.21.15.6:0/3102965251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa8b80afca0 0x7fa8b8157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.775+0000 7fa8bce00640 1 --2- 172.21.15.6:0/3102965251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b81590b0 0x7fa8b8157c90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000c7c0 tx=0x7fa8b00015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.775+0000 7fa8afe00640 1 -- 172.21.15.6:0/3102965251 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b000a640 con 0x7fa8b81590b0 2024-08-17T02:27:25.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.775+0000 7fa8afe00640 1 -- 172.21.15.6:0/3102965251 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b000a7c0 con 0x7fa8b81590b0 2024-08-17T02:27:25.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.775+0000 7fa8bee00640 1 -- 172.21.15.6:0/3102965251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b8150850 con 0x7fa8b81590b0 2024-08-17T02:27:25.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.775+0000 7fa8afe00640 1 -- 172.21.15.6:0/3102965251 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b000ab80 con 0x7fa8b81590b0 2024-08-17T02:27:25.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.775+0000 7fa8bee00640 1 -- 172.21.15.6:0/3102965251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b8150e10 con 0x7fa8b81590b0 2024-08-17T02:27:25.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.776+0000 7fa8bee00640 1 -- 172.21.15.6:0/3102965251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b8063fb0 con 0x7fa8b81590b0 2024-08-17T02:27:25.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.777+0000 7fa8afe00640 1 -- 172.21.15.6:0/3102965251 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa8b0012420 con 0x7fa8b81590b0 2024-08-17T02:27:25.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.778+0000 7fa8afe00640 1 --2- 172.21.15.6:0/3102965251 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa894065150 0x7fa894067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.778+0000 7fa8afe00640 1 -- 172.21.15.6:0/3102965251 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa8b00826f0 con 0x7fa8b81590b0 2024-08-17T02:27:25.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.778+0000 7fa8b7e00640 1 --2- 172.21.15.6:0/3102965251 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa894065150 0x7fa894067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.779+0000 7fa8b7e00640 1 --2- 172.21.15.6:0/3102965251 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa894065150 0x7fa894067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8034000 tx=0x7fa8a8032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.782+0000 7fa8afe00640 1 -- 172.21.15.6:0/3102965251 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa8b0050710 con 0x7fa8b81590b0 2024-08-17T02:27:25.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.961+0000 7fa8bee00640 1 -- 172.21.15.6:0/3102965251 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8b8067b70 con 0x7fa894065150 2024-08-17T02:27:25.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.970+0000 7fa8afe00640 1 -- 172.21.15.6:0/3102965251 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+267775 (secure 0 0 0) 0x7fa8b8067b70 con 0x7fa894065150 2024-08-17T02:27:25.974 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:25.975 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-08-17T02:27:25.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.974+0000 7fa8bee00640 1 -- 172.21.15.6:0/3102965251 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa894065150 msgr2=0x7fa894067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.974+0000 7fa8bee00640 1 --2- 172.21.15.6:0/3102965251 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa894065150 0x7fa894067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8034000 tx=0x7fa8a8032000 comp rx=0 tx=0).stop 2024-08-17T02:27:25.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.974+0000 7fa8bee00640 1 -- 172.21.15.6:0/3102965251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b81590b0 msgr2=0x7fa8b8157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.974+0000 7fa8bee00640 1 --2- 172.21.15.6:0/3102965251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b81590b0 0x7fa8b8157c90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000c7c0 tx=0x7fa8b00015b0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.974+0000 7fa8bee00640 1 -- 172.21.15.6:0/3102965251 shutdown_connections 2024-08-17T02:27:25.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.974+0000 7fa8bee00640 1 --2- 172.21.15.6:0/3102965251 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa894065150 0x7fa894067600 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.974+0000 7fa8bee00640 1 --2- 172.21.15.6:0/3102965251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b81590b0 0x7fa8b8157c90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.974+0000 7fa8bee00640 1 --2- 172.21.15.6:0/3102965251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa8b80afca0 0x7fa8b8157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.974+0000 7fa8bee00640 1 --2- 172.21.15.6:0/3102965251 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa8b80acf10 0x7fa8b814b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.974+0000 7fa8bee00640 1 -- 172.21.15.6:0/3102965251 >> 172.21.15.6:0/3102965251 conn(0x7fa8b8066e60 msgr2=0x7fa8b80698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.974+0000 7fa8bee00640 1 -- 172.21.15.6:0/3102965251 shutdown_connections 2024-08-17T02:27:25.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:25.974+0000 7fa8bee00640 1 -- 172.21.15.6:0/3102965251 wait complete. 2024-08-17T02:27:25.989 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-08-17T02:27:25.420539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382904,"kb_used_data":4040,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752591816,"statfs":{"total":773094113280,"available":770654019584,"internally_reserved":0,"allocated":4136960,"data_stored":2292396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.643993"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.818827+0000","last_change":"2024-08-17T02:27:21.811136+0000","last_active":"2024-08-17T02:27:21.818827+0000","last_peered":"2024-08-17T02:27:21.818827+0000","last_clean":"2024-08-17T02:27:21.818827+0000","last_became_active":"2024-08-17T02:27:21.810826+0000","last_became_peered":"2024-08-17T02:27:21.810826+0000","last_unstale":"2024-08-17T02:27:21.818827+0000","last_undegraded":"2024-08-17T02:27:21.818827+0000","last_fullsized":"2024-08-17T02:27:21.818827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:20:30.360210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.807184+0000","last_change":"2024-08-17T02:27:21.805370+0000","last_active":"2024-08-17T02:27:21.807184+0000","last_peered":"2024-08-17T02:27:21.807184+0000","last_clean":"2024-08-17T02:27:21.807184+0000","last_became_active":"2024-08-17T02:27:21.804560+0000","last_became_peered":"2024-08-17T02:27:21.804560+0000","last_unstale":"2024-08-17T02:27:21.807184+0000","last_undegraded":"2024-08-17T02:27:21.807184+0000","last_fullsized":"2024-08-17T02:27:21.807184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:23:11.251565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834414+0000","last_change":"2024-08-17T02:27:21.830035+0000","last_active":"2024-08-17T02:27:21.834414+0000","last_peered":"2024-08-17T02:27:21.834414+0000","last_clean":"2024-08-17T02:27:21.834414+0000","last_became_active":"2024-08-17T02:27:21.829752+0000","last_became_peered":"2024-08-17T02:27:21.829752+0000","last_unstale":"2024-08-17T02:27:21.834414+0000","last_undegraded":"2024-08-17T02:27:21.834414+0000","last_fullsized":"2024-08-17T02:27:21.834414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:42.139955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834238+0000","last_change":"2024-08-17T02:27:21.829806+0000","last_active":"2024-08-17T02:27:21.834238+0000","last_peered":"2024-08-17T02:27:21.834238+0000","last_clean":"2024-08-17T02:27:21.834238+0000","last_became_active":"2024-08-17T02:27:21.829561+0000","last_became_peered":"2024-08-17T02:27:21.829561+0000","last_unstale":"2024-08-17T02:27:21.834238+0000","last_undegraded":"2024-08-17T02:27:21.834238+0000","last_fullsized":"2024-08-17T02:27:21.834238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:00.821559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.816656+0000","last_change":"2024-08-17T02:27:21.806525+0000","last_active":"2024-08-17T02:27:21.816656+0000","last_peered":"2024-08-17T02:27:21.816656+0000","last_clean":"2024-08-17T02:27:21.816656+0000","last_became_active":"2024-08-17T02:27:21.806280+0000","last_became_peered":"2024-08-17T02:27:21.806280+0000","last_unstale":"2024-08-17T02:27:21.816656+0000","last_undegraded":"2024-08-17T02:27:21.816656+0000","last_fullsized":"2024-08-17T02:27:21.816656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:22:27.234568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.806370+0000","last_change":"2024-08-17T02:27:21.802156+0000","last_active":"2024-08-17T02:27:21.806370+0000","last_peered":"2024-08-17T02:27:21.806370+0000","last_clean":"2024-08-17T02:27:21.806370+0000","last_became_active":"2024-08-17T02:27:21.801856+0000","last_became_peered":"2024-08-17T02:27:21.801856+0000","last_unstale":"2024-08-17T02:27:21.806370+0000","last_undegraded":"2024-08-17T02:27:21.806370+0000","last_fullsized":"2024-08-17T02:27:21.806370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:38:13.150669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834629+0000","last_change":"2024-08-17T02:27:21.827113+0000","last_active":"2024-08-17T02:27:21.834629+0000","last_peered":"2024-08-17T02:27:21.834629+0000","last_clean":"2024-08-17T02:27:21.834629+0000","last_became_active":"2024-08-17T02:27:21.826187+0000","last_became_peered":"2024-08-17T02:27:21.826187+0000","last_unstale":"2024-08-17T02:27:21.834629+0000","last_undegraded":"2024-08-17T02:27:21.834629+0000","last_fullsized":"2024-08-17T02:27:21.834629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:07.015453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834594+0000","last_change":"2024-08-17T02:27:21.826604+0000","last_active":"2024-08-17T02:27:21.834594+0000","last_peered":"2024-08-17T02:27:21.834594+0000","last_clean":"2024-08-17T02:27:21.834594+0000","last_became_active":"2024-08-17T02:27:21.822003+0000","last_became_peered":"2024-08-17T02:27:21.822003+0000","last_unstale":"2024-08-17T02:27:21.834594+0000","last_undegraded":"2024-08-17T02:27:21.834594+0000","last_fullsized":"2024-08-17T02:27:21.834594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:19.609640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.830277+0000","last_change":"2024-08-17T02:27:21.825332+0000","last_active":"2024-08-17T02:27:21.830277+0000","last_peered":"2024-08-17T02:27:21.830277+0000","last_clean":"2024-08-17T02:27:21.830277+0000","last_became_active":"2024-08-17T02:27:21.824903+0000","last_became_peered":"2024-08-17T02:27:21.824903+0000","last_unstale":"2024-08-17T02:27:21.830277+0000","last_undegraded":"2024-08-17T02:27:21.830277+0000","last_fullsized":"2024-08-17T02:27:21.830277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:59.409218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.832080+0000","last_change":"2024-08-17T02:27:21.824554+0000","last_active":"2024-08-17T02:27:21.832080+0000","last_peered":"2024-08-17T02:27:21.832080+0000","last_clean":"2024-08-17T02:27:21.832080+0000","last_became_active":"2024-08-17T02:27:21.823985+0000","last_became_peered":"2024-08-17T02:27:21.823985+0000","last_unstale":"2024-08-17T02:27:21.832080+0000","last_undegraded":"2024-08-17T02:27:21.832080+0000","last_fullsized":"2024-08-17T02:27:21.832080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:14:55.984318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834759+0000","last_change":"2024-08-17T02:27:21.830940+0000","last_active":"2024-08-17T02:27:21.834759+0000","last_peered":"2024-08-17T02:27:21.834759+0000","last_clean":"2024-08-17T02:27:21.834759+0000","last_became_active":"2024-08-17T02:27:21.830658+0000","last_became_peered":"2024-08-17T02:27:21.830658+0000","last_unstale":"2024-08-17T02:27:21.834759+0000","last_undegraded":"2024-08-17T02:27:21.834759+0000","last_fullsized":"2024-08-17T02:27:21.834759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:38:13.150669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.815316+0000","last_change":"2024-08-17T02:27:21.811682+0000","last_active":"2024-08-17T02:27:21.815316+0000","last_peered":"2024-08-17T02:27:21.815316+0000","last_clean":"2024-08-17T02:27:21.815316+0000","last_became_active":"2024-08-17T02:27:21.810822+0000","last_became_peered":"2024-08-17T02:27:21.810822+0000","last_unstale":"2024-08-17T02:27:21.815316+0000","last_undegraded":"2024-08-17T02:27:21.815316+0000","last_fullsized":"2024-08-17T02:27:21.815316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:36:49.607977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.819545+0000","last_change":"2024-08-17T02:27:21.811896+0000","last_active":"2024-08-17T02:27:21.819545+0000","last_peered":"2024-08-17T02:27:21.819545+0000","last_clean":"2024-08-17T02:27:21.819545+0000","last_became_active":"2024-08-17T02:27:21.811562+0000","last_became_peered":"2024-08-17T02:27:21.811562+0000","last_unstale":"2024-08-17T02:27:21.819545+0000","last_undegraded":"2024-08-17T02:27:21.819545+0000","last_fullsized":"2024-08-17T02:27:21.819545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:03.284079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.818500+0000","last_change":"2024-08-17T02:27:21.810689+0000","last_active":"2024-08-17T02:27:21.818500+0000","last_peered":"2024-08-17T02:27:21.818500+0000","last_clean":"2024-08-17T02:27:21.818500+0000","last_became_active":"2024-08-17T02:27:21.810451+0000","last_became_peered":"2024-08-17T02:27:21.810451+0000","last_unstale":"2024-08-17T02:27:21.818500+0000","last_undegraded":"2024-08-17T02:27:21.818500+0000","last_fullsized":"2024-08-17T02:27:21.818500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:09:53.711158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.815162+0000","last_change":"2024-08-17T02:27:21.806168+0000","last_active":"2024-08-17T02:27:21.815162+0000","last_peered":"2024-08-17T02:27:21.815162+0000","last_clean":"2024-08-17T02:27:21.815162+0000","last_became_active":"2024-08-17T02:27:21.805845+0000","last_became_peered":"2024-08-17T02:27:21.805845+0000","last_unstale":"2024-08-17T02:27:21.815162+0000","last_undegraded":"2024-08-17T02:27:21.815162+0000","last_fullsized":"2024-08-17T02:27:21.815162+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:00.821559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834702+0000","last_change":"2024-08-17T02:27:21.830637+0000","last_active":"2024-08-17T02:27:21.834702+0000","last_peered":"2024-08-17T02:27:21.834702+0000","last_clean":"2024-08-17T02:27:21.834702+0000","last_became_active":"2024-08-17T02:27:21.829106+0000","last_became_peered":"2024-08-17T02:27:21.829106+0000","last_unstale":"2024-08-17T02:27:21.834702+0000","last_undegraded":"2024-08-17T02:27:21.834702+0000","last_fullsized":"2024-08-17T02:27:21.834702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:42.139955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834507+0000","last_change":"2024-08-17T02:27:21.822193+0000","last_active":"2024-08-17T02:27:21.834507+0000","last_peered":"2024-08-17T02:27:21.834507+0000","last_clean":"2024-08-17T02:27:21.834507+0000","last_became_active":"2024-08-17T02:27:21.821938+0000","last_became_peered":"2024-08-17T02:27:21.821938+0000","last_unstale":"2024-08-17T02:27:21.834507+0000","last_undegraded":"2024-08-17T02:27:21.834507+0000","last_fullsized":"2024-08-17T02:27:21.834507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:06:54.181385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.832886+0000","last_change":"2024-08-17T02:27:21.830508+0000","last_active":"2024-08-17T02:27:21.832886+0000","last_peered":"2024-08-17T02:27:21.832886+0000","last_clean":"2024-08-17T02:27:21.832886+0000","last_became_active":"2024-08-17T02:27:21.825634+0000","last_became_peered":"2024-08-17T02:27:21.825634+0000","last_unstale":"2024-08-17T02:27:21.832886+0000","last_undegraded":"2024-08-17T02:27:21.832886+0000","last_fullsized":"2024-08-17T02:27:21.832886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:19.609640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.832954+0000","last_change":"2024-08-17T02:27:21.831274+0000","last_active":"2024-08-17T02:27:21.832954+0000","last_peered":"2024-08-17T02:27:21.832954+0000","last_clean":"2024-08-17T02:27:21.832954+0000","last_became_active":"2024-08-17T02:27:21.830923+0000","last_became_peered":"2024-08-17T02:27:21.830923+0000","last_unstale":"2024-08-17T02:27:21.832954+0000","last_undegraded":"2024-08-17T02:27:21.832954+0000","last_fullsized":"2024-08-17T02:27:21.832954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:51.514747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.818826+0000","last_change":"2024-08-17T02:27:21.803519+0000","last_active":"2024-08-17T02:27:21.818826+0000","last_peered":"2024-08-17T02:27:21.818826+0000","last_clean":"2024-08-17T02:27:21.818826+0000","last_became_active":"2024-08-17T02:27:21.803212+0000","last_became_peered":"2024-08-17T02:27:21.803212+0000","last_unstale":"2024-08-17T02:27:21.818826+0000","last_undegraded":"2024-08-17T02:27:21.818826+0000","last_fullsized":"2024-08-17T02:27:21.818826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:03:54.877074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.823829+0000","last_change":"2024-08-17T02:27:21.813248+0000","last_active":"2024-08-17T02:27:21.823829+0000","last_peered":"2024-08-17T02:27:21.823829+0000","last_clean":"2024-08-17T02:27:21.823829+0000","last_became_active":"2024-08-17T02:27:21.812939+0000","last_became_peered":"2024-08-17T02:27:21.812939+0000","last_unstale":"2024-08-17T02:27:21.823829+0000","last_undegraded":"2024-08-17T02:27:21.823829+0000","last_fullsized":"2024-08-17T02:27:21.823829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:17:19.823110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.824477+0000","last_change":"2024-08-17T02:27:21.818256+0000","last_active":"2024-08-17T02:27:21.824477+0000","last_peered":"2024-08-17T02:27:21.824477+0000","last_clean":"2024-08-17T02:27:21.824477+0000","last_became_active":"2024-08-17T02:27:21.815316+0000","last_became_peered":"2024-08-17T02:27:21.815316+0000","last_unstale":"2024-08-17T02:27:21.824477+0000","last_undegraded":"2024-08-17T02:27:21.824477+0000","last_fullsized":"2024-08-17T02:27:21.824477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:46:12.597353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.819017+0000","last_change":"2024-08-17T02:27:21.814369+0000","last_active":"2024-08-17T02:27:21.819017+0000","last_peered":"2024-08-17T02:27:21.819017+0000","last_clean":"2024-08-17T02:27:21.819017+0000","last_became_active":"2024-08-17T02:27:21.812301+0000","last_became_peered":"2024-08-17T02:27:21.812301+0000","last_unstale":"2024-08-17T02:27:21.819017+0000","last_undegraded":"2024-08-17T02:27:21.819017+0000","last_fullsized":"2024-08-17T02:27:21.819017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:23.390289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.815526+0000","last_change":"2024-08-17T02:27:21.809845+0000","last_active":"2024-08-17T02:27:21.815526+0000","last_peered":"2024-08-17T02:27:21.815526+0000","last_clean":"2024-08-17T02:27:21.815526+0000","last_became_active":"2024-08-17T02:27:21.809570+0000","last_became_peered":"2024-08-17T02:27:21.809570+0000","last_unstale":"2024-08-17T02:27:21.815526+0000","last_undegraded":"2024-08-17T02:27:21.815526+0000","last_fullsized":"2024-08-17T02:27:21.815526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:39:43.173489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.830686+0000","last_change":"2024-08-17T02:27:21.823957+0000","last_active":"2024-08-17T02:27:21.830686+0000","last_peered":"2024-08-17T02:27:21.830686+0000","last_clean":"2024-08-17T02:27:21.830686+0000","last_became_active":"2024-08-17T02:27:21.822192+0000","last_became_peered":"2024-08-17T02:27:21.822192+0000","last_unstale":"2024-08-17T02:27:21.830686+0000","last_undegraded":"2024-08-17T02:27:21.830686+0000","last_fullsized":"2024-08-17T02:27:21.830686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:46:12.597353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.823103+0000","last_change":"2024-08-17T02:27:21.818215+0000","last_active":"2024-08-17T02:27:21.823103+0000","last_peered":"2024-08-17T02:27:21.823103+0000","last_clean":"2024-08-17T02:27:21.823103+0000","last_became_active":"2024-08-17T02:27:21.817926+0000","last_became_peered":"2024-08-17T02:27:21.817926+0000","last_unstale":"2024-08-17T02:27:21.823103+0000","last_undegraded":"2024-08-17T02:27:21.823103+0000","last_fullsized":"2024-08-17T02:27:21.823103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:06:54.181385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.830535+0000","last_change":"2024-08-17T02:27:21.822475+0000","last_active":"2024-08-17T02:27:21.830535+0000","last_peered":"2024-08-17T02:27:21.830535+0000","last_clean":"2024-08-17T02:27:21.830535+0000","last_became_active":"2024-08-17T02:27:21.822229+0000","last_became_peered":"2024-08-17T02:27:21.822229+0000","last_unstale":"2024-08-17T02:27:21.830535+0000","last_undegraded":"2024-08-17T02:27:21.830535+0000","last_fullsized":"2024-08-17T02:27:21.830535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:17:19.823110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.815296+0000","last_change":"2024-08-17T02:27:21.807724+0000","last_active":"2024-08-17T02:27:21.815296+0000","last_peered":"2024-08-17T02:27:21.815296+0000","last_clean":"2024-08-17T02:27:21.815296+0000","last_became_active":"2024-08-17T02:27:21.805970+0000","last_became_peered":"2024-08-17T02:27:21.805970+0000","last_unstale":"2024-08-17T02:27:21.815296+0000","last_undegraded":"2024-08-17T02:27:21.815296+0000","last_fullsized":"2024-08-17T02:27:21.815296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:06:54.181385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.823805+0000","last_change":"2024-08-17T02:27:21.812729+0000","last_active":"2024-08-17T02:27:21.823805+0000","last_peered":"2024-08-17T02:27:21.823805+0000","last_clean":"2024-08-17T02:27:21.823805+0000","last_became_active":"2024-08-17T02:27:21.812201+0000","last_became_peered":"2024-08-17T02:27:21.812201+0000","last_unstale":"2024-08-17T02:27:21.823805+0000","last_undegraded":"2024-08-17T02:27:21.823805+0000","last_fullsized":"2024-08-17T02:27:21.823805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:29.077064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.831426+0000","last_change":"2024-08-17T02:27:21.818177+0000","last_active":"2024-08-17T02:27:21.831426+0000","last_peered":"2024-08-17T02:27:21.831426+0000","last_clean":"2024-08-17T02:27:21.831426+0000","last_became_active":"2024-08-17T02:27:21.817924+0000","last_became_peered":"2024-08-17T02:27:21.817924+0000","last_unstale":"2024-08-17T02:27:21.831426+0000","last_undegraded":"2024-08-17T02:27:21.831426+0000","last_fullsized":"2024-08-17T02:27:21.831426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:19.145353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.818679+0000","last_change":"2024-08-17T02:27:21.813907+0000","last_active":"2024-08-17T02:27:21.818679+0000","last_peered":"2024-08-17T02:27:21.818679+0000","last_clean":"2024-08-17T02:27:21.818679+0000","last_became_active":"2024-08-17T02:27:21.813464+0000","last_became_peered":"2024-08-17T02:27:21.813464+0000","last_unstale":"2024-08-17T02:27:21.818679+0000","last_undegraded":"2024-08-17T02:27:21.818679+0000","last_fullsized":"2024-08-17T02:27:21.818679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:13:02.312015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834645+0000","last_change":"2024-08-17T02:27:21.827202+0000","last_active":"2024-08-17T02:27:21.834645+0000","last_peered":"2024-08-17T02:27:21.834645+0000","last_clean":"2024-08-17T02:27:21.834645+0000","last_became_active":"2024-08-17T02:27:21.826930+0000","last_became_peered":"2024-08-17T02:27:21.826930+0000","last_unstale":"2024-08-17T02:27:21.834645+0000","last_undegraded":"2024-08-17T02:27:21.834645+0000","last_fullsized":"2024-08-17T02:27:21.834645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:36:49.607977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.821535+0000","last_change":"2024-08-17T02:27:21.819085+0000","last_active":"2024-08-17T02:27:21.821535+0000","last_peered":"2024-08-17T02:27:21.821535+0000","last_clean":"2024-08-17T02:27:21.821535+0000","last_became_active":"2024-08-17T02:27:21.818776+0000","last_became_peered":"2024-08-17T02:27:21.818776+0000","last_unstale":"2024-08-17T02:27:21.821535+0000","last_undegraded":"2024-08-17T02:27:21.821535+0000","last_fullsized":"2024-08-17T02:27:21.821535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:13:02.312015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.824037+0000","last_change":"2024-08-17T02:27:20.805781+0000","last_active":"2024-08-17T02:27:21.824037+0000","last_peered":"2024-08-17T02:27:21.824037+0000","last_clean":"2024-08-17T02:27:21.824037+0000","last_became_active":"2024-08-17T02:27:20.805522+0000","last_became_peered":"2024-08-17T02:27:20.805522+0000","last_unstale":"2024-08-17T02:27:21.824037+0000","last_undegraded":"2024-08-17T02:27:21.824037+0000","last_fullsized":"2024-08-17T02:27:21.824037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:09.295691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.822981+0000","last_change":"2024-08-17T02:27:21.821303+0000","last_active":"2024-08-17T02:27:21.822981+0000","last_peered":"2024-08-17T02:27:21.822981+0000","last_clean":"2024-08-17T02:27:21.822981+0000","last_became_active":"2024-08-17T02:27:21.821015+0000","last_became_peered":"2024-08-17T02:27:21.821015+0000","last_unstale":"2024-08-17T02:27:21.822981+0000","last_undegraded":"2024-08-17T02:27:21.822981+0000","last_fullsized":"2024-08-17T02:27:21.822981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:38:58.195987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.831579+0000","last_change":"2024-08-17T02:27:20.800488+0000","last_active":"2024-08-17T02:27:21.831579+0000","last_peered":"2024-08-17T02:27:21.831579+0000","last_clean":"2024-08-17T02:27:21.831579+0000","last_became_active":"2024-08-17T02:27:20.800198+0000","last_became_peered":"2024-08-17T02:27:20.800198+0000","last_unstale":"2024-08-17T02:27:21.831579+0000","last_undegraded":"2024-08-17T02:27:21.831579+0000","last_fullsized":"2024-08-17T02:27:21.831579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:50.037093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.824262+0000","last_change":"2024-08-17T02:27:21.819311+0000","last_active":"2024-08-17T02:27:21.824262+0000","last_peered":"2024-08-17T02:27:21.824262+0000","last_clean":"2024-08-17T02:27:21.824262+0000","last_became_active":"2024-08-17T02:27:21.814746+0000","last_became_peered":"2024-08-17T02:27:21.814746+0000","last_unstale":"2024-08-17T02:27:21.824262+0000","last_undegraded":"2024-08-17T02:27:21.824262+0000","last_fullsized":"2024-08-17T02:27:21.824262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:00.821559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.831615+0000","last_change":"2024-08-17T02:27:20.797356+0000","last_active":"2024-08-17T02:27:21.831615+0000","last_peered":"2024-08-17T02:27:21.831615+0000","last_clean":"2024-08-17T02:27:21.831615+0000","last_became_active":"2024-08-17T02:27:20.797106+0000","last_became_peered":"2024-08-17T02:27:20.797106+0000","last_unstale":"2024-08-17T02:27:21.831615+0000","last_undegraded":"2024-08-17T02:27:21.831615+0000","last_fullsized":"2024-08-17T02:27:21.831615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:13:01.304125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834074+0000","last_change":"2024-08-17T02:27:21.828951+0000","last_active":"2024-08-17T02:27:21.834074+0000","last_peered":"2024-08-17T02:27:21.834074+0000","last_clean":"2024-08-17T02:27:21.834074+0000","last_became_active":"2024-08-17T02:27:21.825836+0000","last_became_peered":"2024-08-17T02:27:21.825836+0000","last_unstale":"2024-08-17T02:27:21.834074+0000","last_undegraded":"2024-08-17T02:27:21.834074+0000","last_fullsized":"2024-08-17T02:27:21.834074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:59.409218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834646+0000","last_change":"2024-08-17T02:27:20.798788+0000","last_active":"2024-08-17T02:27:21.834646+0000","last_peered":"2024-08-17T02:27:21.834646+0000","last_clean":"2024-08-17T02:27:21.834646+0000","last_became_active":"2024-08-17T02:27:20.797728+0000","last_became_peered":"2024-08-17T02:27:20.797728+0000","last_unstale":"2024-08-17T02:27:21.834646+0000","last_undegraded":"2024-08-17T02:27:21.834646+0000","last_fullsized":"2024-08-17T02:27:21.834646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:16.342786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834634+0000","last_change":"2024-08-17T02:27:21.827019+0000","last_active":"2024-08-17T02:27:21.834634+0000","last_peered":"2024-08-17T02:27:21.834634+0000","last_clean":"2024-08-17T02:27:21.834634+0000","last_became_active":"2024-08-17T02:27:21.826072+0000","last_became_peered":"2024-08-17T02:27:21.826072+0000","last_unstale":"2024-08-17T02:27:21.834634+0000","last_undegraded":"2024-08-17T02:27:21.834634+0000","last_fullsized":"2024-08-17T02:27:21.834634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:39:43.173489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.830931+0000","last_change":"2024-08-17T02:27:20.802861+0000","last_active":"2024-08-17T02:27:21.830931+0000","last_peered":"2024-08-17T02:27:21.830931+0000","last_clean":"2024-08-17T02:27:21.830931+0000","last_became_active":"2024-08-17T02:27:20.802621+0000","last_became_peered":"2024-08-17T02:27:20.802621+0000","last_unstale":"2024-08-17T02:27:21.830931+0000","last_undegraded":"2024-08-17T02:27:21.830931+0000","last_fullsized":"2024-08-17T02:27:21.830931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:22:26.226678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.816180+0000","last_change":"2024-08-17T02:27:21.812248+0000","last_active":"2024-08-17T02:27:21.816180+0000","last_peered":"2024-08-17T02:27:21.816180+0000","last_clean":"2024-08-17T02:27:21.816180+0000","last_became_active":"2024-08-17T02:27:21.811996+0000","last_became_peered":"2024-08-17T02:27:21.811996+0000","last_unstale":"2024-08-17T02:27:21.816180+0000","last_undegraded":"2024-08-17T02:27:21.816180+0000","last_fullsized":"2024-08-17T02:27:21.816180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:21.513275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.830920+0000","last_change":"2024-08-17T02:27:20.802979+0000","last_active":"2024-08-17T02:27:21.830920+0000","last_peered":"2024-08-17T02:27:21.830920+0000","last_clean":"2024-08-17T02:27:21.830920+0000","last_became_active":"2024-08-17T02:27:20.802715+0000","last_became_peered":"2024-08-17T02:27:20.802715+0000","last_unstale":"2024-08-17T02:27:21.830920+0000","last_undegraded":"2024-08-17T02:27:21.830920+0000","last_fullsized":"2024-08-17T02:27:21.830920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:41.427901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.824309+0000","last_change":"2024-08-17T02:27:21.807975+0000","last_active":"2024-08-17T02:27:21.824309+0000","last_peered":"2024-08-17T02:27:21.824309+0000","last_clean":"2024-08-17T02:27:21.824309+0000","last_became_active":"2024-08-17T02:27:21.807298+0000","last_became_peered":"2024-08-17T02:27:21.807298+0000","last_unstale":"2024-08-17T02:27:21.824309+0000","last_undegraded":"2024-08-17T02:27:21.824309+0000","last_fullsized":"2024-08-17T02:27:21.824309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:31.309319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.793171+0000","last_change":"2024-08-17T02:27:20.791954+0000","last_active":"2024-08-17T02:27:21.793171+0000","last_peered":"2024-08-17T02:27:21.793171+0000","last_clean":"2024-08-17T02:27:21.793171+0000","last_became_active":"2024-08-17T02:27:20.791681+0000","last_became_peered":"2024-08-17T02:27:20.791681+0000","last_unstale":"2024-08-17T02:27:21.793171+0000","last_undegraded":"2024-08-17T02:27:21.793171+0000","last_fullsized":"2024-08-17T02:27:21.793171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:30.963557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.828359+0000","last_change":"2024-08-17T02:27:21.811614+0000","last_active":"2024-08-17T02:27:21.828359+0000","last_peered":"2024-08-17T02:27:21.828359+0000","last_clean":"2024-08-17T02:27:21.828359+0000","last_became_active":"2024-08-17T02:27:21.811356+0000","last_became_peered":"2024-08-17T02:27:21.811356+0000","last_unstale":"2024-08-17T02:27:21.828359+0000","last_undegraded":"2024-08-17T02:27:21.828359+0000","last_fullsized":"2024-08-17T02:27:21.828359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:07.015453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.797054+0000","last_change":"2024-08-17T02:27:20.797325+0000","last_active":"2024-08-17T02:27:21.797054+0000","last_peered":"2024-08-17T02:27:21.797054+0000","last_clean":"2024-08-17T02:27:21.797054+0000","last_became_active":"2024-08-17T02:27:20.797057+0000","last_became_peered":"2024-08-17T02:27:20.797057+0000","last_unstale":"2024-08-17T02:27:21.797054+0000","last_undegraded":"2024-08-17T02:27:21.797054+0000","last_fullsized":"2024-08-17T02:27:21.797054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:21.674458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.815967+0000","last_change":"2024-08-17T02:27:21.804661+0000","last_active":"2024-08-17T02:27:21.815967+0000","last_peered":"2024-08-17T02:27:21.815967+0000","last_clean":"2024-08-17T02:27:21.815967+0000","last_became_active":"2024-08-17T02:27:21.804379+0000","last_became_peered":"2024-08-17T02:27:21.804379+0000","last_unstale":"2024-08-17T02:27:21.815967+0000","last_undegraded":"2024-08-17T02:27:21.815967+0000","last_fullsized":"2024-08-17T02:27:21.815967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:07.015453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.793931+0000","last_change":"2024-08-17T02:27:20.797885+0000","last_active":"2024-08-17T02:27:21.793931+0000","last_peered":"2024-08-17T02:27:21.793931+0000","last_clean":"2024-08-17T02:27:21.793931+0000","last_became_active":"2024-08-17T02:27:20.797672+0000","last_became_peered":"2024-08-17T02:27:20.797672+0000","last_unstale":"2024-08-17T02:27:21.793931+0000","last_undegraded":"2024-08-17T02:27:21.793931+0000","last_fullsized":"2024-08-17T02:27:21.793931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:00:44.738835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.833000+0000","last_change":"2024-08-17T02:27:21.831408+0000","last_active":"2024-08-17T02:27:21.833000+0000","last_peered":"2024-08-17T02:27:21.833000+0000","last_clean":"2024-08-17T02:27:21.833000+0000","last_became_active":"2024-08-17T02:27:21.831184+0000","last_became_peered":"2024-08-17T02:27:21.831184+0000","last_unstale":"2024-08-17T02:27:21.833000+0000","last_undegraded":"2024-08-17T02:27:21.833000+0000","last_fullsized":"2024-08-17T02:27:21.833000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:13:43.709389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.799250+0000","last_change":"2024-08-17T02:27:20.808511+0000","last_active":"2024-08-17T02:27:21.799250+0000","last_peered":"2024-08-17T02:27:21.799250+0000","last_clean":"2024-08-17T02:27:21.799250+0000","last_became_active":"2024-08-17T02:27:20.808256+0000","last_became_peered":"2024-08-17T02:27:20.808256+0000","last_unstale":"2024-08-17T02:27:21.799250+0000","last_undegraded":"2024-08-17T02:27:21.799250+0000","last_fullsized":"2024-08-17T02:27:21.799250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:02.276190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.822879+0000","last_change":"2024-08-17T02:27:21.813150+0000","last_active":"2024-08-17T02:27:21.822879+0000","last_peered":"2024-08-17T02:27:21.822879+0000","last_clean":"2024-08-17T02:27:21.822879+0000","last_became_active":"2024-08-17T02:27:21.812828+0000","last_became_peered":"2024-08-17T02:27:21.812828+0000","last_unstale":"2024-08-17T02:27:21.822879+0000","last_undegraded":"2024-08-17T02:27:21.822879+0000","last_fullsized":"2024-08-17T02:27:21.822879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:42.139955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.835106+0000","last_change":"2024-08-17T02:27:20.801510+0000","last_active":"2024-08-17T02:27:21.835106+0000","last_peered":"2024-08-17T02:27:21.835106+0000","last_clean":"2024-08-17T02:27:21.835106+0000","last_became_active":"2024-08-17T02:27:20.801194+0000","last_became_peered":"2024-08-17T02:27:20.801194+0000","last_unstale":"2024-08-17T02:27:21.835106+0000","last_undegraded":"2024-08-17T02:27:21.835106+0000","last_fullsized":"2024-08-17T02:27:21.835106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:38:57.188098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834433+0000","last_change":"2024-08-17T02:27:21.830058+0000","last_active":"2024-08-17T02:27:21.834433+0000","last_peered":"2024-08-17T02:27:21.834433+0000","last_clean":"2024-08-17T02:27:21.834433+0000","last_became_active":"2024-08-17T02:27:21.829779+0000","last_became_peered":"2024-08-17T02:27:21.829779+0000","last_unstale":"2024-08-17T02:27:21.834433+0000","last_undegraded":"2024-08-17T02:27:21.834433+0000","last_fullsized":"2024-08-17T02:27:21.834433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:38:13.150669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.836841+0000","last_change":"2024-08-17T02:27:20.802218+0000","last_active":"2024-08-17T02:27:21.836841+0000","last_peered":"2024-08-17T02:27:21.836841+0000","last_clean":"2024-08-17T02:27:21.836841+0000","last_became_active":"2024-08-17T02:27:20.801962+0000","last_became_peered":"2024-08-17T02:27:20.801962+0000","last_unstale":"2024-08-17T02:27:21.836841+0000","last_undegraded":"2024-08-17T02:27:21.836841+0000","last_fullsized":"2024-08-17T02:27:21.836841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:20:29.352321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.830528+0000","last_change":"2024-08-17T02:27:21.820346+0000","last_active":"2024-08-17T02:27:21.830528+0000","last_peered":"2024-08-17T02:27:21.830528+0000","last_clean":"2024-08-17T02:27:21.830528+0000","last_became_active":"2024-08-17T02:27:21.820060+0000","last_became_peered":"2024-08-17T02:27:21.820060+0000","last_unstale":"2024-08-17T02:27:21.830528+0000","last_undegraded":"2024-08-17T02:27:21.830528+0000","last_fullsized":"2024-08-17T02:27:21.830528+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:21.513275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.832165+0000","last_change":"2024-08-17T02:27:20.796104+0000","last_active":"2024-08-17T02:27:21.832165+0000","last_peered":"2024-08-17T02:27:21.832165+0000","last_clean":"2024-08-17T02:27:21.832165+0000","last_became_active":"2024-08-17T02:27:20.795846+0000","last_became_peered":"2024-08-17T02:27:20.795846+0000","last_unstale":"2024-08-17T02:27:21.832165+0000","last_undegraded":"2024-08-17T02:27:21.832165+0000","last_fullsized":"2024-08-17T02:27:21.832165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:49.744867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.807116+0000","last_change":"2024-08-17T02:27:21.805170+0000","last_active":"2024-08-17T02:27:21.807116+0000","last_peered":"2024-08-17T02:27:21.807116+0000","last_clean":"2024-08-17T02:27:21.807116+0000","last_became_active":"2024-08-17T02:27:21.804909+0000","last_became_peered":"2024-08-17T02:27:21.804909+0000","last_unstale":"2024-08-17T02:27:21.807116+0000","last_undegraded":"2024-08-17T02:27:21.807116+0000","last_fullsized":"2024-08-17T02:27:21.807116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:36:33.357094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.804336+0000","last_change":"2024-08-17T02:27:20.804761+0000","last_active":"2024-08-17T02:27:21.804336+0000","last_peered":"2024-08-17T02:27:21.804336+0000","last_clean":"2024-08-17T02:27:21.804336+0000","last_became_active":"2024-08-17T02:27:20.804494+0000","last_became_peered":"2024-08-17T02:27:20.804494+0000","last_unstale":"2024-08-17T02:27:21.804336+0000","last_undegraded":"2024-08-17T02:27:21.804336+0000","last_fullsized":"2024-08-17T02:27:21.804336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:50.037093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834656+0000","last_change":"2024-08-17T02:27:21.827257+0000","last_active":"2024-08-17T02:27:21.834656+0000","last_peered":"2024-08-17T02:27:21.834656+0000","last_clean":"2024-08-17T02:27:21.834656+0000","last_became_active":"2024-08-17T02:27:21.826930+0000","last_became_peered":"2024-08-17T02:27:21.826930+0000","last_unstale":"2024-08-17T02:27:21.834656+0000","last_undegraded":"2024-08-17T02:27:21.834656+0000","last_fullsized":"2024-08-17T02:27:21.834656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:51.514747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.792575+0000","last_change":"2024-08-17T02:27:20.794736+0000","last_active":"2024-08-17T02:27:21.792575+0000","last_peered":"2024-08-17T02:27:21.792575+0000","last_clean":"2024-08-17T02:27:21.792575+0000","last_became_active":"2024-08-17T02:27:20.794063+0000","last_became_peered":"2024-08-17T02:27:20.794063+0000","last_unstale":"2024-08-17T02:27:21.792575+0000","last_undegraded":"2024-08-17T02:27:21.792575+0000","last_fullsized":"2024-08-17T02:27:21.792575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:38:57.188098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.819815+0000","last_change":"2024-08-17T02:27:21.816628+0000","last_active":"2024-08-17T02:27:21.819815+0000","last_peered":"2024-08-17T02:27:21.819815+0000","last_clean":"2024-08-17T02:27:21.819815+0000","last_became_active":"2024-08-17T02:27:21.816329+0000","last_became_peered":"2024-08-17T02:27:21.816329+0000","last_unstale":"2024-08-17T02:27:21.819815+0000","last_undegraded":"2024-08-17T02:27:21.819815+0000","last_fullsized":"2024-08-17T02:27:21.819815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:00:45.746724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.835244+0000","last_change":"2024-08-17T02:27:20.801402+0000","last_active":"2024-08-17T02:27:21.835244+0000","last_peered":"2024-08-17T02:27:21.835244+0000","last_clean":"2024-08-17T02:27:21.835244+0000","last_became_active":"2024-08-17T02:27:20.798120+0000","last_became_peered":"2024-08-17T02:27:20.798120+0000","last_unstale":"2024-08-17T02:27:21.835244+0000","last_undegraded":"2024-08-17T02:27:21.835244+0000","last_fullsized":"2024-08-17T02:27:21.835244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:22.382400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.831861+0000","last_change":"2024-08-17T02:27:21.825794+0000","last_active":"2024-08-17T02:27:21.831861+0000","last_peered":"2024-08-17T02:27:21.831861+0000","last_clean":"2024-08-17T02:27:21.831861+0000","last_became_active":"2024-08-17T02:27:21.821382+0000","last_became_peered":"2024-08-17T02:27:21.821382+0000","last_unstale":"2024-08-17T02:27:21.831861+0000","last_undegraded":"2024-08-17T02:27:21.831861+0000","last_fullsized":"2024-08-17T02:27:21.831861+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:41:05.227602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.828679+0000","last_change":"2024-08-17T02:27:20.803075+0000","last_active":"2024-08-17T02:27:21.828679+0000","last_peered":"2024-08-17T02:27:21.828679+0000","last_clean":"2024-08-17T02:27:21.828679+0000","last_became_active":"2024-08-17T02:27:20.802760+0000","last_became_peered":"2024-08-17T02:27:20.802760+0000","last_unstale":"2024-08-17T02:27:21.828679+0000","last_undegraded":"2024-08-17T02:27:21.828679+0000","last_fullsized":"2024-08-17T02:27:21.828679+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:02.276190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.820604+0000","last_change":"2024-08-17T02:27:21.816958+0000","last_active":"2024-08-17T02:27:21.820604+0000","last_peered":"2024-08-17T02:27:21.820604+0000","last_clean":"2024-08-17T02:27:21.820604+0000","last_became_active":"2024-08-17T02:27:21.816343+0000","last_became_peered":"2024-08-17T02:27:21.816343+0000","last_unstale":"2024-08-17T02:27:21.820604+0000","last_undegraded":"2024-08-17T02:27:21.820604+0000","last_fullsized":"2024-08-17T02:27:21.820604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:19.145353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.829506+0000","last_change":"2024-08-17T02:27:20.800209+0000","last_active":"2024-08-17T02:27:21.829506+0000","last_peered":"2024-08-17T02:27:21.829506+0000","last_clean":"2024-08-17T02:27:21.829506+0000","last_became_active":"2024-08-17T02:27:20.799907+0000","last_became_peered":"2024-08-17T02:27:20.799907+0000","last_unstale":"2024-08-17T02:27:21.829506+0000","last_undegraded":"2024-08-17T02:27:21.829506+0000","last_fullsized":"2024-08-17T02:27:21.829506+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:09.295691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834256+0000","last_change":"2024-08-17T02:27:21.830578+0000","last_active":"2024-08-17T02:27:21.834256+0000","last_peered":"2024-08-17T02:27:21.834256+0000","last_clean":"2024-08-17T02:27:21.834256+0000","last_became_active":"2024-08-17T02:27:21.830125+0000","last_became_peered":"2024-08-17T02:27:21.830125+0000","last_unstale":"2024-08-17T02:27:21.834256+0000","last_undegraded":"2024-08-17T02:27:21.834256+0000","last_fullsized":"2024-08-17T02:27:21.834256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:41:05.227602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.824993+0000","last_change":"2024-08-17T02:27:20.800306+0000","last_active":"2024-08-17T02:27:21.824993+0000","last_peered":"2024-08-17T02:27:21.824993+0000","last_clean":"2024-08-17T02:27:21.824993+0000","last_became_active":"2024-08-17T02:27:20.800024+0000","last_became_peered":"2024-08-17T02:27:20.800024+0000","last_unstale":"2024-08-17T02:27:21.824993+0000","last_undegraded":"2024-08-17T02:27:21.824993+0000","last_fullsized":"2024-08-17T02:27:21.824993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:09.415412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.824484+0000","last_change":"2024-08-17T02:27:21.821992+0000","last_active":"2024-08-17T02:27:21.824484+0000","last_peered":"2024-08-17T02:27:21.824484+0000","last_clean":"2024-08-17T02:27:21.824484+0000","last_became_active":"2024-08-17T02:27:21.815906+0000","last_became_peered":"2024-08-17T02:27:21.815906+0000","last_unstale":"2024-08-17T02:27:21.824484+0000","last_undegraded":"2024-08-17T02:27:21.824484+0000","last_fullsized":"2024-08-17T02:27:21.824484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:50.752756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.806216+0000","last_change":"2024-08-17T02:27:20.804253+0000","last_active":"2024-08-17T02:27:21.806216+0000","last_peered":"2024-08-17T02:27:21.806216+0000","last_clean":"2024-08-17T02:27:21.806216+0000","last_became_active":"2024-08-17T02:27:20.803327+0000","last_became_peered":"2024-08-17T02:27:20.803327+0000","last_unstale":"2024-08-17T02:27:21.806216+0000","last_undegraded":"2024-08-17T02:27:21.806216+0000","last_fullsized":"2024-08-17T02:27:21.806216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:50.230330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.823162+0000","last_change":"2024-08-17T02:27:21.821628+0000","last_active":"2024-08-17T02:27:21.823162+0000","last_peered":"2024-08-17T02:27:21.823162+0000","last_clean":"2024-08-17T02:27:21.823162+0000","last_became_active":"2024-08-17T02:27:21.821412+0000","last_became_peered":"2024-08-17T02:27:21.821412+0000","last_unstale":"2024-08-17T02:27:21.823162+0000","last_undegraded":"2024-08-17T02:27:21.823162+0000","last_fullsized":"2024-08-17T02:27:21.823162+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:10.303580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.829761+0000","last_change":"2024-08-17T02:27:20.806200+0000","last_active":"2024-08-17T02:27:21.829761+0000","last_peered":"2024-08-17T02:27:21.829761+0000","last_clean":"2024-08-17T02:27:21.829761+0000","last_became_active":"2024-08-17T02:27:20.805923+0000","last_became_peered":"2024-08-17T02:27:20.805923+0000","last_unstale":"2024-08-17T02:27:21.829761+0000","last_undegraded":"2024-08-17T02:27:21.829761+0000","last_fullsized":"2024-08-17T02:27:21.829761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:03:53.869185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.822394+0000","last_change":"2024-08-17T02:27:21.819243+0000","last_active":"2024-08-17T02:27:21.822394+0000","last_peered":"2024-08-17T02:27:21.822394+0000","last_clean":"2024-08-17T02:27:21.822394+0000","last_became_active":"2024-08-17T02:27:21.811653+0000","last_became_peered":"2024-08-17T02:27:21.811653+0000","last_unstale":"2024-08-17T02:27:21.822394+0000","last_undegraded":"2024-08-17T02:27:21.822394+0000","last_fullsized":"2024-08-17T02:27:21.822394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:10.423301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.799145+0000","last_change":"2024-08-17T02:27:20.808867+0000","last_active":"2024-08-17T02:27:21.799145+0000","last_peered":"2024-08-17T02:27:21.799145+0000","last_clean":"2024-08-17T02:27:21.799145+0000","last_became_active":"2024-08-17T02:27:20.808636+0000","last_became_peered":"2024-08-17T02:27:20.808636+0000","last_unstale":"2024-08-17T02:27:21.799145+0000","last_undegraded":"2024-08-17T02:27:21.799145+0000","last_fullsized":"2024-08-17T02:27:21.799145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:21.674458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.821337+0000","last_change":"2024-08-17T02:27:21.804922+0000","last_active":"2024-08-17T02:27:21.821337+0000","last_peered":"2024-08-17T02:27:21.821337+0000","last_clean":"2024-08-17T02:27:21.821337+0000","last_became_active":"2024-08-17T02:27:21.804650+0000","last_became_peered":"2024-08-17T02:27:21.804650+0000","last_unstale":"2024-08-17T02:27:21.821337+0000","last_undegraded":"2024-08-17T02:27:21.821337+0000","last_fullsized":"2024-08-17T02:27:21.821337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:22.682347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.802210+0000","last_change":"2024-08-17T02:27:20.796106+0000","last_active":"2024-08-17T02:27:21.802210+0000","last_peered":"2024-08-17T02:27:21.802210+0000","last_clean":"2024-08-17T02:27:21.802210+0000","last_became_active":"2024-08-17T02:27:20.795831+0000","last_became_peered":"2024-08-17T02:27:20.795831+0000","last_unstale":"2024-08-17T02:27:21.802210+0000","last_undegraded":"2024-08-17T02:27:21.802210+0000","last_fullsized":"2024-08-17T02:27:21.802210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:11:31.809137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834486+0000","last_change":"2024-08-17T02:27:21.820666+0000","last_active":"2024-08-17T02:27:21.834486+0000","last_peered":"2024-08-17T02:27:21.834486+0000","last_clean":"2024-08-17T02:27:21.834486+0000","last_became_active":"2024-08-17T02:27:21.820173+0000","last_became_peered":"2024-08-17T02:27:21.820173+0000","last_unstale":"2024-08-17T02:27:21.834486+0000","last_undegraded":"2024-08-17T02:27:21.834486+0000","last_fullsized":"2024-08-17T02:27:21.834486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:36:33.357094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.796520+0000","last_change":"2024-08-17T02:27:20.804357+0000","last_active":"2024-08-17T02:27:21.796520+0000","last_peered":"2024-08-17T02:27:21.796520+0000","last_clean":"2024-08-17T02:27:21.796520+0000","last_became_active":"2024-08-17T02:27:20.803986+0000","last_became_peered":"2024-08-17T02:27:20.803986+0000","last_unstale":"2024-08-17T02:27:21.796520+0000","last_undegraded":"2024-08-17T02:27:21.796520+0000","last_fullsized":"2024-08-17T02:27:21.796520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:47:47.470339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.819603+0000","last_change":"2024-08-17T02:27:21.810062+0000","last_active":"2024-08-17T02:27:21.819603+0000","last_peered":"2024-08-17T02:27:21.819603+0000","last_clean":"2024-08-17T02:27:21.819603+0000","last_became_active":"2024-08-17T02:27:21.809768+0000","last_became_peered":"2024-08-17T02:27:21.809768+0000","last_unstale":"2024-08-17T02:27:21.819603+0000","last_undegraded":"2024-08-17T02:27:21.819603+0000","last_fullsized":"2024-08-17T02:27:21.819603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:40:40.512394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.828595+0000","last_change":"2024-08-17T02:27:20.800990+0000","last_active":"2024-08-17T02:27:21.828595+0000","last_peered":"2024-08-17T02:27:21.828595+0000","last_clean":"2024-08-17T02:27:21.828595+0000","last_became_active":"2024-08-17T02:27:20.800645+0000","last_became_peered":"2024-08-17T02:27:20.800645+0000","last_unstale":"2024-08-17T02:27:21.828595+0000","last_undegraded":"2024-08-17T02:27:21.828595+0000","last_fullsized":"2024-08-17T02:27:21.828595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:03:53.869185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.832028+0000","last_change":"2024-08-17T02:27:21.828297+0000","last_active":"2024-08-17T02:27:21.832028+0000","last_peered":"2024-08-17T02:27:21.832028+0000","last_clean":"2024-08-17T02:27:21.832028+0000","last_became_active":"2024-08-17T02:27:21.827604+0000","last_became_peered":"2024-08-17T02:27:21.827604+0000","last_unstale":"2024-08-17T02:27:21.832028+0000","last_undegraded":"2024-08-17T02:27:21.832028+0000","last_fullsized":"2024-08-17T02:27:21.832028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:14:55.984318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.833156+0000","last_change":"2024-08-17T02:27:20.806418+0000","last_active":"2024-08-17T02:27:22.833156+0000","last_peered":"2024-08-17T02:27:22.833156+0000","last_clean":"2024-08-17T02:27:22.833156+0000","last_became_active":"2024-08-17T02:27:20.805980+0000","last_became_peered":"2024-08-17T02:27:20.805980+0000","last_unstale":"2024-08-17T02:27:22.833156+0000","last_undegraded":"2024-08-17T02:27:22.833156+0000","last_fullsized":"2024-08-17T02:27:22.833156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:40:39.504505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.830099+0000","last_change":"2024-08-17T02:27:21.827812+0000","last_active":"2024-08-17T02:27:21.830099+0000","last_peered":"2024-08-17T02:27:21.830099+0000","last_clean":"2024-08-17T02:27:21.830099+0000","last_became_active":"2024-08-17T02:27:21.827347+0000","last_became_peered":"2024-08-17T02:27:21.827347+0000","last_unstale":"2024-08-17T02:27:21.830099+0000","last_undegraded":"2024-08-17T02:27:21.830099+0000","last_fullsized":"2024-08-17T02:27:21.830099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:31.309319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.803678+0000","last_change":"2024-08-17T02:27:20.800940+0000","last_active":"2024-08-17T02:27:21.803678+0000","last_peered":"2024-08-17T02:27:21.803678+0000","last_clean":"2024-08-17T02:27:21.803678+0000","last_became_active":"2024-08-17T02:27:20.800689+0000","last_became_peered":"2024-08-17T02:27:20.800689+0000","last_unstale":"2024-08-17T02:27:21.803678+0000","last_undegraded":"2024-08-17T02:27:21.803678+0000","last_fullsized":"2024-08-17T02:27:21.803678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:09.415412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.809890+0000","last_change":"2024-08-17T02:27:21.805751+0000","last_active":"2024-08-17T02:27:21.809890+0000","last_peered":"2024-08-17T02:27:21.809890+0000","last_clean":"2024-08-17T02:27:21.809890+0000","last_became_active":"2024-08-17T02:27:21.804753+0000","last_became_peered":"2024-08-17T02:27:21.804753+0000","last_unstale":"2024-08-17T02:27:21.809890+0000","last_undegraded":"2024-08-17T02:27:21.809890+0000","last_fullsized":"2024-08-17T02:27:21.809890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:31.971446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.797389+0000","last_change":"2024-08-17T02:27:20.802441+0000","last_active":"2024-08-17T02:27:21.797389+0000","last_peered":"2024-08-17T02:27:21.797389+0000","last_clean":"2024-08-17T02:27:21.797389+0000","last_became_active":"2024-08-17T02:27:20.801600+0000","last_became_peered":"2024-08-17T02:27:20.801600+0000","last_unstale":"2024-08-17T02:27:21.797389+0000","last_undegraded":"2024-08-17T02:27:21.797389+0000","last_fullsized":"2024-08-17T02:27:21.797389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:22:26.226678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.808196+0000","last_change":"2024-08-17T02:27:21.805922+0000","last_active":"2024-08-17T02:27:21.808196+0000","last_peered":"2024-08-17T02:27:21.808196+0000","last_clean":"2024-08-17T02:27:21.808196+0000","last_became_active":"2024-08-17T02:27:21.805642+0000","last_became_peered":"2024-08-17T02:27:21.805642+0000","last_unstale":"2024-08-17T02:27:21.808196+0000","last_undegraded":"2024-08-17T02:27:21.808196+0000","last_fullsized":"2024-08-17T02:27:21.808196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:20:30.360210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.804558+0000","last_change":"2024-08-17T02:27:20.801331+0000","last_active":"2024-08-17T02:27:21.804558+0000","last_peered":"2024-08-17T02:27:21.804558+0000","last_clean":"2024-08-17T02:27:21.804558+0000","last_became_active":"2024-08-17T02:27:20.801092+0000","last_became_peered":"2024-08-17T02:27:20.801092+0000","last_unstale":"2024-08-17T02:27:21.804558+0000","last_undegraded":"2024-08-17T02:27:21.804558+0000","last_fullsized":"2024-08-17T02:27:21.804558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:40:39.504505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.807578+0000","last_change":"2024-08-17T02:27:21.805921+0000","last_active":"2024-08-17T02:27:21.807578+0000","last_peered":"2024-08-17T02:27:21.807578+0000","last_clean":"2024-08-17T02:27:21.807578+0000","last_became_active":"2024-08-17T02:27:21.805637+0000","last_became_peered":"2024-08-17T02:27:21.805637+0000","last_unstale":"2024-08-17T02:27:21.807578+0000","last_undegraded":"2024-08-17T02:27:21.807578+0000","last_fullsized":"2024-08-17T02:27:21.807578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:14:55.984318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.802222+0000","last_change":"2024-08-17T02:27:20.798405+0000","last_active":"2024-08-17T02:27:21.802222+0000","last_peered":"2024-08-17T02:27:21.802222+0000","last_clean":"2024-08-17T02:27:21.802222+0000","last_became_active":"2024-08-17T02:27:20.798156+0000","last_became_peered":"2024-08-17T02:27:20.798156+0000","last_unstale":"2024-08-17T02:27:21.802222+0000","last_undegraded":"2024-08-17T02:27:21.802222+0000","last_fullsized":"2024-08-17T02:27:21.802222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:40:39.504505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.823784+0000","last_change":"2024-08-17T02:27:21.812505+0000","last_active":"2024-08-17T02:27:21.823784+0000","last_peered":"2024-08-17T02:27:21.823784+0000","last_clean":"2024-08-17T02:27:21.823784+0000","last_became_active":"2024-08-17T02:27:21.812190+0000","last_became_peered":"2024-08-17T02:27:21.812190+0000","last_unstale":"2024-08-17T02:27:21.823784+0000","last_undegraded":"2024-08-17T02:27:21.823784+0000","last_fullsized":"2024-08-17T02:27:21.823784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:14:55.984318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.792578+0000","last_change":"2024-08-17T02:27:20.798944+0000","last_active":"2024-08-17T02:27:21.792578+0000","last_peered":"2024-08-17T02:27:21.792578+0000","last_clean":"2024-08-17T02:27:21.792578+0000","last_became_active":"2024-08-17T02:27:20.798405+0000","last_became_peered":"2024-08-17T02:27:20.798405+0000","last_unstale":"2024-08-17T02:27:21.792578+0000","last_undegraded":"2024-08-17T02:27:21.792578+0000","last_fullsized":"2024-08-17T02:27:21.792578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:47:47.470339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834530+0000","last_change":"2024-08-17T02:27:21.822803+0000","last_active":"2024-08-17T02:27:21.834530+0000","last_peered":"2024-08-17T02:27:21.834530+0000","last_clean":"2024-08-17T02:27:21.834530+0000","last_became_active":"2024-08-17T02:27:21.822540+0000","last_became_peered":"2024-08-17T02:27:21.822540+0000","last_unstale":"2024-08-17T02:27:21.834530+0000","last_undegraded":"2024-08-17T02:27:21.834530+0000","last_fullsized":"2024-08-17T02:27:21.834530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:13:43.709389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.799148+0000","last_change":"2024-08-17T02:27:20.810731+0000","last_active":"2024-08-17T02:27:21.799148+0000","last_peered":"2024-08-17T02:27:21.799148+0000","last_clean":"2024-08-17T02:27:21.799148+0000","last_became_active":"2024-08-17T02:27:20.810454+0000","last_became_peered":"2024-08-17T02:27:20.810454+0000","last_unstale":"2024-08-17T02:27:21.799148+0000","last_undegraded":"2024-08-17T02:27:21.799148+0000","last_fullsized":"2024-08-17T02:27:21.799148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:22:26.226678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.811403+0000","last_change":"2024-08-17T02:26:27.275086+0000","last_active":"2024-08-17T02:27:21.811403+0000","last_peered":"2024-08-17T02:27:21.811403+0000","last_clean":"2024-08-17T02:27:21.811403+0000","last_became_active":"2024-08-17T02:26:27.274075+0000","last_became_peered":"2024-08-17T02:26:27.274075+0000","last_unstale":"2024-08-17T02:27:21.811403+0000","last_undegraded":"2024-08-17T02:27:21.811403+0000","last_fullsized":"2024-08-17T02:27:21.811403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_clean_scrub_stamp":"2024-08-17T02:26:26.139133+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:52.161982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":958464,"data_stored":728831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":138977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":139033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":3.3130000000000002,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":4.0670000000000002,"5min":4.0670000000000002,"15min":4.0670000000000002},"last":0.82899999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.74299999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.71999999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66300000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68700000000000006}]},{"osd":7,"last update":"Sat Aug 17 02:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.86299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":138477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":376832,"data_stored":139947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074128,"statfs":{"total":96636764160,"available":96331907072,"internally_reserved":0,"allocated":364544,"data_stored":138443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":376832,"data_stored":139947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298296,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073544,"statfs":{"total":96636764160,"available":96331309056,"internally_reserved":0,"allocated":954368,"data_stored":728741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:25.993 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:26.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.180+0000 7f6d48a00640 1 Processor -- start 2024-08-17T02:27:26.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.180+0000 7f6d48a00640 1 -- start start 2024-08-17T02:27:26.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.181+0000 7f6d48a00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6d440afca0 0x7f6d440b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.181+0000 7f6d48a00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d440c92b0 con 0x7f6d441590b0 2024-08-17T02:27:26.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.181+0000 7f6d48a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d440ad480 con 0x7f6d440acf10 2024-08-17T02:27:26.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.181+0000 7f6d48a00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d440b0980 con 0x7f6d440afca0 2024-08-17T02:27:26.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.181+0000 7f6d41e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6d440afca0 0x7f6d440b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.181+0000 7f6d42800640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6d441590b0 0x7f6d440c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56656/0 (socket says 172.21.15.6:56656) 2024-08-17T02:27:26.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.181+0000 7f6d42800640 1 -- 172.21.15.6:0/1973323490 learned_addr learned my addr 172.21.15.6:0/1973323490 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:26.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.182+0000 7f6d41e00640 1 -- 172.21.15.6:0/1973323490 >> v1:172.21.15.136:6789/0 conn(0x7f6d440acf10 legacy=0x7f6d441589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:26.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.182+0000 7f6d41e00640 1 -- 172.21.15.6:0/1973323490 >> v1:172.21.15.6:6789/0 conn(0x7f6d441590b0 legacy=0x7f6d440c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.182+0000 7f6d41e00640 1 -- 172.21.15.6:0/1973323490 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d440ad760 con 0x7f6d440afca0 2024-08-17T02:27:26.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.182+0000 7f6d40a00640 1 -- 172.21.15.6:0/1973323490 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378799388 0 0) 0x7f6d440c92b0 con 0x7f6d441590b0 2024-08-17T02:27:26.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.183+0000 7f6d41e00640 1 --2- 172.21.15.6:0/1973323490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d440afca0 0x7f6d440b0070 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009850 tx=0x7f6d340090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f4a1313b366b3a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.183+0000 7f6d40a00640 1 -- 172.21.15.6:0/1973323490 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3402adb0 con 0x7f6d440afca0 2024-08-17T02:27:26.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.183+0000 7f6d40a00640 1 -- 172.21.15.6:0/1973323490 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d34032440 con 0x7f6d440afca0 2024-08-17T02:27:26.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.183+0000 7f6d40a00640 1 -- 172.21.15.6:0/1973323490 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d340327e0 con 0x7f6d440afca0 2024-08-17T02:27:26.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.184+0000 7f6d48a00640 1 -- 172.21.15.6:0/1973323490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d440afca0 msgr2=0x7f6d440b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.184+0000 7f6d48a00640 1 --2- 172.21.15.6:0/1973323490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d440afca0 0x7f6d440b0070 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009850 tx=0x7f6d340090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.184+0000 7f6d48a00640 1 -- 172.21.15.6:0/1973323490 shutdown_connections 2024-08-17T02:27:26.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.184+0000 7f6d48a00640 1 --2- 172.21.15.6:0/1973323490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d440afca0 0x7f6d440b0070 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.184+0000 7f6d48a00640 1 -- 172.21.15.6:0/1973323490 >> 172.21.15.6:0/1973323490 conn(0x7f6d44066e60 msgr2=0x7f6d44067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.184+0000 7f6d48a00640 1 -- 172.21.15.6:0/1973323490 shutdown_connections 2024-08-17T02:27:26.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.184+0000 7f6d48a00640 1 -- 172.21.15.6:0/1973323490 wait complete. 2024-08-17T02:27:26.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.185+0000 7f6d48a00640 1 Processor -- start 2024-08-17T02:27:26.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.185+0000 7f6d48a00640 1 -- start start 2024-08-17T02:27:26.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.186+0000 7f6d48a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d440acf10 0x7f6d44149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.186+0000 7f6d48a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d440afca0 0x7f6d4414abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.186+0000 7f6d48a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d441590b0 0x7f6d4414b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.186+0000 7f6d48a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4414c7d0 con 0x7f6d440afca0 2024-08-17T02:27:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.186+0000 7f6d48a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d441595c0 con 0x7f6d440acf10 2024-08-17T02:27:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.186+0000 7f6d48a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d44159860 con 0x7f6d441590b0 2024-08-17T02:27:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.186+0000 7f6d41400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d440afca0 0x7f6d4414abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.186+0000 7f6d41400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d440afca0 0x7f6d4414abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41138/0 (socket says 172.21.15.6:41138) 2024-08-17T02:27:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.186+0000 7f6d41400640 1 -- 172.21.15.6:0/4209428648 learned_addr learned my addr 172.21.15.6:0/4209428648 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.187+0000 7f6d41e00640 1 --2- 172.21.15.6:0/4209428648 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d440acf10 0x7f6d44149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.187+0000 7f6d42800640 1 --2- 172.21.15.6:0/4209428648 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d441590b0 0x7f6d4414b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.187+0000 7f6d41400640 1 -- 172.21.15.6:0/4209428648 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d441590b0 msgr2=0x7f6d4414b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.187+0000 7f6d41400640 1 --2- 172.21.15.6:0/4209428648 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d441590b0 0x7f6d4414b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.187+0000 7f6d41400640 1 -- 172.21.15.6:0/4209428648 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d440acf10 msgr2=0x7f6d44149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.187+0000 7f6d41400640 1 --2- 172.21.15.6:0/4209428648 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d440acf10 0x7f6d44149f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.187+0000 7f6d41400640 1 -- 172.21.15.6:0/4209428648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d34009390 con 0x7f6d440afca0 2024-08-17T02:27:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.187+0000 7f6d42800640 1 --2- 172.21.15.6:0/4209428648 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d441590b0 0x7f6d4414b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.187+0000 7f6d41e00640 1 --2- 172.21.15.6:0/4209428648 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d440acf10 0x7f6d44149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.187+0000 7f6d41400640 1 --2- 172.21.15.6:0/4209428648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d440afca0 0x7f6d4414abe0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000c5e0 tx=0x7f6d30007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.187+0000 7f6d39600640 1 -- 172.21.15.6:0/4209428648 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d30012630 con 0x7f6d440afca0 2024-08-17T02:27:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.187+0000 7f6d39600640 1 -- 172.21.15.6:0/4209428648 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d300127b0 con 0x7f6d440afca0 2024-08-17T02:27:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.187+0000 7f6d48a00640 1 -- 172.21.15.6:0/4209428648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d44159b40 con 0x7f6d440afca0 2024-08-17T02:27:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.187+0000 7f6d39600640 1 -- 172.21.15.6:0/4209428648 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d30012bb0 con 0x7f6d440afca0 2024-08-17T02:27:26.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.188+0000 7f6d48a00640 1 -- 172.21.15.6:0/4209428648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4415a100 con 0x7f6d440afca0 2024-08-17T02:27:26.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.189+0000 7f6d48a00640 1 -- 172.21.15.6:0/4209428648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4415a2f0 con 0x7f6d440afca0 2024-08-17T02:27:26.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.189+0000 7f6d39600640 1 -- 172.21.15.6:0/4209428648 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6d3001a3b0 con 0x7f6d440afca0 2024-08-17T02:27:26.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.190+0000 7f6d39600640 1 --2- 172.21.15.6:0/4209428648 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6d24065150 0x7f6d24067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.190+0000 7f6d39600640 1 -- 172.21.15.6:0/4209428648 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6d300820c0 con 0x7f6d440afca0 2024-08-17T02:27:26.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.191+0000 7f6d41e00640 1 --2- 172.21.15.6:0/4209428648 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6d24065150 0x7f6d24067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.192+0000 7f6d41e00640 1 --2- 172.21.15.6:0/4209428648 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6d24065150 0x7f6d24067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6d34034000 tx=0x7f6d34032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.194+0000 7f6d39600640 1 -- 172.21.15.6:0/4209428648 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6d300500e0 con 0x7f6d440afca0 2024-08-17T02:27:26.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.376+0000 7f6d48a00640 1 -- 172.21.15.6:0/4209428648 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d44063fb0 con 0x7f6d24065150 2024-08-17T02:27:26.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.383+0000 7f6d39600640 1 -- 172.21.15.6:0/4209428648 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+267775 (secure 0 0 0) 0x7f6d44063fb0 con 0x7f6d24065150 2024-08-17T02:27:26.387 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:26.388 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-08-17T02:27:26.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.387+0000 7f6d48a00640 1 -- 172.21.15.6:0/4209428648 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6d24065150 msgr2=0x7f6d24067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.387+0000 7f6d48a00640 1 --2- 172.21.15.6:0/4209428648 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6d24065150 0x7f6d24067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6d34034000 tx=0x7f6d34032000 comp rx=0 tx=0).stop 2024-08-17T02:27:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.387+0000 7f6d48a00640 1 -- 172.21.15.6:0/4209428648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d440afca0 msgr2=0x7f6d4414abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.387+0000 7f6d48a00640 1 --2- 172.21.15.6:0/4209428648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d440afca0 0x7f6d4414abe0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000c5e0 tx=0x7f6d30007ed0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.388+0000 7f6d48a00640 1 -- 172.21.15.6:0/4209428648 shutdown_connections 2024-08-17T02:27:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.388+0000 7f6d48a00640 1 --2- 172.21.15.6:0/4209428648 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6d24065150 0x7f6d24067600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.388+0000 7f6d48a00640 1 --2- 172.21.15.6:0/4209428648 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d441590b0 0x7f6d4414b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.388+0000 7f6d48a00640 1 --2- 172.21.15.6:0/4209428648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d440afca0 0x7f6d4414abe0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.388+0000 7f6d48a00640 1 --2- 172.21.15.6:0/4209428648 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d440acf10 0x7f6d44149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.388+0000 7f6d48a00640 1 -- 172.21.15.6:0/4209428648 >> 172.21.15.6:0/4209428648 conn(0x7f6d44066e60 msgr2=0x7f6d440ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.388+0000 7f6d48a00640 1 -- 172.21.15.6:0/4209428648 shutdown_connections 2024-08-17T02:27:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.388+0000 7f6d48a00640 1 -- 172.21.15.6:0/4209428648 wait complete. 2024-08-17T02:27:26.403 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-08-17T02:27:25.420539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382904,"kb_used_data":4040,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752591816,"statfs":{"total":773094113280,"available":770654019584,"internally_reserved":0,"allocated":4136960,"data_stored":2292396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.643993"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.818827+0000","last_change":"2024-08-17T02:27:21.811136+0000","last_active":"2024-08-17T02:27:21.818827+0000","last_peered":"2024-08-17T02:27:21.818827+0000","last_clean":"2024-08-17T02:27:21.818827+0000","last_became_active":"2024-08-17T02:27:21.810826+0000","last_became_peered":"2024-08-17T02:27:21.810826+0000","last_unstale":"2024-08-17T02:27:21.818827+0000","last_undegraded":"2024-08-17T02:27:21.818827+0000","last_fullsized":"2024-08-17T02:27:21.818827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:20:30.360210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.807184+0000","last_change":"2024-08-17T02:27:21.805370+0000","last_active":"2024-08-17T02:27:21.807184+0000","last_peered":"2024-08-17T02:27:21.807184+0000","last_clean":"2024-08-17T02:27:21.807184+0000","last_became_active":"2024-08-17T02:27:21.804560+0000","last_became_peered":"2024-08-17T02:27:21.804560+0000","last_unstale":"2024-08-17T02:27:21.807184+0000","last_undegraded":"2024-08-17T02:27:21.807184+0000","last_fullsized":"2024-08-17T02:27:21.807184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:23:11.251565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834414+0000","last_change":"2024-08-17T02:27:21.830035+0000","last_active":"2024-08-17T02:27:21.834414+0000","last_peered":"2024-08-17T02:27:21.834414+0000","last_clean":"2024-08-17T02:27:21.834414+0000","last_became_active":"2024-08-17T02:27:21.829752+0000","last_became_peered":"2024-08-17T02:27:21.829752+0000","last_unstale":"2024-08-17T02:27:21.834414+0000","last_undegraded":"2024-08-17T02:27:21.834414+0000","last_fullsized":"2024-08-17T02:27:21.834414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:42.139955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834238+0000","last_change":"2024-08-17T02:27:21.829806+0000","last_active":"2024-08-17T02:27:21.834238+0000","last_peered":"2024-08-17T02:27:21.834238+0000","last_clean":"2024-08-17T02:27:21.834238+0000","last_became_active":"2024-08-17T02:27:21.829561+0000","last_became_peered":"2024-08-17T02:27:21.829561+0000","last_unstale":"2024-08-17T02:27:21.834238+0000","last_undegraded":"2024-08-17T02:27:21.834238+0000","last_fullsized":"2024-08-17T02:27:21.834238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:00.821559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.816656+0000","last_change":"2024-08-17T02:27:21.806525+0000","last_active":"2024-08-17T02:27:21.816656+0000","last_peered":"2024-08-17T02:27:21.816656+0000","last_clean":"2024-08-17T02:27:21.816656+0000","last_became_active":"2024-08-17T02:27:21.806280+0000","last_became_peered":"2024-08-17T02:27:21.806280+0000","last_unstale":"2024-08-17T02:27:21.816656+0000","last_undegraded":"2024-08-17T02:27:21.816656+0000","last_fullsized":"2024-08-17T02:27:21.816656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:22:27.234568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.806370+0000","last_change":"2024-08-17T02:27:21.802156+0000","last_active":"2024-08-17T02:27:21.806370+0000","last_peered":"2024-08-17T02:27:21.806370+0000","last_clean":"2024-08-17T02:27:21.806370+0000","last_became_active":"2024-08-17T02:27:21.801856+0000","last_became_peered":"2024-08-17T02:27:21.801856+0000","last_unstale":"2024-08-17T02:27:21.806370+0000","last_undegraded":"2024-08-17T02:27:21.806370+0000","last_fullsized":"2024-08-17T02:27:21.806370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:38:13.150669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834629+0000","last_change":"2024-08-17T02:27:21.827113+0000","last_active":"2024-08-17T02:27:21.834629+0000","last_peered":"2024-08-17T02:27:21.834629+0000","last_clean":"2024-08-17T02:27:21.834629+0000","last_became_active":"2024-08-17T02:27:21.826187+0000","last_became_peered":"2024-08-17T02:27:21.826187+0000","last_unstale":"2024-08-17T02:27:21.834629+0000","last_undegraded":"2024-08-17T02:27:21.834629+0000","last_fullsized":"2024-08-17T02:27:21.834629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:07.015453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834594+0000","last_change":"2024-08-17T02:27:21.826604+0000","last_active":"2024-08-17T02:27:21.834594+0000","last_peered":"2024-08-17T02:27:21.834594+0000","last_clean":"2024-08-17T02:27:21.834594+0000","last_became_active":"2024-08-17T02:27:21.822003+0000","last_became_peered":"2024-08-17T02:27:21.822003+0000","last_unstale":"2024-08-17T02:27:21.834594+0000","last_undegraded":"2024-08-17T02:27:21.834594+0000","last_fullsized":"2024-08-17T02:27:21.834594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:19.609640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.830277+0000","last_change":"2024-08-17T02:27:21.825332+0000","last_active":"2024-08-17T02:27:21.830277+0000","last_peered":"2024-08-17T02:27:21.830277+0000","last_clean":"2024-08-17T02:27:21.830277+0000","last_became_active":"2024-08-17T02:27:21.824903+0000","last_became_peered":"2024-08-17T02:27:21.824903+0000","last_unstale":"2024-08-17T02:27:21.830277+0000","last_undegraded":"2024-08-17T02:27:21.830277+0000","last_fullsized":"2024-08-17T02:27:21.830277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:59.409218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.832080+0000","last_change":"2024-08-17T02:27:21.824554+0000","last_active":"2024-08-17T02:27:21.832080+0000","last_peered":"2024-08-17T02:27:21.832080+0000","last_clean":"2024-08-17T02:27:21.832080+0000","last_became_active":"2024-08-17T02:27:21.823985+0000","last_became_peered":"2024-08-17T02:27:21.823985+0000","last_unstale":"2024-08-17T02:27:21.832080+0000","last_undegraded":"2024-08-17T02:27:21.832080+0000","last_fullsized":"2024-08-17T02:27:21.832080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:14:55.984318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834759+0000","last_change":"2024-08-17T02:27:21.830940+0000","last_active":"2024-08-17T02:27:21.834759+0000","last_peered":"2024-08-17T02:27:21.834759+0000","last_clean":"2024-08-17T02:27:21.834759+0000","last_became_active":"2024-08-17T02:27:21.830658+0000","last_became_peered":"2024-08-17T02:27:21.830658+0000","last_unstale":"2024-08-17T02:27:21.834759+0000","last_undegraded":"2024-08-17T02:27:21.834759+0000","last_fullsized":"2024-08-17T02:27:21.834759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:38:13.150669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.815316+0000","last_change":"2024-08-17T02:27:21.811682+0000","last_active":"2024-08-17T02:27:21.815316+0000","last_peered":"2024-08-17T02:27:21.815316+0000","last_clean":"2024-08-17T02:27:21.815316+0000","last_became_active":"2024-08-17T02:27:21.810822+0000","last_became_peered":"2024-08-17T02:27:21.810822+0000","last_unstale":"2024-08-17T02:27:21.815316+0000","last_undegraded":"2024-08-17T02:27:21.815316+0000","last_fullsized":"2024-08-17T02:27:21.815316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:36:49.607977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.819545+0000","last_change":"2024-08-17T02:27:21.811896+0000","last_active":"2024-08-17T02:27:21.819545+0000","last_peered":"2024-08-17T02:27:21.819545+0000","last_clean":"2024-08-17T02:27:21.819545+0000","last_became_active":"2024-08-17T02:27:21.811562+0000","last_became_peered":"2024-08-17T02:27:21.811562+0000","last_unstale":"2024-08-17T02:27:21.819545+0000","last_undegraded":"2024-08-17T02:27:21.819545+0000","last_fullsized":"2024-08-17T02:27:21.819545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:03.284079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.818500+0000","last_change":"2024-08-17T02:27:21.810689+0000","last_active":"2024-08-17T02:27:21.818500+0000","last_peered":"2024-08-17T02:27:21.818500+0000","last_clean":"2024-08-17T02:27:21.818500+0000","last_became_active":"2024-08-17T02:27:21.810451+0000","last_became_peered":"2024-08-17T02:27:21.810451+0000","last_unstale":"2024-08-17T02:27:21.818500+0000","last_undegraded":"2024-08-17T02:27:21.818500+0000","last_fullsized":"2024-08-17T02:27:21.818500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:09:53.711158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.815162+0000","last_change":"2024-08-17T02:27:21.806168+0000","last_active":"2024-08-17T02:27:21.815162+0000","last_peered":"2024-08-17T02:27:21.815162+0000","last_clean":"2024-08-17T02:27:21.815162+0000","last_became_active":"2024-08-17T02:27:21.805845+0000","last_became_peered":"2024-08-17T02:27:21.805845+0000","last_unstale":"2024-08-17T02:27:21.815162+0000","last_undegraded":"2024-08-17T02:27:21.815162+0000","last_fullsized":"2024-08-17T02:27:21.815162+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:00.821559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834702+0000","last_change":"2024-08-17T02:27:21.830637+0000","last_active":"2024-08-17T02:27:21.834702+0000","last_peered":"2024-08-17T02:27:21.834702+0000","last_clean":"2024-08-17T02:27:21.834702+0000","last_became_active":"2024-08-17T02:27:21.829106+0000","last_became_peered":"2024-08-17T02:27:21.829106+0000","last_unstale":"2024-08-17T02:27:21.834702+0000","last_undegraded":"2024-08-17T02:27:21.834702+0000","last_fullsized":"2024-08-17T02:27:21.834702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:42.139955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834507+0000","last_change":"2024-08-17T02:27:21.822193+0000","last_active":"2024-08-17T02:27:21.834507+0000","last_peered":"2024-08-17T02:27:21.834507+0000","last_clean":"2024-08-17T02:27:21.834507+0000","last_became_active":"2024-08-17T02:27:21.821938+0000","last_became_peered":"2024-08-17T02:27:21.821938+0000","last_unstale":"2024-08-17T02:27:21.834507+0000","last_undegraded":"2024-08-17T02:27:21.834507+0000","last_fullsized":"2024-08-17T02:27:21.834507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:06:54.181385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.832886+0000","last_change":"2024-08-17T02:27:21.830508+0000","last_active":"2024-08-17T02:27:21.832886+0000","last_peered":"2024-08-17T02:27:21.832886+0000","last_clean":"2024-08-17T02:27:21.832886+0000","last_became_active":"2024-08-17T02:27:21.825634+0000","last_became_peered":"2024-08-17T02:27:21.825634+0000","last_unstale":"2024-08-17T02:27:21.832886+0000","last_undegraded":"2024-08-17T02:27:21.832886+0000","last_fullsized":"2024-08-17T02:27:21.832886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:19.609640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.832954+0000","last_change":"2024-08-17T02:27:21.831274+0000","last_active":"2024-08-17T02:27:21.832954+0000","last_peered":"2024-08-17T02:27:21.832954+0000","last_clean":"2024-08-17T02:27:21.832954+0000","last_became_active":"2024-08-17T02:27:21.830923+0000","last_became_peered":"2024-08-17T02:27:21.830923+0000","last_unstale":"2024-08-17T02:27:21.832954+0000","last_undegraded":"2024-08-17T02:27:21.832954+0000","last_fullsized":"2024-08-17T02:27:21.832954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:51.514747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.818826+0000","last_change":"2024-08-17T02:27:21.803519+0000","last_active":"2024-08-17T02:27:21.818826+0000","last_peered":"2024-08-17T02:27:21.818826+0000","last_clean":"2024-08-17T02:27:21.818826+0000","last_became_active":"2024-08-17T02:27:21.803212+0000","last_became_peered":"2024-08-17T02:27:21.803212+0000","last_unstale":"2024-08-17T02:27:21.818826+0000","last_undegraded":"2024-08-17T02:27:21.818826+0000","last_fullsized":"2024-08-17T02:27:21.818826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:03:54.877074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.823829+0000","last_change":"2024-08-17T02:27:21.813248+0000","last_active":"2024-08-17T02:27:21.823829+0000","last_peered":"2024-08-17T02:27:21.823829+0000","last_clean":"2024-08-17T02:27:21.823829+0000","last_became_active":"2024-08-17T02:27:21.812939+0000","last_became_peered":"2024-08-17T02:27:21.812939+0000","last_unstale":"2024-08-17T02:27:21.823829+0000","last_undegraded":"2024-08-17T02:27:21.823829+0000","last_fullsized":"2024-08-17T02:27:21.823829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:17:19.823110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.824477+0000","last_change":"2024-08-17T02:27:21.818256+0000","last_active":"2024-08-17T02:27:21.824477+0000","last_peered":"2024-08-17T02:27:21.824477+0000","last_clean":"2024-08-17T02:27:21.824477+0000","last_became_active":"2024-08-17T02:27:21.815316+0000","last_became_peered":"2024-08-17T02:27:21.815316+0000","last_unstale":"2024-08-17T02:27:21.824477+0000","last_undegraded":"2024-08-17T02:27:21.824477+0000","last_fullsized":"2024-08-17T02:27:21.824477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:46:12.597353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.819017+0000","last_change":"2024-08-17T02:27:21.814369+0000","last_active":"2024-08-17T02:27:21.819017+0000","last_peered":"2024-08-17T02:27:21.819017+0000","last_clean":"2024-08-17T02:27:21.819017+0000","last_became_active":"2024-08-17T02:27:21.812301+0000","last_became_peered":"2024-08-17T02:27:21.812301+0000","last_unstale":"2024-08-17T02:27:21.819017+0000","last_undegraded":"2024-08-17T02:27:21.819017+0000","last_fullsized":"2024-08-17T02:27:21.819017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:23.390289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.815526+0000","last_change":"2024-08-17T02:27:21.809845+0000","last_active":"2024-08-17T02:27:21.815526+0000","last_peered":"2024-08-17T02:27:21.815526+0000","last_clean":"2024-08-17T02:27:21.815526+0000","last_became_active":"2024-08-17T02:27:21.809570+0000","last_became_peered":"2024-08-17T02:27:21.809570+0000","last_unstale":"2024-08-17T02:27:21.815526+0000","last_undegraded":"2024-08-17T02:27:21.815526+0000","last_fullsized":"2024-08-17T02:27:21.815526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:39:43.173489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.830686+0000","last_change":"2024-08-17T02:27:21.823957+0000","last_active":"2024-08-17T02:27:21.830686+0000","last_peered":"2024-08-17T02:27:21.830686+0000","last_clean":"2024-08-17T02:27:21.830686+0000","last_became_active":"2024-08-17T02:27:21.822192+0000","last_became_peered":"2024-08-17T02:27:21.822192+0000","last_unstale":"2024-08-17T02:27:21.830686+0000","last_undegraded":"2024-08-17T02:27:21.830686+0000","last_fullsized":"2024-08-17T02:27:21.830686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:46:12.597353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.823103+0000","last_change":"2024-08-17T02:27:21.818215+0000","last_active":"2024-08-17T02:27:21.823103+0000","last_peered":"2024-08-17T02:27:21.823103+0000","last_clean":"2024-08-17T02:27:21.823103+0000","last_became_active":"2024-08-17T02:27:21.817926+0000","last_became_peered":"2024-08-17T02:27:21.817926+0000","last_unstale":"2024-08-17T02:27:21.823103+0000","last_undegraded":"2024-08-17T02:27:21.823103+0000","last_fullsized":"2024-08-17T02:27:21.823103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:06:54.181385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.830535+0000","last_change":"2024-08-17T02:27:21.822475+0000","last_active":"2024-08-17T02:27:21.830535+0000","last_peered":"2024-08-17T02:27:21.830535+0000","last_clean":"2024-08-17T02:27:21.830535+0000","last_became_active":"2024-08-17T02:27:21.822229+0000","last_became_peered":"2024-08-17T02:27:21.822229+0000","last_unstale":"2024-08-17T02:27:21.830535+0000","last_undegraded":"2024-08-17T02:27:21.830535+0000","last_fullsized":"2024-08-17T02:27:21.830535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:17:19.823110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.815296+0000","last_change":"2024-08-17T02:27:21.807724+0000","last_active":"2024-08-17T02:27:21.815296+0000","last_peered":"2024-08-17T02:27:21.815296+0000","last_clean":"2024-08-17T02:27:21.815296+0000","last_became_active":"2024-08-17T02:27:21.805970+0000","last_became_peered":"2024-08-17T02:27:21.805970+0000","last_unstale":"2024-08-17T02:27:21.815296+0000","last_undegraded":"2024-08-17T02:27:21.815296+0000","last_fullsized":"2024-08-17T02:27:21.815296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:06:54.181385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.823805+0000","last_change":"2024-08-17T02:27:21.812729+0000","last_active":"2024-08-17T02:27:21.823805+0000","last_peered":"2024-08-17T02:27:21.823805+0000","last_clean":"2024-08-17T02:27:21.823805+0000","last_became_active":"2024-08-17T02:27:21.812201+0000","last_became_peered":"2024-08-17T02:27:21.812201+0000","last_unstale":"2024-08-17T02:27:21.823805+0000","last_undegraded":"2024-08-17T02:27:21.823805+0000","last_fullsized":"2024-08-17T02:27:21.823805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:29.077064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.831426+0000","last_change":"2024-08-17T02:27:21.818177+0000","last_active":"2024-08-17T02:27:21.831426+0000","last_peered":"2024-08-17T02:27:21.831426+0000","last_clean":"2024-08-17T02:27:21.831426+0000","last_became_active":"2024-08-17T02:27:21.817924+0000","last_became_peered":"2024-08-17T02:27:21.817924+0000","last_unstale":"2024-08-17T02:27:21.831426+0000","last_undegraded":"2024-08-17T02:27:21.831426+0000","last_fullsized":"2024-08-17T02:27:21.831426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:19.145353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.818679+0000","last_change":"2024-08-17T02:27:21.813907+0000","last_active":"2024-08-17T02:27:21.818679+0000","last_peered":"2024-08-17T02:27:21.818679+0000","last_clean":"2024-08-17T02:27:21.818679+0000","last_became_active":"2024-08-17T02:27:21.813464+0000","last_became_peered":"2024-08-17T02:27:21.813464+0000","last_unstale":"2024-08-17T02:27:21.818679+0000","last_undegraded":"2024-08-17T02:27:21.818679+0000","last_fullsized":"2024-08-17T02:27:21.818679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:13:02.312015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834645+0000","last_change":"2024-08-17T02:27:21.827202+0000","last_active":"2024-08-17T02:27:21.834645+0000","last_peered":"2024-08-17T02:27:21.834645+0000","last_clean":"2024-08-17T02:27:21.834645+0000","last_became_active":"2024-08-17T02:27:21.826930+0000","last_became_peered":"2024-08-17T02:27:21.826930+0000","last_unstale":"2024-08-17T02:27:21.834645+0000","last_undegraded":"2024-08-17T02:27:21.834645+0000","last_fullsized":"2024-08-17T02:27:21.834645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:36:49.607977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.821535+0000","last_change":"2024-08-17T02:27:21.819085+0000","last_active":"2024-08-17T02:27:21.821535+0000","last_peered":"2024-08-17T02:27:21.821535+0000","last_clean":"2024-08-17T02:27:21.821535+0000","last_became_active":"2024-08-17T02:27:21.818776+0000","last_became_peered":"2024-08-17T02:27:21.818776+0000","last_unstale":"2024-08-17T02:27:21.821535+0000","last_undegraded":"2024-08-17T02:27:21.821535+0000","last_fullsized":"2024-08-17T02:27:21.821535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:13:02.312015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.824037+0000","last_change":"2024-08-17T02:27:20.805781+0000","last_active":"2024-08-17T02:27:21.824037+0000","last_peered":"2024-08-17T02:27:21.824037+0000","last_clean":"2024-08-17T02:27:21.824037+0000","last_became_active":"2024-08-17T02:27:20.805522+0000","last_became_peered":"2024-08-17T02:27:20.805522+0000","last_unstale":"2024-08-17T02:27:21.824037+0000","last_undegraded":"2024-08-17T02:27:21.824037+0000","last_fullsized":"2024-08-17T02:27:21.824037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:09.295691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.822981+0000","last_change":"2024-08-17T02:27:21.821303+0000","last_active":"2024-08-17T02:27:21.822981+0000","last_peered":"2024-08-17T02:27:21.822981+0000","last_clean":"2024-08-17T02:27:21.822981+0000","last_became_active":"2024-08-17T02:27:21.821015+0000","last_became_peered":"2024-08-17T02:27:21.821015+0000","last_unstale":"2024-08-17T02:27:21.822981+0000","last_undegraded":"2024-08-17T02:27:21.822981+0000","last_fullsized":"2024-08-17T02:27:21.822981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:38:58.195987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.831579+0000","last_change":"2024-08-17T02:27:20.800488+0000","last_active":"2024-08-17T02:27:21.831579+0000","last_peered":"2024-08-17T02:27:21.831579+0000","last_clean":"2024-08-17T02:27:21.831579+0000","last_became_active":"2024-08-17T02:27:20.800198+0000","last_became_peered":"2024-08-17T02:27:20.800198+0000","last_unstale":"2024-08-17T02:27:21.831579+0000","last_undegraded":"2024-08-17T02:27:21.831579+0000","last_fullsized":"2024-08-17T02:27:21.831579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:50.037093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.824262+0000","last_change":"2024-08-17T02:27:21.819311+0000","last_active":"2024-08-17T02:27:21.824262+0000","last_peered":"2024-08-17T02:27:21.824262+0000","last_clean":"2024-08-17T02:27:21.824262+0000","last_became_active":"2024-08-17T02:27:21.814746+0000","last_became_peered":"2024-08-17T02:27:21.814746+0000","last_unstale":"2024-08-17T02:27:21.824262+0000","last_undegraded":"2024-08-17T02:27:21.824262+0000","last_fullsized":"2024-08-17T02:27:21.824262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:00.821559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.831615+0000","last_change":"2024-08-17T02:27:20.797356+0000","last_active":"2024-08-17T02:27:21.831615+0000","last_peered":"2024-08-17T02:27:21.831615+0000","last_clean":"2024-08-17T02:27:21.831615+0000","last_became_active":"2024-08-17T02:27:20.797106+0000","last_became_peered":"2024-08-17T02:27:20.797106+0000","last_unstale":"2024-08-17T02:27:21.831615+0000","last_undegraded":"2024-08-17T02:27:21.831615+0000","last_fullsized":"2024-08-17T02:27:21.831615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:13:01.304125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834074+0000","last_change":"2024-08-17T02:27:21.828951+0000","last_active":"2024-08-17T02:27:21.834074+0000","last_peered":"2024-08-17T02:27:21.834074+0000","last_clean":"2024-08-17T02:27:21.834074+0000","last_became_active":"2024-08-17T02:27:21.825836+0000","last_became_peered":"2024-08-17T02:27:21.825836+0000","last_unstale":"2024-08-17T02:27:21.834074+0000","last_undegraded":"2024-08-17T02:27:21.834074+0000","last_fullsized":"2024-08-17T02:27:21.834074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:59.409218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834646+0000","last_change":"2024-08-17T02:27:20.798788+0000","last_active":"2024-08-17T02:27:21.834646+0000","last_peered":"2024-08-17T02:27:21.834646+0000","last_clean":"2024-08-17T02:27:21.834646+0000","last_became_active":"2024-08-17T02:27:20.797728+0000","last_became_peered":"2024-08-17T02:27:20.797728+0000","last_unstale":"2024-08-17T02:27:21.834646+0000","last_undegraded":"2024-08-17T02:27:21.834646+0000","last_fullsized":"2024-08-17T02:27:21.834646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:16.342786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834634+0000","last_change":"2024-08-17T02:27:21.827019+0000","last_active":"2024-08-17T02:27:21.834634+0000","last_peered":"2024-08-17T02:27:21.834634+0000","last_clean":"2024-08-17T02:27:21.834634+0000","last_became_active":"2024-08-17T02:27:21.826072+0000","last_became_peered":"2024-08-17T02:27:21.826072+0000","last_unstale":"2024-08-17T02:27:21.834634+0000","last_undegraded":"2024-08-17T02:27:21.834634+0000","last_fullsized":"2024-08-17T02:27:21.834634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:39:43.173489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.830931+0000","last_change":"2024-08-17T02:27:20.802861+0000","last_active":"2024-08-17T02:27:21.830931+0000","last_peered":"2024-08-17T02:27:21.830931+0000","last_clean":"2024-08-17T02:27:21.830931+0000","last_became_active":"2024-08-17T02:27:20.802621+0000","last_became_peered":"2024-08-17T02:27:20.802621+0000","last_unstale":"2024-08-17T02:27:21.830931+0000","last_undegraded":"2024-08-17T02:27:21.830931+0000","last_fullsized":"2024-08-17T02:27:21.830931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:22:26.226678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.816180+0000","last_change":"2024-08-17T02:27:21.812248+0000","last_active":"2024-08-17T02:27:21.816180+0000","last_peered":"2024-08-17T02:27:21.816180+0000","last_clean":"2024-08-17T02:27:21.816180+0000","last_became_active":"2024-08-17T02:27:21.811996+0000","last_became_peered":"2024-08-17T02:27:21.811996+0000","last_unstale":"2024-08-17T02:27:21.816180+0000","last_undegraded":"2024-08-17T02:27:21.816180+0000","last_fullsized":"2024-08-17T02:27:21.816180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:21.513275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.830920+0000","last_change":"2024-08-17T02:27:20.802979+0000","last_active":"2024-08-17T02:27:21.830920+0000","last_peered":"2024-08-17T02:27:21.830920+0000","last_clean":"2024-08-17T02:27:21.830920+0000","last_became_active":"2024-08-17T02:27:20.802715+0000","last_became_peered":"2024-08-17T02:27:20.802715+0000","last_unstale":"2024-08-17T02:27:21.830920+0000","last_undegraded":"2024-08-17T02:27:21.830920+0000","last_fullsized":"2024-08-17T02:27:21.830920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:41.427901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.824309+0000","last_change":"2024-08-17T02:27:21.807975+0000","last_active":"2024-08-17T02:27:21.824309+0000","last_peered":"2024-08-17T02:27:21.824309+0000","last_clean":"2024-08-17T02:27:21.824309+0000","last_became_active":"2024-08-17T02:27:21.807298+0000","last_became_peered":"2024-08-17T02:27:21.807298+0000","last_unstale":"2024-08-17T02:27:21.824309+0000","last_undegraded":"2024-08-17T02:27:21.824309+0000","last_fullsized":"2024-08-17T02:27:21.824309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:31.309319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.793171+0000","last_change":"2024-08-17T02:27:20.791954+0000","last_active":"2024-08-17T02:27:21.793171+0000","last_peered":"2024-08-17T02:27:21.793171+0000","last_clean":"2024-08-17T02:27:21.793171+0000","last_became_active":"2024-08-17T02:27:20.791681+0000","last_became_peered":"2024-08-17T02:27:20.791681+0000","last_unstale":"2024-08-17T02:27:21.793171+0000","last_undegraded":"2024-08-17T02:27:21.793171+0000","last_fullsized":"2024-08-17T02:27:21.793171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:30.963557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.828359+0000","last_change":"2024-08-17T02:27:21.811614+0000","last_active":"2024-08-17T02:27:21.828359+0000","last_peered":"2024-08-17T02:27:21.828359+0000","last_clean":"2024-08-17T02:27:21.828359+0000","last_became_active":"2024-08-17T02:27:21.811356+0000","last_became_peered":"2024-08-17T02:27:21.811356+0000","last_unstale":"2024-08-17T02:27:21.828359+0000","last_undegraded":"2024-08-17T02:27:21.828359+0000","last_fullsized":"2024-08-17T02:27:21.828359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:07.015453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.797054+0000","last_change":"2024-08-17T02:27:20.797325+0000","last_active":"2024-08-17T02:27:21.797054+0000","last_peered":"2024-08-17T02:27:21.797054+0000","last_clean":"2024-08-17T02:27:21.797054+0000","last_became_active":"2024-08-17T02:27:20.797057+0000","last_became_peered":"2024-08-17T02:27:20.797057+0000","last_unstale":"2024-08-17T02:27:21.797054+0000","last_undegraded":"2024-08-17T02:27:21.797054+0000","last_fullsized":"2024-08-17T02:27:21.797054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:21.674458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.815967+0000","last_change":"2024-08-17T02:27:21.804661+0000","last_active":"2024-08-17T02:27:21.815967+0000","last_peered":"2024-08-17T02:27:21.815967+0000","last_clean":"2024-08-17T02:27:21.815967+0000","last_became_active":"2024-08-17T02:27:21.804379+0000","last_became_peered":"2024-08-17T02:27:21.804379+0000","last_unstale":"2024-08-17T02:27:21.815967+0000","last_undegraded":"2024-08-17T02:27:21.815967+0000","last_fullsized":"2024-08-17T02:27:21.815967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:07.015453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.793931+0000","last_change":"2024-08-17T02:27:20.797885+0000","last_active":"2024-08-17T02:27:21.793931+0000","last_peered":"2024-08-17T02:27:21.793931+0000","last_clean":"2024-08-17T02:27:21.793931+0000","last_became_active":"2024-08-17T02:27:20.797672+0000","last_became_peered":"2024-08-17T02:27:20.797672+0000","last_unstale":"2024-08-17T02:27:21.793931+0000","last_undegraded":"2024-08-17T02:27:21.793931+0000","last_fullsized":"2024-08-17T02:27:21.793931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:00:44.738835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.833000+0000","last_change":"2024-08-17T02:27:21.831408+0000","last_active":"2024-08-17T02:27:21.833000+0000","last_peered":"2024-08-17T02:27:21.833000+0000","last_clean":"2024-08-17T02:27:21.833000+0000","last_became_active":"2024-08-17T02:27:21.831184+0000","last_became_peered":"2024-08-17T02:27:21.831184+0000","last_unstale":"2024-08-17T02:27:21.833000+0000","last_undegraded":"2024-08-17T02:27:21.833000+0000","last_fullsized":"2024-08-17T02:27:21.833000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:13:43.709389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.799250+0000","last_change":"2024-08-17T02:27:20.808511+0000","last_active":"2024-08-17T02:27:21.799250+0000","last_peered":"2024-08-17T02:27:21.799250+0000","last_clean":"2024-08-17T02:27:21.799250+0000","last_became_active":"2024-08-17T02:27:20.808256+0000","last_became_peered":"2024-08-17T02:27:20.808256+0000","last_unstale":"2024-08-17T02:27:21.799250+0000","last_undegraded":"2024-08-17T02:27:21.799250+0000","last_fullsized":"2024-08-17T02:27:21.799250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:02.276190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.822879+0000","last_change":"2024-08-17T02:27:21.813150+0000","last_active":"2024-08-17T02:27:21.822879+0000","last_peered":"2024-08-17T02:27:21.822879+0000","last_clean":"2024-08-17T02:27:21.822879+0000","last_became_active":"2024-08-17T02:27:21.812828+0000","last_became_peered":"2024-08-17T02:27:21.812828+0000","last_unstale":"2024-08-17T02:27:21.822879+0000","last_undegraded":"2024-08-17T02:27:21.822879+0000","last_fullsized":"2024-08-17T02:27:21.822879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:42.139955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.835106+0000","last_change":"2024-08-17T02:27:20.801510+0000","last_active":"2024-08-17T02:27:21.835106+0000","last_peered":"2024-08-17T02:27:21.835106+0000","last_clean":"2024-08-17T02:27:21.835106+0000","last_became_active":"2024-08-17T02:27:20.801194+0000","last_became_peered":"2024-08-17T02:27:20.801194+0000","last_unstale":"2024-08-17T02:27:21.835106+0000","last_undegraded":"2024-08-17T02:27:21.835106+0000","last_fullsized":"2024-08-17T02:27:21.835106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:38:57.188098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834433+0000","last_change":"2024-08-17T02:27:21.830058+0000","last_active":"2024-08-17T02:27:21.834433+0000","last_peered":"2024-08-17T02:27:21.834433+0000","last_clean":"2024-08-17T02:27:21.834433+0000","last_became_active":"2024-08-17T02:27:21.829779+0000","last_became_peered":"2024-08-17T02:27:21.829779+0000","last_unstale":"2024-08-17T02:27:21.834433+0000","last_undegraded":"2024-08-17T02:27:21.834433+0000","last_fullsized":"2024-08-17T02:27:21.834433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:38:13.150669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.836841+0000","last_change":"2024-08-17T02:27:20.802218+0000","last_active":"2024-08-17T02:27:21.836841+0000","last_peered":"2024-08-17T02:27:21.836841+0000","last_clean":"2024-08-17T02:27:21.836841+0000","last_became_active":"2024-08-17T02:27:20.801962+0000","last_became_peered":"2024-08-17T02:27:20.801962+0000","last_unstale":"2024-08-17T02:27:21.836841+0000","last_undegraded":"2024-08-17T02:27:21.836841+0000","last_fullsized":"2024-08-17T02:27:21.836841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:20:29.352321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.830528+0000","last_change":"2024-08-17T02:27:21.820346+0000","last_active":"2024-08-17T02:27:21.830528+0000","last_peered":"2024-08-17T02:27:21.830528+0000","last_clean":"2024-08-17T02:27:21.830528+0000","last_became_active":"2024-08-17T02:27:21.820060+0000","last_became_peered":"2024-08-17T02:27:21.820060+0000","last_unstale":"2024-08-17T02:27:21.830528+0000","last_undegraded":"2024-08-17T02:27:21.830528+0000","last_fullsized":"2024-08-17T02:27:21.830528+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:40:21.513275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.832165+0000","last_change":"2024-08-17T02:27:20.796104+0000","last_active":"2024-08-17T02:27:21.832165+0000","last_peered":"2024-08-17T02:27:21.832165+0000","last_clean":"2024-08-17T02:27:21.832165+0000","last_became_active":"2024-08-17T02:27:20.795846+0000","last_became_peered":"2024-08-17T02:27:20.795846+0000","last_unstale":"2024-08-17T02:27:21.832165+0000","last_undegraded":"2024-08-17T02:27:21.832165+0000","last_fullsized":"2024-08-17T02:27:21.832165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:49.744867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.807116+0000","last_change":"2024-08-17T02:27:21.805170+0000","last_active":"2024-08-17T02:27:21.807116+0000","last_peered":"2024-08-17T02:27:21.807116+0000","last_clean":"2024-08-17T02:27:21.807116+0000","last_became_active":"2024-08-17T02:27:21.804909+0000","last_became_peered":"2024-08-17T02:27:21.804909+0000","last_unstale":"2024-08-17T02:27:21.807116+0000","last_undegraded":"2024-08-17T02:27:21.807116+0000","last_fullsized":"2024-08-17T02:27:21.807116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:36:33.357094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.804336+0000","last_change":"2024-08-17T02:27:20.804761+0000","last_active":"2024-08-17T02:27:21.804336+0000","last_peered":"2024-08-17T02:27:21.804336+0000","last_clean":"2024-08-17T02:27:21.804336+0000","last_became_active":"2024-08-17T02:27:20.804494+0000","last_became_peered":"2024-08-17T02:27:20.804494+0000","last_unstale":"2024-08-17T02:27:21.804336+0000","last_undegraded":"2024-08-17T02:27:21.804336+0000","last_fullsized":"2024-08-17T02:27:21.804336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:50.037093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834656+0000","last_change":"2024-08-17T02:27:21.827257+0000","last_active":"2024-08-17T02:27:21.834656+0000","last_peered":"2024-08-17T02:27:21.834656+0000","last_clean":"2024-08-17T02:27:21.834656+0000","last_became_active":"2024-08-17T02:27:21.826930+0000","last_became_peered":"2024-08-17T02:27:21.826930+0000","last_unstale":"2024-08-17T02:27:21.834656+0000","last_undegraded":"2024-08-17T02:27:21.834656+0000","last_fullsized":"2024-08-17T02:27:21.834656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:51.514747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.792575+0000","last_change":"2024-08-17T02:27:20.794736+0000","last_active":"2024-08-17T02:27:21.792575+0000","last_peered":"2024-08-17T02:27:21.792575+0000","last_clean":"2024-08-17T02:27:21.792575+0000","last_became_active":"2024-08-17T02:27:20.794063+0000","last_became_peered":"2024-08-17T02:27:20.794063+0000","last_unstale":"2024-08-17T02:27:21.792575+0000","last_undegraded":"2024-08-17T02:27:21.792575+0000","last_fullsized":"2024-08-17T02:27:21.792575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:38:57.188098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.819815+0000","last_change":"2024-08-17T02:27:21.816628+0000","last_active":"2024-08-17T02:27:21.819815+0000","last_peered":"2024-08-17T02:27:21.819815+0000","last_clean":"2024-08-17T02:27:21.819815+0000","last_became_active":"2024-08-17T02:27:21.816329+0000","last_became_peered":"2024-08-17T02:27:21.816329+0000","last_unstale":"2024-08-17T02:27:21.819815+0000","last_undegraded":"2024-08-17T02:27:21.819815+0000","last_fullsized":"2024-08-17T02:27:21.819815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:00:45.746724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.835244+0000","last_change":"2024-08-17T02:27:20.801402+0000","last_active":"2024-08-17T02:27:21.835244+0000","last_peered":"2024-08-17T02:27:21.835244+0000","last_clean":"2024-08-17T02:27:21.835244+0000","last_became_active":"2024-08-17T02:27:20.798120+0000","last_became_peered":"2024-08-17T02:27:20.798120+0000","last_unstale":"2024-08-17T02:27:21.835244+0000","last_undegraded":"2024-08-17T02:27:21.835244+0000","last_fullsized":"2024-08-17T02:27:21.835244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:22.382400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.831861+0000","last_change":"2024-08-17T02:27:21.825794+0000","last_active":"2024-08-17T02:27:21.831861+0000","last_peered":"2024-08-17T02:27:21.831861+0000","last_clean":"2024-08-17T02:27:21.831861+0000","last_became_active":"2024-08-17T02:27:21.821382+0000","last_became_peered":"2024-08-17T02:27:21.821382+0000","last_unstale":"2024-08-17T02:27:21.831861+0000","last_undegraded":"2024-08-17T02:27:21.831861+0000","last_fullsized":"2024-08-17T02:27:21.831861+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:41:05.227602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.828679+0000","last_change":"2024-08-17T02:27:20.803075+0000","last_active":"2024-08-17T02:27:21.828679+0000","last_peered":"2024-08-17T02:27:21.828679+0000","last_clean":"2024-08-17T02:27:21.828679+0000","last_became_active":"2024-08-17T02:27:20.802760+0000","last_became_peered":"2024-08-17T02:27:20.802760+0000","last_unstale":"2024-08-17T02:27:21.828679+0000","last_undegraded":"2024-08-17T02:27:21.828679+0000","last_fullsized":"2024-08-17T02:27:21.828679+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:02.276190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.820604+0000","last_change":"2024-08-17T02:27:21.816958+0000","last_active":"2024-08-17T02:27:21.820604+0000","last_peered":"2024-08-17T02:27:21.820604+0000","last_clean":"2024-08-17T02:27:21.820604+0000","last_became_active":"2024-08-17T02:27:21.816343+0000","last_became_peered":"2024-08-17T02:27:21.816343+0000","last_unstale":"2024-08-17T02:27:21.820604+0000","last_undegraded":"2024-08-17T02:27:21.820604+0000","last_fullsized":"2024-08-17T02:27:21.820604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:19.145353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.829506+0000","last_change":"2024-08-17T02:27:20.800209+0000","last_active":"2024-08-17T02:27:21.829506+0000","last_peered":"2024-08-17T02:27:21.829506+0000","last_clean":"2024-08-17T02:27:21.829506+0000","last_became_active":"2024-08-17T02:27:20.799907+0000","last_became_peered":"2024-08-17T02:27:20.799907+0000","last_unstale":"2024-08-17T02:27:21.829506+0000","last_undegraded":"2024-08-17T02:27:21.829506+0000","last_fullsized":"2024-08-17T02:27:21.829506+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:09.295691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834256+0000","last_change":"2024-08-17T02:27:21.830578+0000","last_active":"2024-08-17T02:27:21.834256+0000","last_peered":"2024-08-17T02:27:21.834256+0000","last_clean":"2024-08-17T02:27:21.834256+0000","last_became_active":"2024-08-17T02:27:21.830125+0000","last_became_peered":"2024-08-17T02:27:21.830125+0000","last_unstale":"2024-08-17T02:27:21.834256+0000","last_undegraded":"2024-08-17T02:27:21.834256+0000","last_fullsized":"2024-08-17T02:27:21.834256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:41:05.227602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.824993+0000","last_change":"2024-08-17T02:27:20.800306+0000","last_active":"2024-08-17T02:27:21.824993+0000","last_peered":"2024-08-17T02:27:21.824993+0000","last_clean":"2024-08-17T02:27:21.824993+0000","last_became_active":"2024-08-17T02:27:20.800024+0000","last_became_peered":"2024-08-17T02:27:20.800024+0000","last_unstale":"2024-08-17T02:27:21.824993+0000","last_undegraded":"2024-08-17T02:27:21.824993+0000","last_fullsized":"2024-08-17T02:27:21.824993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:09.415412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.824484+0000","last_change":"2024-08-17T02:27:21.821992+0000","last_active":"2024-08-17T02:27:21.824484+0000","last_peered":"2024-08-17T02:27:21.824484+0000","last_clean":"2024-08-17T02:27:21.824484+0000","last_became_active":"2024-08-17T02:27:21.815906+0000","last_became_peered":"2024-08-17T02:27:21.815906+0000","last_unstale":"2024-08-17T02:27:21.824484+0000","last_undegraded":"2024-08-17T02:27:21.824484+0000","last_fullsized":"2024-08-17T02:27:21.824484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:50.752756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.806216+0000","last_change":"2024-08-17T02:27:20.804253+0000","last_active":"2024-08-17T02:27:21.806216+0000","last_peered":"2024-08-17T02:27:21.806216+0000","last_clean":"2024-08-17T02:27:21.806216+0000","last_became_active":"2024-08-17T02:27:20.803327+0000","last_became_peered":"2024-08-17T02:27:20.803327+0000","last_unstale":"2024-08-17T02:27:21.806216+0000","last_undegraded":"2024-08-17T02:27:21.806216+0000","last_fullsized":"2024-08-17T02:27:21.806216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:50.230330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.823162+0000","last_change":"2024-08-17T02:27:21.821628+0000","last_active":"2024-08-17T02:27:21.823162+0000","last_peered":"2024-08-17T02:27:21.823162+0000","last_clean":"2024-08-17T02:27:21.823162+0000","last_became_active":"2024-08-17T02:27:21.821412+0000","last_became_peered":"2024-08-17T02:27:21.821412+0000","last_unstale":"2024-08-17T02:27:21.823162+0000","last_undegraded":"2024-08-17T02:27:21.823162+0000","last_fullsized":"2024-08-17T02:27:21.823162+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:10.303580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.829761+0000","last_change":"2024-08-17T02:27:20.806200+0000","last_active":"2024-08-17T02:27:21.829761+0000","last_peered":"2024-08-17T02:27:21.829761+0000","last_clean":"2024-08-17T02:27:21.829761+0000","last_became_active":"2024-08-17T02:27:20.805923+0000","last_became_peered":"2024-08-17T02:27:20.805923+0000","last_unstale":"2024-08-17T02:27:21.829761+0000","last_undegraded":"2024-08-17T02:27:21.829761+0000","last_fullsized":"2024-08-17T02:27:21.829761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:03:53.869185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.822394+0000","last_change":"2024-08-17T02:27:21.819243+0000","last_active":"2024-08-17T02:27:21.822394+0000","last_peered":"2024-08-17T02:27:21.822394+0000","last_clean":"2024-08-17T02:27:21.822394+0000","last_became_active":"2024-08-17T02:27:21.811653+0000","last_became_peered":"2024-08-17T02:27:21.811653+0000","last_unstale":"2024-08-17T02:27:21.822394+0000","last_undegraded":"2024-08-17T02:27:21.822394+0000","last_fullsized":"2024-08-17T02:27:21.822394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:10.423301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.799145+0000","last_change":"2024-08-17T02:27:20.808867+0000","last_active":"2024-08-17T02:27:21.799145+0000","last_peered":"2024-08-17T02:27:21.799145+0000","last_clean":"2024-08-17T02:27:21.799145+0000","last_became_active":"2024-08-17T02:27:20.808636+0000","last_became_peered":"2024-08-17T02:27:20.808636+0000","last_unstale":"2024-08-17T02:27:21.799145+0000","last_undegraded":"2024-08-17T02:27:21.799145+0000","last_fullsized":"2024-08-17T02:27:21.799145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:21.674458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.821337+0000","last_change":"2024-08-17T02:27:21.804922+0000","last_active":"2024-08-17T02:27:21.821337+0000","last_peered":"2024-08-17T02:27:21.821337+0000","last_clean":"2024-08-17T02:27:21.821337+0000","last_became_active":"2024-08-17T02:27:21.804650+0000","last_became_peered":"2024-08-17T02:27:21.804650+0000","last_unstale":"2024-08-17T02:27:21.821337+0000","last_undegraded":"2024-08-17T02:27:21.821337+0000","last_fullsized":"2024-08-17T02:27:21.821337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:22.682347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.802210+0000","last_change":"2024-08-17T02:27:20.796106+0000","last_active":"2024-08-17T02:27:21.802210+0000","last_peered":"2024-08-17T02:27:21.802210+0000","last_clean":"2024-08-17T02:27:21.802210+0000","last_became_active":"2024-08-17T02:27:20.795831+0000","last_became_peered":"2024-08-17T02:27:20.795831+0000","last_unstale":"2024-08-17T02:27:21.802210+0000","last_undegraded":"2024-08-17T02:27:21.802210+0000","last_fullsized":"2024-08-17T02:27:21.802210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:11:31.809137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834486+0000","last_change":"2024-08-17T02:27:21.820666+0000","last_active":"2024-08-17T02:27:21.834486+0000","last_peered":"2024-08-17T02:27:21.834486+0000","last_clean":"2024-08-17T02:27:21.834486+0000","last_became_active":"2024-08-17T02:27:21.820173+0000","last_became_peered":"2024-08-17T02:27:21.820173+0000","last_unstale":"2024-08-17T02:27:21.834486+0000","last_undegraded":"2024-08-17T02:27:21.834486+0000","last_fullsized":"2024-08-17T02:27:21.834486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:36:33.357094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.796520+0000","last_change":"2024-08-17T02:27:20.804357+0000","last_active":"2024-08-17T02:27:21.796520+0000","last_peered":"2024-08-17T02:27:21.796520+0000","last_clean":"2024-08-17T02:27:21.796520+0000","last_became_active":"2024-08-17T02:27:20.803986+0000","last_became_peered":"2024-08-17T02:27:20.803986+0000","last_unstale":"2024-08-17T02:27:21.796520+0000","last_undegraded":"2024-08-17T02:27:21.796520+0000","last_fullsized":"2024-08-17T02:27:21.796520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:47:47.470339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.819603+0000","last_change":"2024-08-17T02:27:21.810062+0000","last_active":"2024-08-17T02:27:21.819603+0000","last_peered":"2024-08-17T02:27:21.819603+0000","last_clean":"2024-08-17T02:27:21.819603+0000","last_became_active":"2024-08-17T02:27:21.809768+0000","last_became_peered":"2024-08-17T02:27:21.809768+0000","last_unstale":"2024-08-17T02:27:21.819603+0000","last_undegraded":"2024-08-17T02:27:21.819603+0000","last_fullsized":"2024-08-17T02:27:21.819603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:40:40.512394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.828595+0000","last_change":"2024-08-17T02:27:20.800990+0000","last_active":"2024-08-17T02:27:21.828595+0000","last_peered":"2024-08-17T02:27:21.828595+0000","last_clean":"2024-08-17T02:27:21.828595+0000","last_became_active":"2024-08-17T02:27:20.800645+0000","last_became_peered":"2024-08-17T02:27:20.800645+0000","last_unstale":"2024-08-17T02:27:21.828595+0000","last_undegraded":"2024-08-17T02:27:21.828595+0000","last_fullsized":"2024-08-17T02:27:21.828595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:03:53.869185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.832028+0000","last_change":"2024-08-17T02:27:21.828297+0000","last_active":"2024-08-17T02:27:21.832028+0000","last_peered":"2024-08-17T02:27:21.832028+0000","last_clean":"2024-08-17T02:27:21.832028+0000","last_became_active":"2024-08-17T02:27:21.827604+0000","last_became_peered":"2024-08-17T02:27:21.827604+0000","last_unstale":"2024-08-17T02:27:21.832028+0000","last_undegraded":"2024-08-17T02:27:21.832028+0000","last_fullsized":"2024-08-17T02:27:21.832028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:14:55.984318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.833156+0000","last_change":"2024-08-17T02:27:20.806418+0000","last_active":"2024-08-17T02:27:22.833156+0000","last_peered":"2024-08-17T02:27:22.833156+0000","last_clean":"2024-08-17T02:27:22.833156+0000","last_became_active":"2024-08-17T02:27:20.805980+0000","last_became_peered":"2024-08-17T02:27:20.805980+0000","last_unstale":"2024-08-17T02:27:22.833156+0000","last_undegraded":"2024-08-17T02:27:22.833156+0000","last_fullsized":"2024-08-17T02:27:22.833156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:40:39.504505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.830099+0000","last_change":"2024-08-17T02:27:21.827812+0000","last_active":"2024-08-17T02:27:21.830099+0000","last_peered":"2024-08-17T02:27:21.830099+0000","last_clean":"2024-08-17T02:27:21.830099+0000","last_became_active":"2024-08-17T02:27:21.827347+0000","last_became_peered":"2024-08-17T02:27:21.827347+0000","last_unstale":"2024-08-17T02:27:21.830099+0000","last_undegraded":"2024-08-17T02:27:21.830099+0000","last_fullsized":"2024-08-17T02:27:21.830099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:31.309319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.803678+0000","last_change":"2024-08-17T02:27:20.800940+0000","last_active":"2024-08-17T02:27:21.803678+0000","last_peered":"2024-08-17T02:27:21.803678+0000","last_clean":"2024-08-17T02:27:21.803678+0000","last_became_active":"2024-08-17T02:27:20.800689+0000","last_became_peered":"2024-08-17T02:27:20.800689+0000","last_unstale":"2024-08-17T02:27:21.803678+0000","last_undegraded":"2024-08-17T02:27:21.803678+0000","last_fullsized":"2024-08-17T02:27:21.803678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:09.415412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.809890+0000","last_change":"2024-08-17T02:27:21.805751+0000","last_active":"2024-08-17T02:27:21.809890+0000","last_peered":"2024-08-17T02:27:21.809890+0000","last_clean":"2024-08-17T02:27:21.809890+0000","last_became_active":"2024-08-17T02:27:21.804753+0000","last_became_peered":"2024-08-17T02:27:21.804753+0000","last_unstale":"2024-08-17T02:27:21.809890+0000","last_undegraded":"2024-08-17T02:27:21.809890+0000","last_fullsized":"2024-08-17T02:27:21.809890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:31.971446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.797389+0000","last_change":"2024-08-17T02:27:20.802441+0000","last_active":"2024-08-17T02:27:21.797389+0000","last_peered":"2024-08-17T02:27:21.797389+0000","last_clean":"2024-08-17T02:27:21.797389+0000","last_became_active":"2024-08-17T02:27:20.801600+0000","last_became_peered":"2024-08-17T02:27:20.801600+0000","last_unstale":"2024-08-17T02:27:21.797389+0000","last_undegraded":"2024-08-17T02:27:21.797389+0000","last_fullsized":"2024-08-17T02:27:21.797389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:22:26.226678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.808196+0000","last_change":"2024-08-17T02:27:21.805922+0000","last_active":"2024-08-17T02:27:21.808196+0000","last_peered":"2024-08-17T02:27:21.808196+0000","last_clean":"2024-08-17T02:27:21.808196+0000","last_became_active":"2024-08-17T02:27:21.805642+0000","last_became_peered":"2024-08-17T02:27:21.805642+0000","last_unstale":"2024-08-17T02:27:21.808196+0000","last_undegraded":"2024-08-17T02:27:21.808196+0000","last_fullsized":"2024-08-17T02:27:21.808196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:20:30.360210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.804558+0000","last_change":"2024-08-17T02:27:20.801331+0000","last_active":"2024-08-17T02:27:21.804558+0000","last_peered":"2024-08-17T02:27:21.804558+0000","last_clean":"2024-08-17T02:27:21.804558+0000","last_became_active":"2024-08-17T02:27:20.801092+0000","last_became_peered":"2024-08-17T02:27:20.801092+0000","last_unstale":"2024-08-17T02:27:21.804558+0000","last_undegraded":"2024-08-17T02:27:21.804558+0000","last_fullsized":"2024-08-17T02:27:21.804558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:40:39.504505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.807578+0000","last_change":"2024-08-17T02:27:21.805921+0000","last_active":"2024-08-17T02:27:21.807578+0000","last_peered":"2024-08-17T02:27:21.807578+0000","last_clean":"2024-08-17T02:27:21.807578+0000","last_became_active":"2024-08-17T02:27:21.805637+0000","last_became_peered":"2024-08-17T02:27:21.805637+0000","last_unstale":"2024-08-17T02:27:21.807578+0000","last_undegraded":"2024-08-17T02:27:21.807578+0000","last_fullsized":"2024-08-17T02:27:21.807578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:14:55.984318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.802222+0000","last_change":"2024-08-17T02:27:20.798405+0000","last_active":"2024-08-17T02:27:21.802222+0000","last_peered":"2024-08-17T02:27:21.802222+0000","last_clean":"2024-08-17T02:27:21.802222+0000","last_became_active":"2024-08-17T02:27:20.798156+0000","last_became_peered":"2024-08-17T02:27:20.798156+0000","last_unstale":"2024-08-17T02:27:21.802222+0000","last_undegraded":"2024-08-17T02:27:21.802222+0000","last_fullsized":"2024-08-17T02:27:21.802222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:40:39.504505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.823784+0000","last_change":"2024-08-17T02:27:21.812505+0000","last_active":"2024-08-17T02:27:21.823784+0000","last_peered":"2024-08-17T02:27:21.823784+0000","last_clean":"2024-08-17T02:27:21.823784+0000","last_became_active":"2024-08-17T02:27:21.812190+0000","last_became_peered":"2024-08-17T02:27:21.812190+0000","last_unstale":"2024-08-17T02:27:21.823784+0000","last_undegraded":"2024-08-17T02:27:21.823784+0000","last_fullsized":"2024-08-17T02:27:21.823784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:14:55.984318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.792578+0000","last_change":"2024-08-17T02:27:20.798944+0000","last_active":"2024-08-17T02:27:21.792578+0000","last_peered":"2024-08-17T02:27:21.792578+0000","last_clean":"2024-08-17T02:27:21.792578+0000","last_became_active":"2024-08-17T02:27:20.798405+0000","last_became_peered":"2024-08-17T02:27:20.798405+0000","last_unstale":"2024-08-17T02:27:21.792578+0000","last_undegraded":"2024-08-17T02:27:21.792578+0000","last_fullsized":"2024-08-17T02:27:21.792578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:47:47.470339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.834530+0000","last_change":"2024-08-17T02:27:21.822803+0000","last_active":"2024-08-17T02:27:21.834530+0000","last_peered":"2024-08-17T02:27:21.834530+0000","last_clean":"2024-08-17T02:27:21.834530+0000","last_became_active":"2024-08-17T02:27:21.822540+0000","last_became_peered":"2024-08-17T02:27:21.822540+0000","last_unstale":"2024-08-17T02:27:21.834530+0000","last_undegraded":"2024-08-17T02:27:21.834530+0000","last_fullsized":"2024-08-17T02:27:21.834530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.775576+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.775576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:13:43.709389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.799148+0000","last_change":"2024-08-17T02:27:20.810731+0000","last_active":"2024-08-17T02:27:21.799148+0000","last_peered":"2024-08-17T02:27:21.799148+0000","last_clean":"2024-08-17T02:27:21.799148+0000","last_became_active":"2024-08-17T02:27:20.810454+0000","last_became_peered":"2024-08-17T02:27:20.810454+0000","last_unstale":"2024-08-17T02:27:21.799148+0000","last_undegraded":"2024-08-17T02:27:21.799148+0000","last_fullsized":"2024-08-17T02:27:21.799148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:19.767687+0000","last_clean_scrub_stamp":"2024-08-17T02:27:19.767687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:22:26.226678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:27:21.811403+0000","last_change":"2024-08-17T02:26:27.275086+0000","last_active":"2024-08-17T02:27:21.811403+0000","last_peered":"2024-08-17T02:27:21.811403+0000","last_clean":"2024-08-17T02:27:21.811403+0000","last_became_active":"2024-08-17T02:26:27.274075+0000","last_became_peered":"2024-08-17T02:26:27.274075+0000","last_unstale":"2024-08-17T02:27:21.811403+0000","last_undegraded":"2024-08-17T02:27:21.811403+0000","last_fullsized":"2024-08-17T02:27:21.811403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_clean_scrub_stamp":"2024-08-17T02:26:26.139133+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:52.161982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":958464,"data_stored":728831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":138977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":139033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":3.3130000000000002,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":4.0670000000000002,"5min":4.0670000000000002,"15min":4.0670000000000002},"last":0.82899999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.74299999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.71999999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66300000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68700000000000006}]},{"osd":7,"last update":"Sat Aug 17 02:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.86299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":138477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":376832,"data_stored":139947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074128,"statfs":{"total":96636764160,"available":96331907072,"internally_reserved":0,"allocated":364544,"data_stored":138443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":376832,"data_stored":139947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298296,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073544,"statfs":{"total":96636764160,"available":96331309056,"internally_reserved":0,"allocated":954368,"data_stored":728741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:26.407 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:27:26.408 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:27:26.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.601+0000 7f7897a00640 1 Processor -- start 2024-08-17T02:27:26.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.601+0000 7f7897a00640 1 -- start start 2024-08-17T02:27:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.602+0000 7f7897a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f78900ca050 0x7f7890156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.602+0000 7f7897a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f78900add30 0x7f789015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.602+0000 7f7897a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789015b5e0 con 0x7f78900ad960 2024-08-17T02:27:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.602+0000 7f7897a00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78900cb160 con 0x7f78900ca050 2024-08-17T02:27:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.602+0000 7f7897a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78900b0d10 con 0x7f78900add30 2024-08-17T02:27:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.603+0000 7f788fe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f78900ca050 0x7f7890156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.603+0000 7f7895a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f78900add30 0x7f789015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.603+0000 7f7895000640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f78900ad960 0x7f7890156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:39020/0 (socket says 172.21.15.6:39020) 2024-08-17T02:27:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.603+0000 7f7895000640 1 -- 172.21.15.6:0/150458122 learned_addr learned my addr 172.21.15.6:0/150458122 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.604+0000 7f788fe00640 1 -- 172.21.15.6:0/150458122 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f78900add30 msgr2=0x7f789015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.604+0000 7f788fe00640 1 --2- 172.21.15.6:0/150458122 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f78900add30 0x7f789015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.604+0000 7f788fe00640 1 -- 172.21.15.6:0/150458122 >> v1:172.21.15.136:6789/0 conn(0x7f78900ad960 legacy=0x7f7890156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.604+0000 7f788fe00640 1 -- 172.21.15.6:0/150458122 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78900ca550 con 0x7f78900ca050 2024-08-17T02:27:26.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.605+0000 7f788fe00640 1 --2- 172.21.15.6:0/150458122 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78900ca050 0x7f7890156b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f787c009850 tx=0x7f787c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8033abdf8019293 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.605+0000 7f788f400640 1 -- 172.21.15.6:0/150458122 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c02ae10 con 0x7f78900ca050 2024-08-17T02:27:26.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.606+0000 7f788f400640 1 -- 172.21.15.6:0/150458122 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c032440 con 0x7f78900ca050 2024-08-17T02:27:26.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.606+0000 7f788f400640 1 -- 172.21.15.6:0/150458122 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c032820 con 0x7f78900ca050 2024-08-17T02:27:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.606+0000 7f7897a00640 1 -- 172.21.15.6:0/150458122 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78900ca050 msgr2=0x7f7890156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.606+0000 7f7897a00640 1 --2- 172.21.15.6:0/150458122 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78900ca050 0x7f7890156b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f787c009850 tx=0x7f787c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.606+0000 7f7897a00640 1 -- 172.21.15.6:0/150458122 shutdown_connections 2024-08-17T02:27:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.606+0000 7f7897a00640 1 --2- 172.21.15.6:0/150458122 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f78900add30 0x7f789015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.606+0000 7f7897a00640 1 --2- 172.21.15.6:0/150458122 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78900ca050 0x7f7890156b30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.606+0000 7f7897a00640 1 -- 172.21.15.6:0/150458122 >> 172.21.15.6:0/150458122 conn(0x7f7890066e60 msgr2=0x7f7890067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.606+0000 7f7897a00640 1 -- 172.21.15.6:0/150458122 shutdown_connections 2024-08-17T02:27:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.606+0000 7f7897a00640 1 -- 172.21.15.6:0/150458122 wait complete. 2024-08-17T02:27:26.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.608+0000 7f7897a00640 1 Processor -- start 2024-08-17T02:27:26.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.608+0000 7f7897a00640 1 -- start start 2024-08-17T02:27:26.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.608+0000 7f7897a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78900ad960 0x7f789014bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.608+0000 7f7897a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f78900add30 0x7f7890151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.608+0000 7f7897a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78900ca050 0x7f78901518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.608+0000 7f7897a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7890152770 con 0x7f78900ad960 2024-08-17T02:27:26.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.608+0000 7f7897a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7890164e90 con 0x7f78900ca050 2024-08-17T02:27:26.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.609+0000 7f7897a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7890157d50 con 0x7f78900add30 2024-08-17T02:27:26.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.609+0000 7f7895000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78900ad960 0x7f789014bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.609+0000 7f7895000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78900ad960 0x7f789014bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41154/0 (socket says 172.21.15.6:41154) 2024-08-17T02:27:26.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.609+0000 7f7895000640 1 -- 172.21.15.6:0/514234234 learned_addr learned my addr 172.21.15.6:0/514234234 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:26.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.609+0000 7f788fe00640 1 --2- 172.21.15.6:0/514234234 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f78900add30 0x7f7890151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.609+0000 7f7895a00640 1 --2- 172.21.15.6:0/514234234 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78900ca050 0x7f78901518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.609+0000 7f7895000640 1 -- 172.21.15.6:0/514234234 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f78900add30 msgr2=0x7f7890151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.609+0000 7f7895000640 1 --2- 172.21.15.6:0/514234234 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f78900add30 0x7f7890151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.609+0000 7f7895000640 1 -- 172.21.15.6:0/514234234 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78900ca050 msgr2=0x7f78901518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.609+0000 7f7895000640 1 --2- 172.21.15.6:0/514234234 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78900ca050 0x7f78901518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.609+0000 7f7895000640 1 -- 172.21.15.6:0/514234234 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c009390 con 0x7f78900ad960 2024-08-17T02:27:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.610+0000 7f7895000640 1 --2- 172.21.15.6:0/514234234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78900ad960 0x7f789014bf30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f788400c5c0 tx=0x7f7884007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.610+0000 7f7883e00640 1 -- 172.21.15.6:0/514234234 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884005aa0 con 0x7f78900ad960 2024-08-17T02:27:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.610+0000 7f7883e00640 1 -- 172.21.15.6:0/514234234 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7884005c20 con 0x7f78900ad960 2024-08-17T02:27:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.610+0000 7f7897a00640 1 -- 172.21.15.6:0/514234234 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f789014c470 con 0x7f78900ad960 2024-08-17T02:27:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.610+0000 7f7883e00640 1 -- 172.21.15.6:0/514234234 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840070f0 con 0x7f78900ad960 2024-08-17T02:27:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.610+0000 7f7897a00640 1 -- 172.21.15.6:0/514234234 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78901521b0 con 0x7f78900ad960 2024-08-17T02:27:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.611+0000 7f7897a00640 1 -- 172.21.15.6:0/514234234 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7890063fb0 con 0x7f78900ad960 2024-08-17T02:27:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.612+0000 7f7883e00640 1 -- 172.21.15.6:0/514234234 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7884007520 con 0x7f78900ad960 2024-08-17T02:27:26.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.613+0000 7f7883e00640 1 --2- 172.21.15.6:0/514234234 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7870065150 0x7f7870067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.613+0000 7f7883e00640 1 -- 172.21.15.6:0/514234234 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f78840815c0 con 0x7f78900ad960 2024-08-17T02:27:26.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.613+0000 7f788fe00640 1 --2- 172.21.15.6:0/514234234 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7870065150 0x7f7870067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.614+0000 7f788fe00640 1 --2- 172.21.15.6:0/514234234 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7870065150 0x7f7870067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f787c034000 tx=0x7f787c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.616+0000 7f7883e00640 1 -- 172.21.15.6:0/514234234 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f788404f710 con 0x7f78900ad960 2024-08-17T02:27:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.864+0000 7f7897a00640 1 -- 172.21.15.6:0/514234234 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f789015b5e0 con 0x7f78900ad960 2024-08-17T02:27:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.869+0000 7f7883e00640 1 -- 172.21.15.6:0/514234234 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f789015b5e0 con 0x7f78900ad960 2024-08-17T02:27:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2024-08-17T02:27:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.871+0000 7f7897a00640 1 -- 172.21.15.6:0/514234234 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7870065150 msgr2=0x7f7870067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.872+0000 7f7897a00640 1 --2- 172.21.15.6:0/514234234 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7870065150 0x7f7870067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f787c034000 tx=0x7f787c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.872+0000 7f7897a00640 1 -- 172.21.15.6:0/514234234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78900ad960 msgr2=0x7f789014bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.872+0000 7f7897a00640 1 --2- 172.21.15.6:0/514234234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78900ad960 0x7f789014bf30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f788400c5c0 tx=0x7f7884007ee0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.872+0000 7f7897a00640 1 -- 172.21.15.6:0/514234234 shutdown_connections 2024-08-17T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.872+0000 7f7897a00640 1 --2- 172.21.15.6:0/514234234 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7870065150 0x7f7870067600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.872+0000 7f7897a00640 1 --2- 172.21.15.6:0/514234234 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78900ca050 0x7f78901518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.872+0000 7f7897a00640 1 --2- 172.21.15.6:0/514234234 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f78900add30 0x7f7890151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.872+0000 7f7897a00640 1 --2- 172.21.15.6:0/514234234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78900ad960 0x7f789014bf30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.872+0000 7f7897a00640 1 -- 172.21.15.6:0/514234234 >> 172.21.15.6:0/514234234 conn(0x7f7890066e60 msgr2=0x7f789015a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.872+0000 7f7897a00640 1 -- 172.21.15.6:0/514234234 shutdown_connections 2024-08-17T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:26.872+0000 7f7897a00640 1 -- 172.21.15.6:0/514234234 wait complete. 2024-08-17T02:27:26.888 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:27.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.040+0000 7fa967200640 1 Processor -- start 2024-08-17T02:27:27.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.040+0000 7fa967200640 1 -- start start 2024-08-17T02:27:27.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.041+0000 7fa967200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9600ae4a0 0x7fa9600abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.041+0000 7fa967200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9600ac2e0 0x7fa960068770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.041+0000 7fa967200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9600682e0 con 0x7fa960158bf0 2024-08-17T02:27:27.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.041+0000 7fa967200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9600afa40 con 0x7fa9600ae4a0 2024-08-17T02:27:27.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.041+0000 7fa967200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600ac720 con 0x7fa9600ac2e0 2024-08-17T02:27:27.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.041+0000 7fa965400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9600ae4a0 0x7fa9600abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.041+0000 7fa965e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa960158bf0 0x7fa9600af330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56658/0 (socket says 172.21.15.6:56658) 2024-08-17T02:27:27.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.041+0000 7fa965e00640 1 -- 172.21.15.6:0/2998954922 learned_addr learned my addr 172.21.15.6:0/2998954922 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:27.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.041+0000 7fa966800640 1 --2- 172.21.15.6:0/2998954922 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9600ac2e0 0x7fa960068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.042+0000 7fa965400640 1 -- 172.21.15.6:0/2998954922 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9600ac2e0 msgr2=0x7fa960068770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:27.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.042+0000 7fa965400640 1 --2- 172.21.15.6:0/2998954922 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9600ac2e0 0x7fa960068770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.042+0000 7fa965400640 1 -- 172.21.15.6:0/2998954922 >> v1:172.21.15.6:6789/0 conn(0x7fa960158bf0 legacy=0x7fa9600af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.042+0000 7fa965400640 1 -- 172.21.15.6:0/2998954922 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9600afca0 con 0x7fa9600ae4a0 2024-08-17T02:27:27.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.043+0000 7fa965400640 1 --2- 172.21.15.6:0/2998954922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9600ae4a0 0x7fa9600abda0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa950009850 tx=0x7fa9500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8f72b2732aec42 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.043+0000 7fa964a00640 1 -- 172.21.15.6:0/2998954922 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95002ad90 con 0x7fa9600ae4a0 2024-08-17T02:27:27.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.043+0000 7fa964a00640 1 -- 172.21.15.6:0/2998954922 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa950032440 con 0x7fa9600ae4a0 2024-08-17T02:27:27.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.043+0000 7fa964a00640 1 -- 172.21.15.6:0/2998954922 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa950032820 con 0x7fa9600ae4a0 2024-08-17T02:27:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.043+0000 7fa967200640 1 -- 172.21.15.6:0/2998954922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9600ae4a0 msgr2=0x7fa9600abda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.043+0000 7fa967200640 1 --2- 172.21.15.6:0/2998954922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9600ae4a0 0x7fa9600abda0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa950009850 tx=0x7fa9500090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.044+0000 7fa967200640 1 -- 172.21.15.6:0/2998954922 shutdown_connections 2024-08-17T02:27:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.044+0000 7fa967200640 1 --2- 172.21.15.6:0/2998954922 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9600ac2e0 0x7fa960068770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.044+0000 7fa967200640 1 --2- 172.21.15.6:0/2998954922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9600ae4a0 0x7fa9600abda0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.044+0000 7fa967200640 1 -- 172.21.15.6:0/2998954922 >> 172.21.15.6:0/2998954922 conn(0x7fa9600ce420 msgr2=0x7fa960095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.044+0000 7fa967200640 1 -- 172.21.15.6:0/2998954922 shutdown_connections 2024-08-17T02:27:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.044+0000 7fa967200640 1 -- 172.21.15.6:0/2998954922 wait complete. 2024-08-17T02:27:27.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.045+0000 7fa967200640 1 Processor -- start 2024-08-17T02:27:27.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.045+0000 7fa967200640 1 -- start start 2024-08-17T02:27:27.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.046+0000 7fa967200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9600ac2e0 0x7fa9600c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.046+0000 7fa967200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9600ae4a0 0x7fa96015b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.046+0000 7fa967200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa960158bf0 0x7fa9601537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.046+0000 7fa967200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600c9200 con 0x7fa9600ae4a0 2024-08-17T02:27:27.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.046+0000 7fa967200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600c85f0 con 0x7fa960158bf0 2024-08-17T02:27:27.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.046+0000 7fa967200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600c88d0 con 0x7fa9600ac2e0 2024-08-17T02:27:27.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.046+0000 7fa965400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9600ae4a0 0x7fa96015b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.046+0000 7fa965400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9600ae4a0 0x7fa96015b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41184/0 (socket says 172.21.15.6:41184) 2024-08-17T02:27:27.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.046+0000 7fa965400640 1 -- 172.21.15.6:0/1234760365 learned_addr learned my addr 172.21.15.6:0/1234760365 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:27.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.047+0000 7fa965e00640 1 --2- 172.21.15.6:0/1234760365 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9600ac2e0 0x7fa9600c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.047+0000 7fa966800640 1 --2- 172.21.15.6:0/1234760365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa960158bf0 0x7fa9601537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.047+0000 7fa965400640 1 -- 172.21.15.6:0/1234760365 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9600ac2e0 msgr2=0x7fa9600c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.047+0000 7fa965400640 1 --2- 172.21.15.6:0/1234760365 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9600ac2e0 0x7fa9600c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.047+0000 7fa965400640 1 -- 172.21.15.6:0/1234760365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa960158bf0 msgr2=0x7fa9601537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.047+0000 7fa965400640 1 --2- 172.21.15.6:0/1234760365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa960158bf0 0x7fa9601537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.047+0000 7fa965400640 1 -- 172.21.15.6:0/1234760365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa950009390 con 0x7fa9600ae4a0 2024-08-17T02:27:27.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.047+0000 7fa966800640 1 --2- 172.21.15.6:0/1234760365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa960158bf0 0x7fa9601537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:27.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.047+0000 7fa965400640 1 --2- 172.21.15.6:0/1234760365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9600ae4a0 0x7fa96015b960 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa950009360 tx=0x7fa950032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.047+0000 7fa959600640 1 -- 172.21.15.6:0/1234760365 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa950031de0 con 0x7fa9600ae4a0 2024-08-17T02:27:27.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.047+0000 7fa959600640 1 -- 172.21.15.6:0/1234760365 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95003d420 con 0x7fa9600ae4a0 2024-08-17T02:27:27.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.047+0000 7fa959600640 1 -- 172.21.15.6:0/1234760365 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95003d7e0 con 0x7fa9600ae4a0 2024-08-17T02:27:27.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.047+0000 7fa967200640 1 -- 172.21.15.6:0/1234760365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9600c8bb0 con 0x7fa9600ae4a0 2024-08-17T02:27:27.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.048+0000 7fa967200640 1 -- 172.21.15.6:0/1234760365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9600c9bd0 con 0x7fa9600ae4a0 2024-08-17T02:27:27.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.048+0000 7fa967200640 1 -- 172.21.15.6:0/1234760365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9600c9370 con 0x7fa9600ae4a0 2024-08-17T02:27:27.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.049+0000 7fa959600640 1 -- 172.21.15.6:0/1234760365 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa950039040 con 0x7fa9600ae4a0 2024-08-17T02:27:27.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.050+0000 7fa959600640 1 --2- 172.21.15.6:0/1234760365 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa944065180 0x7fa944067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.050+0000 7fa959600640 1 -- 172.21.15.6:0/1234760365 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa9500a2400 con 0x7fa9600ae4a0 2024-08-17T02:27:27.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.050+0000 7fa965e00640 1 --2- 172.21.15.6:0/1234760365 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa944065180 0x7fa944067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.051+0000 7fa965e00640 1 --2- 172.21.15.6:0/1234760365 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa944065180 0x7fa944067630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa954001700 tx=0x7fa954009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.054+0000 7fa959600640 1 -- 172.21.15.6:0/1234760365 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa950070420 con 0x7fa9600ae4a0 2024-08-17T02:27:27.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.275+0000 7fa967200640 1 -- 172.21.15.6:0/1234760365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa960070720 con 0x7fa9600ae4a0 2024-08-17T02:27:27.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.276+0000 7fa959600640 1 -- 172.21.15.6:0/1234760365 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fa950073a40 con 0x7fa9600ae4a0 2024-08-17T02:27:27.277 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:27.277 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/4280185456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":4280185456},{"type":"v1","addr":"172.21.15.136:6836","nonce":4280185456}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2517061869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":2517061869},{"type":"v1","addr":"172.21.15.136:6837","nonce":2517061869}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4935,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2620799775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2620799775},{"type":"v1","addr":"172.21.15.6:6834","nonce":2620799775}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:21.208240+0000","modified":"2024-08-17T02:27:24.818513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/285178879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":285178879},{"type":"v1","addr":"172.21.15.6:6835","nonce":285178879}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:27:27.277 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 15 2024-08-17T02:27:27.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.278+0000 7fa967200640 1 -- 172.21.15.6:0/1234760365 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa944065180 msgr2=0x7fa944067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.278+0000 7fa967200640 1 --2- 172.21.15.6:0/1234760365 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa944065180 0x7fa944067630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa954001700 tx=0x7fa954009040 comp rx=0 tx=0).stop 2024-08-17T02:27:27.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.278+0000 7fa967200640 1 -- 172.21.15.6:0/1234760365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9600ae4a0 msgr2=0x7fa96015b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.278+0000 7fa967200640 1 --2- 172.21.15.6:0/1234760365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9600ae4a0 0x7fa96015b960 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa950009360 tx=0x7fa950032000 comp rx=0 tx=0).stop 2024-08-17T02:27:27.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.278+0000 7fa967200640 1 -- 172.21.15.6:0/1234760365 shutdown_connections 2024-08-17T02:27:27.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.278+0000 7fa967200640 1 --2- 172.21.15.6:0/1234760365 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa944065180 0x7fa944067630 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.278+0000 7fa967200640 1 --2- 172.21.15.6:0/1234760365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa960158bf0 0x7fa9601537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.278+0000 7fa967200640 1 --2- 172.21.15.6:0/1234760365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9600ae4a0 0x7fa96015b960 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.278+0000 7fa967200640 1 --2- 172.21.15.6:0/1234760365 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9600ac2e0 0x7fa9600c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.278+0000 7fa967200640 1 -- 172.21.15.6:0/1234760365 >> 172.21.15.6:0/1234760365 conn(0x7fa9600ce420 msgr2=0x7fa9600aa620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.278+0000 7fa967200640 1 -- 172.21.15.6:0/1234760365 shutdown_connections 2024-08-17T02:27:27.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.278+0000 7fa967200640 1 -- 172.21.15.6:0/1234760365 wait complete. 2024-08-17T02:27:27.697 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:27:21.208240+0000', 'modified': '2024-08-17T02:27:24.818513+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4938}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4938': {'gid': 4938, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/285178879', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 285178879}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 285178879}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:27:27.697 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:27:27.697 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-17T02:27:27.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.851+0000 7ffa5e400640 1 Processor -- start 2024-08-17T02:27:27.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.851+0000 7ffa5e400640 1 -- start start 2024-08-17T02:27:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.852+0000 7ffa5e400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa58159120 0x7ffa580ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.852+0000 7ffa5e400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa580abe30 0x7ffa580aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.852+0000 7ffa5e400640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa580a96c0 con 0x7ffa58158d50 2024-08-17T02:27:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.852+0000 7ffa5e400640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa580acf00 con 0x7ffa580abe30 2024-08-17T02:27:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.852+0000 7ffa5e400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa580ac230 con 0x7ffa58159120 2024-08-17T02:27:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.853+0000 7ffa57400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ffa58158d50 0x7ffa580ac4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56672/0 (socket says 172.21.15.6:56672) 2024-08-17T02:27:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.853+0000 7ffa57400640 1 -- 172.21.15.6:0/191375569 learned_addr learned my addr 172.21.15.6:0/191375569 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:27.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.853+0000 7ffa57e00640 1 --2- 172.21.15.6:0/191375569 >> v2:172.21.15.6:3300/0 conn(0x7ffa580abe30 0x7ffa580aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.853+0000 7ffa56a00640 1 --2- 172.21.15.6:0/191375569 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa58159120 0x7ffa580ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.853+0000 7ffa56000640 1 -- 172.21.15.6:0/191375569 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774853870 0 0) 0x7ffa580a96c0 con 0x7ffa58158d50 2024-08-17T02:27:27.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.853+0000 7ffa56000640 1 -- 172.21.15.6:0/191375569 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa3c0034e0 con 0x7ffa58158d50 2024-08-17T02:27:27.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.853+0000 7ffa57e00640 1 -- 172.21.15.6:0/191375569 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa58159120 msgr2=0x7ffa580ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:27.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.853+0000 7ffa57e00640 1 --2- 172.21.15.6:0/191375569 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa58159120 0x7ffa580ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.853+0000 7ffa57e00640 1 -- 172.21.15.6:0/191375569 >> v1:172.21.15.6:6789/0 conn(0x7ffa58158d50 legacy=0x7ffa580ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.853+0000 7ffa57e00640 1 -- 172.21.15.6:0/191375569 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa580af7d0 con 0x7ffa580abe30 2024-08-17T02:27:27.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.853+0000 7ffa56a00640 1 --2- 172.21.15.6:0/191375569 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa58159120 0x7ffa580ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:27.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.854+0000 7ffa57e00640 1 --2- 172.21.15.6:0/191375569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa580abe30 0x7ffa580aa3d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009e60 tx=0x7ffa50009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23065b42e08a0ff2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.855+0000 7ffa56000640 1 -- 172.21.15.6:0/191375569 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa50007550 con 0x7ffa580abe30 2024-08-17T02:27:27.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.855+0000 7ffa56000640 1 -- 172.21.15.6:0/191375569 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5002d050 con 0x7ffa580abe30 2024-08-17T02:27:27.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.855+0000 7ffa56000640 1 -- 172.21.15.6:0/191375569 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa50007900 con 0x7ffa580abe30 2024-08-17T02:27:27.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.855+0000 7ffa5e400640 1 -- 172.21.15.6:0/191375569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa580abe30 msgr2=0x7ffa580aa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.855+0000 7ffa5e400640 1 --2- 172.21.15.6:0/191375569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa580abe30 0x7ffa580aa3d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009e60 tx=0x7ffa50009780 comp rx=0 tx=0).stop 2024-08-17T02:27:27.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.855+0000 7ffa5e400640 1 -- 172.21.15.6:0/191375569 shutdown_connections 2024-08-17T02:27:27.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.855+0000 7ffa5e400640 1 --2- 172.21.15.6:0/191375569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa580abe30 0x7ffa580aa3d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.855+0000 7ffa5e400640 1 --2- 172.21.15.6:0/191375569 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa58159120 0x7ffa580ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.855+0000 7ffa5e400640 1 -- 172.21.15.6:0/191375569 >> 172.21.15.6:0/191375569 conn(0x7ffa58095a70 msgr2=0x7ffa58095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.855+0000 7ffa5e400640 1 -- 172.21.15.6:0/191375569 shutdown_connections 2024-08-17T02:27:27.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.855+0000 7ffa5e400640 1 -- 172.21.15.6:0/191375569 wait complete. 2024-08-17T02:27:27.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.857+0000 7ffa5e400640 1 Processor -- start 2024-08-17T02:27:27.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.857+0000 7ffa5e400640 1 -- start start 2024-08-17T02:27:27.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.858+0000 7ffa5e400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa580abe30 0x7ffa58153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.858+0000 7ffa5e400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa58158d50 0x7ffa580b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.858+0000 7ffa5e400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa58159120 0x7ffa580b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.858+0000 7ffa5e400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5815a430 con 0x7ffa58159120 2024-08-17T02:27:27.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.858+0000 7ffa5e400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa580b2380 con 0x7ffa580abe30 2024-08-17T02:27:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.858+0000 7ffa5e400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa58159fa0 con 0x7ffa58158d50 2024-08-17T02:27:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.858+0000 7ffa57e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa58159120 0x7ffa580b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.858+0000 7ffa57e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa58159120 0x7ffa580b1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41192/0 (socket says 172.21.15.6:41192) 2024-08-17T02:27:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.858+0000 7ffa57e00640 1 -- 172.21.15.6:0/1447521916 learned_addr learned my addr 172.21.15.6:0/1447521916 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.858+0000 7ffa56a00640 1 --2- 172.21.15.6:0/1447521916 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa58158d50 0x7ffa580b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.858+0000 7ffa57e00640 1 -- 172.21.15.6:0/1447521916 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa58158d50 msgr2=0x7ffa580b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.858+0000 7ffa57e00640 1 --2- 172.21.15.6:0/1447521916 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa58158d50 0x7ffa580b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.858+0000 7ffa57e00640 1 -- 172.21.15.6:0/1447521916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa580abe30 msgr2=0x7ffa58153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.858+0000 7ffa57400640 1 --2- 172.21.15.6:0/1447521916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa580abe30 0x7ffa58153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.858+0000 7ffa57e00640 1 --2- 172.21.15.6:0/1447521916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa580abe30 0x7ffa58153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.858+0000 7ffa57e00640 1 -- 172.21.15.6:0/1447521916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa50009a20 con 0x7ffa58159120 2024-08-17T02:27:27.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.858+0000 7ffa57400640 1 --2- 172.21.15.6:0/1447521916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa580abe30 0x7ffa58153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:27.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.859+0000 7ffa57e00640 1 --2- 172.21.15.6:0/1447521916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa58159120 0x7ffa580b1d50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009ec0 tx=0x7ffa50037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.859+0000 7ffa4ea00640 1 -- 172.21.15.6:0/1447521916 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa50031b90 con 0x7ffa58159120 2024-08-17T02:27:27.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.859+0000 7ffa4ea00640 1 -- 172.21.15.6:0/1447521916 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa50031d10 con 0x7ffa58159120 2024-08-17T02:27:27.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.859+0000 7ffa4ea00640 1 -- 172.21.15.6:0/1447521916 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa500456b0 con 0x7ffa58159120 2024-08-17T02:27:27.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.859+0000 7ffa5e400640 1 -- 172.21.15.6:0/1447521916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa58169460 con 0x7ffa58159120 2024-08-17T02:27:27.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.859+0000 7ffa5e400640 1 -- 172.21.15.6:0/1447521916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa58159670 con 0x7ffa58159120 2024-08-17T02:27:27.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.862+0000 7ffa4ea00640 1 -- 172.21.15.6:0/1447521916 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffa5003c420 con 0x7ffa58159120 2024-08-17T02:27:27.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.863+0000 7ffa4ea00640 1 --2- 172.21.15.6:0/1447521916 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ffa38065150 0x7ffa38067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.863+0000 7ffa4ea00640 1 -- 172.21.15.6:0/1447521916 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa500a4090 con 0x7ffa58159120 2024-08-17T02:27:27.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.863+0000 7ffa57400640 1 --2- 172.21.15.6:0/1447521916 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ffa38065150 0x7ffa38067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.863+0000 7ffa60977740 1 Processor -- start 2024-08-17T02:27:27.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.864+0000 7ffa60977740 1 -- start start 2024-08-17T02:27:27.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.864+0000 7ffa57400640 1 --2- 172.21.15.6:0/1447521916 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ffa38065150 0x7ffa38067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffa48005840 tx=0x7ffa48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.865+0000 7ffa60977740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1bca30 0x55d35e1bce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.865+0000 7ffa60977740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1980a0 0x55d35e1da5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.865+0000 7ffa60977740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1dab10 0x55d35e191900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.865+0000 7ffa60977740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35e152380 con 0x55d35e1dab10 2024-08-17T02:27:27.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.865+0000 7ffa60977740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35e0fb9e0 con 0x55d35e1980a0 2024-08-17T02:27:27.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.865+0000 7ffa60977740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d35e0f9170 con 0x55d35e1bca30 2024-08-17T02:27:27.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.865+0000 7ffa57e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1dab10 0x55d35e191900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.865+0000 7ffa57e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1dab10 0x55d35e191900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41204/0 (socket says 172.21.15.6:41204) 2024-08-17T02:27:27.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.865+0000 7ffa57e00640 1 -- 172.21.15.6:0/3910377761 learned_addr learned my addr 172.21.15.6:0/3910377761 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:27.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.865+0000 7ffa56a00640 1 --2- 172.21.15.6:0/3910377761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1980a0 0x55d35e1da5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.865+0000 7ffa57400640 1 --2- 172.21.15.6:0/3910377761 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1bca30 0x55d35e1bce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.865+0000 7ffa57e00640 1 -- 172.21.15.6:0/3910377761 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1bca30 msgr2=0x55d35e1bce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:27.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.865+0000 7ffa57e00640 1 --2- 172.21.15.6:0/3910377761 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1bca30 0x55d35e1bce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.865+0000 7ffa57e00640 1 -- 172.21.15.6:0/3910377761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1980a0 msgr2=0x55d35e1da5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:27.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.865+0000 7ffa57e00640 1 --2- 172.21.15.6:0/3910377761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1980a0 0x55d35e1da5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.865+0000 7ffa57e00640 1 -- 172.21.15.6:0/3910377761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d35e0a8820 con 0x55d35e1dab10 2024-08-17T02:27:27.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.866+0000 7ffa57e00640 1 --2- 172.21.15.6:0/3910377761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1dab10 0x55d35e191900 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffa50075a70 tx=0x7ffa500a2470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4897764880390d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.866+0000 7ffa43400640 1 -- 172.21.15.6:0/3910377761 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5007b0f0 con 0x55d35e1dab10 2024-08-17T02:27:27.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.866+0000 7ffa43400640 1 -- 172.21.15.6:0/3910377761 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa50076470 con 0x55d35e1dab10 2024-08-17T02:27:27.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.866+0000 7ffa43400640 1 -- 172.21.15.6:0/3910377761 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa50075d70 con 0x55d35e1dab10 2024-08-17T02:27:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.866+0000 7ffa60977740 1 -- 172.21.15.6:0/3910377761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1dab10 msgr2=0x55d35e191900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.866+0000 7ffa60977740 1 --2- 172.21.15.6:0/3910377761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1dab10 0x55d35e191900 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffa50075a70 tx=0x7ffa500a2470 comp rx=0 tx=0).stop 2024-08-17T02:27:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.866+0000 7ffa60977740 1 -- 172.21.15.6:0/3910377761 shutdown_connections 2024-08-17T02:27:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.866+0000 7ffa60977740 1 --2- 172.21.15.6:0/3910377761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1dab10 0x55d35e191900 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.866+0000 7ffa60977740 1 --2- 172.21.15.6:0/3910377761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1980a0 0x55d35e1da5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.866+0000 7ffa60977740 1 --2- 172.21.15.6:0/3910377761 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1bca30 0x55d35e1bce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.866+0000 7ffa60977740 1 -- 172.21.15.6:0/3910377761 >> 172.21.15.6:0/3910377761 conn(0x55d35e130030 msgr2=0x55d35e1dec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.867+0000 7ffa60977740 1 -- 172.21.15.6:0/3910377761 shutdown_connections 2024-08-17T02:27:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.867+0000 7ffa60977740 1 -- 172.21.15.6:0/3910377761 wait complete. 2024-08-17T02:27:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.867+0000 7ffa60977740 1 -- start start 2024-08-17T02:27:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.867+0000 7ffa60977740 1 Processor -- start 2024-08-17T02:27:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.868+0000 7ffa60977740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1980a0 0x55d35e1c4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.868+0000 7ffa60977740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1bca30 0x55d35e1be190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.868+0000 7ffa60977740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1dab10 0x55d35e1bf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.868+0000 7ffa60977740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35e0f4f60 con 0x55d35e1bca30 2024-08-17T02:27:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.868+0000 7ffa60977740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35e09d690 con 0x55d35e1980a0 2024-08-17T02:27:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.868+0000 7ffa60977740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d35e09d330 con 0x55d35e1dab10 2024-08-17T02:27:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.868+0000 7ffa60977740 10 client.0 _ll_register_callbacks cb 0x55d35e0972b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:27:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.869+0000 7ffa56a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1bca30 0x55d35e1be190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.869+0000 7ffa56a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1bca30 0x55d35e1be190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41220/0 (socket says 172.21.15.6:41220) 2024-08-17T02:27:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.869+0000 7ffa56a00640 1 -- 172.21.15.6:0/4112457998 learned_addr learned my addr 172.21.15.6:0/4112457998 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.869+0000 7ffa57400640 1 --2- 172.21.15.6:0/4112457998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1980a0 0x55d35e1c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.869+0000 7ffa57e00640 1 --2- 172.21.15.6:0/4112457998 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1dab10 0x55d35e1bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.869+0000 7ffa56a00640 1 -- 172.21.15.6:0/4112457998 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1dab10 msgr2=0x55d35e1bf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:27.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.869+0000 7ffa56a00640 1 --2- 172.21.15.6:0/4112457998 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1dab10 0x55d35e1bf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.869+0000 7ffa56a00640 1 -- 172.21.15.6:0/4112457998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1980a0 msgr2=0x55d35e1c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:27.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.869+0000 7ffa56a00640 1 --2- 172.21.15.6:0/4112457998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1980a0 0x55d35e1c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.869+0000 7ffa56a00640 1 -- 172.21.15.6:0/4112457998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa58159670 con 0x55d35e1bca30 2024-08-17T02:27:27.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.869+0000 7ffa57400640 1 --2- 172.21.15.6:0/4112457998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1980a0 0x55d35e1c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:27.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.869+0000 7ffa56a00640 1 --2- 172.21.15.6:0/4112457998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1bca30 0x55d35e1be190 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffa440112e0 tx=0x7ffa44008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22ec14fce724307 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.869+0000 7ffa37e00640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-08-17T02:27:27.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.870+0000 7ffa37e00640 1 -- 172.21.15.6:0/4112457998 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44011e50 con 0x55d35e1bca30 2024-08-17T02:27:27.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.870+0000 7ffa60977740 1 -- 172.21.15.6:0/4112457998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d35e128d20 con 0x55d35e1bca30 2024-08-17T02:27:27.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.870+0000 7ffa37e00640 1 -- 172.21.15.6:0/4112457998 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa44015650 con 0x55d35e1bca30 2024-08-17T02:27:27.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.870+0000 7ffa37e00640 1 -- 172.21.15.6:0/4112457998 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa44015a20 con 0x55d35e1bca30 2024-08-17T02:27:27.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.870+0000 7ffa60977740 10 client.5118 fetch_fsmap learned FSMap version 15 2024-08-17T02:27:27.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.870+0000 7ffa60977740 1 -- 172.21.15.6:0/4112457998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55d35e0beab0 con 0x55d35e1bca30 2024-08-17T02:27:27.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.870+0000 7ffa37e00640 1 -- 172.21.15.6:0/4112457998 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d35e128d20 con 0x55d35e1bca30 2024-08-17T02:27:27.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.870+0000 7ffa37e00640 1 -- 172.21.15.6:0/4112457998 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffa44015b80 con 0x55d35e1bca30 2024-08-17T02:27:27.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.870+0000 7ffa60977740 10 client.5118 fetch_fsmap finished waiting for FSMap version 15 2024-08-17T02:27:27.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.870+0000 7ffa60977740 10 client.5118 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:27:27.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.870+0000 7ffa60977740 20 client.5118 populate_metadata read hostname 'smithi006' 2024-08-17T02:27:27.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.870+0000 7ffa60977740 1 --2- 172.21.15.6:0/4112457998 >> [v2:172.21.15.6:6833/285178879,v1:172.21.15.6:6835/285178879] conn(0x55d35e1f5da0 0x55d35e1f8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.870+0000 7ffa60977740 4 client.5118 mds_command: new command op to 4938 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:27:27.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.870+0000 7ffa60977740 1 -- 172.21.15.6:0/4112457998 --> [v2:172.21.15.6:6833/285178879,v1:172.21.15.6:6835/285178879] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d35ddfc3c0 con 0x55d35e1f5da0 2024-08-17T02:27:27.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.871+0000 7ffa57400640 1 --2- 172.21.15.6:0/4112457998 >> [v2:172.21.15.6:6833/285178879,v1:172.21.15.6:6835/285178879] conn(0x55d35e1f5da0 0x55d35e1f8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.871+0000 7ffa57400640 1 --2- 172.21.15.6:0/4112457998 >> [v2:172.21.15.6:6833/285178879,v1:172.21.15.6:6835/285178879] conn(0x55d35e1f5da0 0x55d35e1f8180 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c795a7a84610cbc6 server_cookie=1f531a6814897d7e in_seq=0 out_seq=0 2024-08-17T02:27:27.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.871+0000 7ffa37e00640 10 client.5118 ms_handle_connect on v2:172.21.15.6:6833/285178879 2024-08-17T02:27:27.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.872+0000 7ffa37e00640 1 -- 172.21.15.6:0/4112457998 <== mds.0 v2:172.21.15.6:6833/285178879 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x55d35ddfc3c0 con 0x55d35e1f5da0 2024-08-17T02:27:27.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.872+0000 7ffa37e00640 10 client.5118 handle_command_reply: tid=0 2024-08-17T02:27:27.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.872+0000 7ffa60977740 1 client.5118 shutdown 2024-08-17T02:27:27.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.872+0000 7ffa60977740 1 -- 172.21.15.6:0/4112457998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1bca30 msgr2=0x55d35e1be190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.872+0000 7ffa60977740 1 --2- 172.21.15.6:0/4112457998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1bca30 0x55d35e1be190 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffa440112e0 tx=0x7ffa44008040 comp rx=0 tx=0).stop 2024-08-17T02:27:27.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.872+0000 7ffa60977740 1 -- 172.21.15.6:0/4112457998 shutdown_connections 2024-08-17T02:27:27.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.872+0000 7ffa60977740 1 --2- 172.21.15.6:0/4112457998 >> [v2:172.21.15.6:6833/285178879,v1:172.21.15.6:6835/285178879] conn(0x55d35e1f5da0 0x55d35e1f8180 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.872+0000 7ffa60977740 1 --2- 172.21.15.6:0/4112457998 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1dab10 0x55d35e1bf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.872+0000 7ffa60977740 1 --2- 172.21.15.6:0/4112457998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1bca30 0x55d35e1be190 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.872+0000 7ffa60977740 1 --2- 172.21.15.6:0/4112457998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1980a0 0x55d35e1c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.872+0000 7ffa37e00640 0 client.5118 ms_handle_reset on v2:172.21.15.6:6833/285178879 2024-08-17T02:27:27.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.872+0000 7ffa60977740 1 -- 172.21.15.6:0/4112457998 >> 172.21.15.6:0/4112457998 conn(0x55d35e130030 msgr2=0x55d35e192250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.873+0000 7ffa60977740 1 -- 172.21.15.6:0/4112457998 shutdown_connections 2024-08-17T02:27:27.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.873+0000 7ffa60977740 1 -- 172.21.15.6:0/4112457998 wait complete. 2024-08-17T02:27:27.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.873+0000 7ffa60977740 20 client.5118 trim_cache size 0 max 16384 2024-08-17T02:27:27.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.889+0000 7ffa60977740 1 Processor -- start 2024-08-17T02:27:27.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.889+0000 7ffa60977740 1 -- start start 2024-08-17T02:27:27.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa60977740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1980a0 0x55d35e1bf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa60977740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1bca30 0x55d35e1de930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa60977740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1dab10 0x55d35e1e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa60977740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35de6ff20 con 0x55d35e1bca30 2024-08-17T02:27:27.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa60977740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35e0cb570 con 0x55d35e1980a0 2024-08-17T02:27:27.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa60977740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d35e1dbd20 con 0x55d35e1dab10 2024-08-17T02:27:27.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa56a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1bca30 0x55d35e1de930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa56a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1bca30 0x55d35e1de930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41230/0 (socket says 172.21.15.6:41230) 2024-08-17T02:27:27.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa56a00640 1 -- 172.21.15.6:0/602740192 learned_addr learned my addr 172.21.15.6:0/602740192 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:27.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa57400640 1 --2- 172.21.15.6:0/602740192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1980a0 0x55d35e1bf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa56a00640 1 -- 172.21.15.6:0/602740192 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1dab10 msgr2=0x55d35e1e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:27.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa57e00640 1 --2- 172.21.15.6:0/602740192 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1dab10 0x55d35e1e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa56a00640 1 --2- 172.21.15.6:0/602740192 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1dab10 0x55d35e1e9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa56a00640 1 -- 172.21.15.6:0/602740192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1980a0 msgr2=0x55d35e1bf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:27.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa56a00640 1 --2- 172.21.15.6:0/602740192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1980a0 0x55d35e1bf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa56a00640 1 -- 172.21.15.6:0/602740192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d35e0c2490 con 0x55d35e1bca30 2024-08-17T02:27:27.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa57400640 1 --2- 172.21.15.6:0/602740192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1980a0 0x55d35e1bf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:27.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.890+0000 7ffa57e00640 1 --2- 172.21.15.6:0/602740192 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1dab10 0x55d35e1e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:27.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.891+0000 7ffa56a00640 1 --2- 172.21.15.6:0/602740192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1bca30 0x55d35e1de930 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffa440070e0 tx=0x7ffa4401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a00de9c9641efe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.891+0000 7ffa43e00640 1 -- 172.21.15.6:0/602740192 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44015650 con 0x55d35e1bca30 2024-08-17T02:27:27.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.891+0000 7ffa43e00640 1 -- 172.21.15.6:0/602740192 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa44007ad0 con 0x55d35e1bca30 2024-08-17T02:27:27.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.891+0000 7ffa43e00640 1 -- 172.21.15.6:0/602740192 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44000e10 con 0x55d35e1bca30 2024-08-17T02:27:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.891+0000 7ffa60977740 1 -- 172.21.15.6:0/602740192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1bca30 msgr2=0x55d35e1de930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.891+0000 7ffa60977740 1 --2- 172.21.15.6:0/602740192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1bca30 0x55d35e1de930 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffa440070e0 tx=0x7ffa4401c000 comp rx=0 tx=0).stop 2024-08-17T02:27:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.892+0000 7ffa60977740 1 -- 172.21.15.6:0/602740192 shutdown_connections 2024-08-17T02:27:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.892+0000 7ffa60977740 1 --2- 172.21.15.6:0/602740192 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1dab10 0x55d35e1e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.892+0000 7ffa60977740 1 --2- 172.21.15.6:0/602740192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1bca30 0x55d35e1de930 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.892+0000 7ffa60977740 1 --2- 172.21.15.6:0/602740192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1980a0 0x55d35e1bf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.892+0000 7ffa60977740 1 -- 172.21.15.6:0/602740192 >> 172.21.15.6:0/602740192 conn(0x55d35e130030 msgr2=0x55d35e18c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.892+0000 7ffa60977740 1 -- 172.21.15.6:0/602740192 shutdown_connections 2024-08-17T02:27:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.892+0000 7ffa60977740 1 -- 172.21.15.6:0/602740192 wait complete. 2024-08-17T02:27:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.892+0000 7ffa60977740 1 -- start start 2024-08-17T02:27:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.892+0000 7ffa60977740 1 Processor -- start 2024-08-17T02:27:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.893+0000 7ffa60977740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1980a0 0x55d35e2371c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.893+0000 7ffa60977740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1bca30 0x55d35e1c3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.893+0000 7ffa60977740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1dab10 0x55d35e1c3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.893+0000 7ffa60977740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35e18c9d0 con 0x55d35e1980a0 2024-08-17T02:27:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.893+0000 7ffa60977740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35e1bf7f0 con 0x55d35e1bca30 2024-08-17T02:27:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.893+0000 7ffa60977740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d35e2433e0 con 0x55d35e1dab10 2024-08-17T02:27:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.893+0000 7ffa60977740 10 client.0 _ll_register_callbacks cb 0x7ffa44007390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:27:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.894+0000 7ffa57400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1980a0 0x55d35e2371c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.894+0000 7ffa57400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1980a0 0x55d35e2371c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41242/0 (socket says 172.21.15.6:41242) 2024-08-17T02:27:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.894+0000 7ffa57400640 1 -- 172.21.15.6:0/1378633737 learned_addr learned my addr 172.21.15.6:0/1378633737 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.894+0000 7ffa56a00640 1 --2- 172.21.15.6:0/1378633737 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1bca30 0x55d35e1c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.894+0000 7ffa57e00640 1 --2- 172.21.15.6:0/1378633737 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1dab10 0x55d35e1c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.894+0000 7ffa57400640 1 -- 172.21.15.6:0/1378633737 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1dab10 msgr2=0x55d35e1c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.894+0000 7ffa57400640 1 --2- 172.21.15.6:0/1378633737 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1dab10 0x55d35e1c3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.894+0000 7ffa57400640 1 -- 172.21.15.6:0/1378633737 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1bca30 msgr2=0x55d35e1c3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.894+0000 7ffa57400640 1 --2- 172.21.15.6:0/1378633737 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1bca30 0x55d35e1c3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.894+0000 7ffa57400640 1 -- 172.21.15.6:0/1378633737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d35e0beab0 con 0x55d35e1980a0 2024-08-17T02:27:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.894+0000 7ffa57e00640 1 --2- 172.21.15.6:0/1378633737 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1dab10 0x55d35e1c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.894+0000 7ffa57400640 1 --2- 172.21.15.6:0/1378633737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1980a0 0x55d35e2371c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55d35e1f4830 tx=0x7ffa48015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2375bdfb804144df server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.894+0000 7ffa37e00640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-08-17T02:27:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.895+0000 7ffa37e00640 1 -- 172.21.15.6:0/1378633737 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa48005ce0 con 0x55d35e1980a0 2024-08-17T02:27:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.895+0000 7ffa37e00640 1 -- 172.21.15.6:0/1378633737 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa48005e40 con 0x55d35e1980a0 2024-08-17T02:27:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.895+0000 7ffa60977740 1 -- 172.21.15.6:0/1378633737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffa50076470 con 0x55d35e1980a0 2024-08-17T02:27:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.895+0000 7ffa37e00640 1 -- 172.21.15.6:0/1378633737 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa48029ab0 con 0x55d35e1980a0 2024-08-17T02:27:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.895+0000 7ffa60977740 10 client.5124 fetch_fsmap learned FSMap version 15 2024-08-17T02:27:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.895+0000 7ffa60977740 1 -- 172.21.15.6:0/1378633737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55d35e0c21e0 con 0x55d35e1980a0 2024-08-17T02:27:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.895+0000 7ffa37e00640 1 -- 172.21.15.6:0/1378633737 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa50076470 con 0x55d35e1980a0 2024-08-17T02:27:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.895+0000 7ffa37e00640 1 -- 172.21.15.6:0/1378633737 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffa48029c10 con 0x55d35e1980a0 2024-08-17T02:27:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.895+0000 7ffa60977740 10 client.5124 fetch_fsmap finished waiting for FSMap version 15 2024-08-17T02:27:27.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.895+0000 7ffa60977740 10 client.5124 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:27:27.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.895+0000 7ffa60977740 20 client.5124 populate_metadata read hostname 'smithi006' 2024-08-17T02:27:27.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.895+0000 7ffa60977740 1 --2- 172.21.15.6:0/1378633737 >> [v2:172.21.15.6:6833/285178879,v1:172.21.15.6:6835/285178879] conn(0x55d35e195ca0 0x55d35e1d74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.895+0000 7ffa60977740 4 client.5124 mds_command: new command op to 4938 tid=0[{"prefix": "status"}] 2024-08-17T02:27:27.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.895+0000 7ffa60977740 1 -- 172.21.15.6:0/1378633737 --> [v2:172.21.15.6:6833/285178879,v1:172.21.15.6:6835/285178879] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d35de0d6c0 con 0x55d35e195ca0 2024-08-17T02:27:27.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.896+0000 7ffa56a00640 1 --2- 172.21.15.6:0/1378633737 >> [v2:172.21.15.6:6833/285178879,v1:172.21.15.6:6835/285178879] conn(0x55d35e195ca0 0x55d35e1d74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.896+0000 7ffa56a00640 1 --2- 172.21.15.6:0/1378633737 >> [v2:172.21.15.6:6833/285178879,v1:172.21.15.6:6835/285178879] conn(0x55d35e195ca0 0x55d35e1d74c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=256be4f6875afc70 server_cookie=52ddc90ff200aa39 in_seq=0 out_seq=0 2024-08-17T02:27:27.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.896+0000 7ffa37e00640 10 client.5124 ms_handle_connect on v2:172.21.15.6:6833/285178879 2024-08-17T02:27:27.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.896+0000 7ffa37e00640 1 -- 172.21.15.6:0/1378633737 <== mds.0 v2:172.21.15.6:6833/285178879 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55d35de0d6c0 con 0x55d35e195ca0 2024-08-17T02:27:27.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.896+0000 7ffa37e00640 10 client.5124 handle_command_reply: tid=0 2024-08-17T02:27:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.896+0000 7ffa60977740 1 client.5124 shutdown 2024-08-17T02:27:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.897+0000 7ffa60977740 1 -- 172.21.15.6:0/1378633737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1980a0 msgr2=0x55d35e2371c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.897+0000 7ffa60977740 1 --2- 172.21.15.6:0/1378633737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1980a0 0x55d35e2371c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55d35e1f4830 tx=0x7ffa48015040 comp rx=0 tx=0).stop 2024-08-17T02:27:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.897+0000 7ffa60977740 1 -- 172.21.15.6:0/1378633737 shutdown_connections 2024-08-17T02:27:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.897+0000 7ffa60977740 1 --2- 172.21.15.6:0/1378633737 >> [v2:172.21.15.6:6833/285178879,v1:172.21.15.6:6835/285178879] conn(0x55d35e195ca0 0x55d35e1d74c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.897+0000 7ffa60977740 1 --2- 172.21.15.6:0/1378633737 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55d35e1dab10 0x55d35e1c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.897+0000 7ffa60977740 1 --2- 172.21.15.6:0/1378633737 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d35e1bca30 0x55d35e1c3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.897+0000 7ffa60977740 1 --2- 172.21.15.6:0/1378633737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d35e1980a0 0x55d35e2371c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.897+0000 7ffa37e00640 0 client.5124 ms_handle_reset on v2:172.21.15.6:6833/285178879 2024-08-17T02:27:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.897+0000 7ffa60977740 1 -- 172.21.15.6:0/1378633737 >> 172.21.15.6:0/1378633737 conn(0x55d35e130030 msgr2=0x55d35e1e9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.897+0000 7ffa60977740 1 -- 172.21.15.6:0/1378633737 shutdown_connections 2024-08-17T02:27:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.897+0000 7ffa60977740 1 -- 172.21.15.6:0/1378633737 wait complete. 2024-08-17T02:27:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.897+0000 7ffa60977740 20 client.5124 trim_cache size 0 max 16384 2024-08-17T02:27:27.903 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-08-17T02:27:27.903 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "61589148-c13d-47c7-8fbb-d1646bb8e5e2", 2024-08-17T02:27:27.903 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-08-17T02:27:27.903 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4938, 2024-08-17T02:27:27.903 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-08-17T02:27:27.903 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-08-17T02:27:27.903 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-08-17T02:27:27.904 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 6.0947799890000001, 2024-08-17T02:27:27.904 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 15, 2024-08-17T02:27:27.904 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 32, 2024-08-17T02:27:27.904 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 32, 2024-08-17T02:27:27.904 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 13.914885541 2024-08-17T02:27:27.904 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-08-17T02:27:27.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.897+0000 7ffa5e400640 1 -- 172.21.15.6:0/1447521916 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ffa38065150 msgr2=0x7ffa38067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.897+0000 7ffa5e400640 1 --2- 172.21.15.6:0/1447521916 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ffa38065150 0x7ffa38067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffa48005840 tx=0x7ffa48009040 comp rx=0 tx=0).stop 2024-08-17T02:27:27.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.897+0000 7ffa5e400640 1 -- 172.21.15.6:0/1447521916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa58159120 msgr2=0x7ffa580b1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.897+0000 7ffa5e400640 1 --2- 172.21.15.6:0/1447521916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa58159120 0x7ffa580b1d50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009ec0 tx=0x7ffa50037000 comp rx=0 tx=0).stop 2024-08-17T02:27:27.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.898+0000 7ffa5e400640 1 -- 172.21.15.6:0/1447521916 shutdown_connections 2024-08-17T02:27:27.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.898+0000 7ffa5e400640 1 --2- 172.21.15.6:0/1447521916 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ffa38065150 0x7ffa38067600 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.898+0000 7ffa5e400640 1 --2- 172.21.15.6:0/1447521916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa58159120 0x7ffa580b1d50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.898+0000 7ffa5e400640 1 --2- 172.21.15.6:0/1447521916 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa58158d50 0x7ffa580b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.898+0000 7ffa5e400640 1 --2- 172.21.15.6:0/1447521916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa580abe30 0x7ffa58153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.898+0000 7ffa5e400640 1 -- 172.21.15.6:0/1447521916 >> 172.21.15.6:0/1447521916 conn(0x7ffa58095a70 msgr2=0x7ffa580aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.898+0000 7ffa5e400640 1 -- 172.21.15.6:0/1447521916 shutdown_connections 2024-08-17T02:27:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:27.898+0000 7ffa5e400640 1 -- 172.21.15.6:0/1447521916 wait complete. 2024-08-17T02:27:27.914 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:28.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.065+0000 7f9395e00640 1 Processor -- start 2024-08-17T02:27:28.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.065+0000 7f9395e00640 1 -- start start 2024-08-17T02:27:28.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.066+0000 7f9395e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9390158b10 0x7f93900b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.066+0000 7f9395e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9390067570 0x7f93900aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.066+0000 7f9395e00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93900a9620 con 0x7f93900b25c0 2024-08-17T02:27:28.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.066+0000 7f9395e00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93900aa420 con 0x7f9390067570 2024-08-17T02:27:28.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.066+0000 7f9395e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93900a9850 con 0x7f9390158b10 2024-08-17T02:27:28.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.066+0000 7f938fe00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f93900b25c0 0x7f9390066e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56676/0 (socket says 172.21.15.6:56676) 2024-08-17T02:27:28.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.066+0000 7f938fe00640 1 -- 172.21.15.6:0/2796310267 learned_addr learned my addr 172.21.15.6:0/2796310267 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:28.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.066+0000 7f9395400640 1 --2- 172.21.15.6:0/2796310267 >> v2:172.21.15.6:3300/0 conn(0x7f9390067570 0x7f93900aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.067+0000 7f9394a00640 1 --2- 172.21.15.6:0/2796310267 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9390158b10 0x7f93900b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.067+0000 7f938f400640 1 -- 172.21.15.6:0/2796310267 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249140153 0 0) 0x7f93900a9620 con 0x7f93900b25c0 2024-08-17T02:27:28.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.067+0000 7f938f400640 1 -- 172.21.15.6:0/2796310267 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93780034e0 con 0x7f93900b25c0 2024-08-17T02:27:28.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.067+0000 7f9395400640 1 -- 172.21.15.6:0/2796310267 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9390158b10 msgr2=0x7f93900b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:28.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.067+0000 7f9395400640 1 --2- 172.21.15.6:0/2796310267 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9390158b10 0x7f93900b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.067+0000 7f9395400640 1 -- 172.21.15.6:0/2796310267 >> v1:172.21.15.6:6789/0 conn(0x7f93900b25c0 legacy=0x7f9390066e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.067+0000 7f9395400640 1 -- 172.21.15.6:0/2796310267 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9390067c40 con 0x7f9390067570 2024-08-17T02:27:28.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.068+0000 7f9395400640 1 --2- 172.21.15.6:0/2796310267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9390067570 0x7f93900aa8b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9388009e90 tx=0x7f9388009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99516e547d018abc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:28.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.068+0000 7f938f400640 1 -- 172.21.15.6:0/2796310267 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938802aea0 con 0x7f9390067570 2024-08-17T02:27:28.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.068+0000 7f938f400640 1 -- 172.21.15.6:0/2796310267 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938802d050 con 0x7f9390067570 2024-08-17T02:27:28.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.068+0000 7f938f400640 1 -- 172.21.15.6:0/2796310267 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388007780 con 0x7f9390067570 2024-08-17T02:27:28.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.069+0000 7f9395e00640 1 -- 172.21.15.6:0/2796310267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9390067570 msgr2=0x7f93900aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.069+0000 7f9395e00640 1 --2- 172.21.15.6:0/2796310267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9390067570 0x7f93900aa8b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9388009e90 tx=0x7f9388009780 comp rx=0 tx=0).stop 2024-08-17T02:27:28.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.069+0000 7f9395e00640 1 -- 172.21.15.6:0/2796310267 shutdown_connections 2024-08-17T02:27:28.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.069+0000 7f9395e00640 1 --2- 172.21.15.6:0/2796310267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9390067570 0x7f93900aa8b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.069+0000 7f9395e00640 1 --2- 172.21.15.6:0/2796310267 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9390158b10 0x7f93900b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.069+0000 7f9395e00640 1 -- 172.21.15.6:0/2796310267 >> 172.21.15.6:0/2796310267 conn(0x7f9390095a70 msgr2=0x7f9390095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:28.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.069+0000 7f9395e00640 1 -- 172.21.15.6:0/2796310267 shutdown_connections 2024-08-17T02:27:28.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.069+0000 7f9395e00640 1 -- 172.21.15.6:0/2796310267 wait complete. 2024-08-17T02:27:28.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.070+0000 7f9395e00640 1 Processor -- start 2024-08-17T02:27:28.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.071+0000 7f9395e00640 1 -- start start 2024-08-17T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.071+0000 7f9395e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9390067570 0x7f9390098f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.071+0000 7f9395e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93900b25c0 0x7f9390153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.071+0000 7f9395e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9390158b10 0x7f9390168c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.071+0000 7f9395e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9390099660 con 0x7f9390158b10 2024-08-17T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.071+0000 7f9395e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9390159940 con 0x7f93900b25c0 2024-08-17T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.071+0000 7f9395e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9390159010 con 0x7f9390067570 2024-08-17T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.072+0000 7f9395400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9390158b10 0x7f9390168c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.072+0000 7f9395400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9390158b10 0x7f9390168c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41252/0 (socket says 172.21.15.6:41252) 2024-08-17T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.072+0000 7f9395400640 1 -- 172.21.15.6:0/2788665552 learned_addr learned my addr 172.21.15.6:0/2788665552 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.072+0000 7f938fe00640 1 --2- 172.21.15.6:0/2788665552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93900b25c0 0x7f9390153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.072+0000 7f9394a00640 1 --2- 172.21.15.6:0/2788665552 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9390067570 0x7f9390098f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.072+0000 7f9395400640 1 -- 172.21.15.6:0/2788665552 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9390067570 msgr2=0x7f9390098f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.072+0000 7f9395400640 1 --2- 172.21.15.6:0/2788665552 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9390067570 0x7f9390098f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.072+0000 7f9395400640 1 -- 172.21.15.6:0/2788665552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93900b25c0 msgr2=0x7f9390153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.072+0000 7f9395400640 1 --2- 172.21.15.6:0/2788665552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93900b25c0 0x7f9390153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.072+0000 7f9395400640 1 -- 172.21.15.6:0/2788665552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9388009a20 con 0x7f9390158b10 2024-08-17T02:27:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.072+0000 7f9395400640 1 --2- 172.21.15.6:0/2788665552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9390158b10 0x7f9390168c70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9388009ef0 tx=0x7f9388037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:28.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.073+0000 7f9383e00640 1 -- 172.21.15.6:0/2788665552 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938802aea0 con 0x7f9390158b10 2024-08-17T02:27:28.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.073+0000 7f9383e00640 1 -- 172.21.15.6:0/2788665552 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9388040070 con 0x7f9390158b10 2024-08-17T02:27:28.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.073+0000 7f9383e00640 1 -- 172.21.15.6:0/2788665552 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388031ae0 con 0x7f9390158b10 2024-08-17T02:27:28.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.073+0000 7f9395e00640 1 -- 172.21.15.6:0/2788665552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93901592f0 con 0x7f9390158b10 2024-08-17T02:27:28.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.073+0000 7f9395e00640 1 -- 172.21.15.6:0/2788665552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9390154300 con 0x7f9390158b10 2024-08-17T02:27:28.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.074+0000 7f9395e00640 1 -- 172.21.15.6:0/2788665552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9390070720 con 0x7f9390158b10 2024-08-17T02:27:28.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.074+0000 7f9383e00640 1 -- 172.21.15.6:0/2788665552 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9388042030 con 0x7f9390158b10 2024-08-17T02:27:28.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.075+0000 7f9383e00640 1 --2- 172.21.15.6:0/2788665552 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9370065150 0x7f9370067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.075+0000 7f9383e00640 1 -- 172.21.15.6:0/2788665552 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f93880a3b00 con 0x7f9390158b10 2024-08-17T02:27:28.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.076+0000 7f9394a00640 1 --2- 172.21.15.6:0/2788665552 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9370065150 0x7f9370067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.076+0000 7f9394a00640 1 --2- 172.21.15.6:0/2788665552 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9370065150 0x7f9370067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9384009c10 tx=0x7f9384008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.080+0000 7f9383e00640 1 -- 172.21.15.6:0/2788665552 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f93880a5e60 con 0x7f9390158b10 2024-08-17T02:27:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.299+0000 7f9395e00640 1 -- 172.21.15.6:0/2788665552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9390159a80 con 0x7f9390158b10 2024-08-17T02:27:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.300+0000 7f9383e00640 1 -- 172.21.15.6:0/2788665552 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9388071b20 con 0x7f9390158b10 2024-08-17T02:27:28.301 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:27:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.302+0000 7f9395e00640 1 -- 172.21.15.6:0/2788665552 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9370065150 msgr2=0x7f9370067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.302+0000 7f9395e00640 1 --2- 172.21.15.6:0/2788665552 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9370065150 0x7f9370067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9384009c10 tx=0x7f9384008040 comp rx=0 tx=0).stop 2024-08-17T02:27:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.302+0000 7f9395e00640 1 -- 172.21.15.6:0/2788665552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9390158b10 msgr2=0x7f9390168c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.302+0000 7f9395e00640 1 --2- 172.21.15.6:0/2788665552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9390158b10 0x7f9390168c70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9388009ef0 tx=0x7f9388037000 comp rx=0 tx=0).stop 2024-08-17T02:27:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.302+0000 7f9395e00640 1 -- 172.21.15.6:0/2788665552 shutdown_connections 2024-08-17T02:27:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.302+0000 7f9395e00640 1 --2- 172.21.15.6:0/2788665552 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9370065150 0x7f9370067600 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.302+0000 7f9395e00640 1 --2- 172.21.15.6:0/2788665552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9390158b10 0x7f9390168c70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.302+0000 7f9395e00640 1 --2- 172.21.15.6:0/2788665552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93900b25c0 0x7f9390153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.302+0000 7f9395e00640 1 --2- 172.21.15.6:0/2788665552 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9390067570 0x7f9390098f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.302+0000 7f9395e00640 1 -- 172.21.15.6:0/2788665552 >> 172.21.15.6:0/2788665552 conn(0x7f9390095a70 msgr2=0x7f9390156790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.302+0000 7f9395e00640 1 -- 172.21.15.6:0/2788665552 shutdown_connections 2024-08-17T02:27:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:28.302+0000 7f9395e00640 1 -- 172.21.15.6:0/2788665552 wait complete. 2024-08-17T02:27:28.317 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:27:28.317 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:27:28.317 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-08-17T02:27:28.317 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:27:28.317 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:28.317 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:27:28.317 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:27:28.317 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:27:28.318 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:27:28.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:28.318 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-08-17T02:27:28.354 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:28.467 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:28.467 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:28.467 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:28.467 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:28.467 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:28.467 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:28.467 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:28.467 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-08-17T02:27:28.467 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:28.467 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:28.468 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-08-17T02:27:28.468 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:27:28.468 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:28.468 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-08-17T02:27:28.468 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:27:28.468 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42591sec preferred_lft 42591sec 2024-08-17T02:27:28.468 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-08-17T02:27:28.468 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:28.468 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:28.468 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:28.468 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-08-17T02:27:28.468 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:28.468 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 1e:e3:92:c2:40:01 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:28.468 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:27:28.469 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:28.469 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::cd0:c9ff:fe4a:aa10/64 scope link 2024-08-17T02:27:28.469 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:28.469 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:28.469 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 1e:e3:92:c2:40:01 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:27:28.469 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::1ce3:92ff:fec2:4001/64 scope link 2024-08-17T02:27:28.469 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:28.469 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:28.469 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 8a:1d:fc:9f:78:f4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:27:28.469 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::881d:fcff:fe9f:78f4/64 scope link 2024-08-17T02:27:28.469 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:28.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:28.470 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:27:28.523 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-08-17T02:27:28.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:28.527 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-08-17T02:27:28.563 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-08-17T02:27:28.563 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:27:28.563 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:27:28.563 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:27:28.563 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:27:28.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:28.564 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2024-08-17T02:27:28.564 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-08-17T02:27:28.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:27:28.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:27:28.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:27:28.564 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-08-17T02:27:28.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:28.709 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-08-17T02:27:28.744 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:27:28.744 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:27:28.745 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:27:28.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:28.745 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-08-17T02:27:28.843 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:28.843 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:28.878 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:27:28.879 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:28.879 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:28.955 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:27:28.955 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:27:28.955 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:29.077 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:29.077 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:29.104 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:29.104 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:29.104 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.136:3300,172.21.15.136:3301" 2024-08-17T02:27:29.104 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@61589148-c13d-47c7-8fbb-d1646bb8e5e2.cephfs=/ 2024-08-17T02:27:29.105 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2024-08-17T02:27:29.105 INFO:teuthology.orchestra.run.smithi006.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:27:29.105 INFO:teuthology.orchestra.run.smithi006.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:27:29.105 INFO:teuthology.orchestra.run.smithi006.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:27:29.106 INFO:teuthology.orchestra.run.smithi006.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:27:29.106 INFO:teuthology.orchestra.run.smithi006.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:27:29.110 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:27:29.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:29.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:29.167 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:29.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.317+0000 7f133d600640 1 Processor -- start 2024-08-17T02:27:29.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.318+0000 7f133d600640 1 -- start start 2024-08-17T02:27:29.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.319+0000 7f133d600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1338069840 0x7f13380cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.319+0000 7f133d600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13380cd550 0x7f133815ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.319+0000 7f133d600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13380cbe10 0x7f133815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.319+0000 7f133d600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133815c9d0 con 0x7f13380cd550 2024-08-17T02:27:29.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.319+0000 7f133d600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133815a200 con 0x7f1338069840 2024-08-17T02:27:29.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.319+0000 7f133d600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13380b0830 con 0x7f13380cbe10 2024-08-17T02:27:29.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.319+0000 7f132fe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13380cd550 0x7f133815ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.319+0000 7f132fe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13380cd550 0x7f133815ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41260/0 (socket says 172.21.15.6:41260) 2024-08-17T02:27:29.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.319+0000 7f132fe00640 1 -- 172.21.15.6:0/595614917 learned_addr learned my addr 172.21.15.6:0/595614917 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:29.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.319+0000 7f133cc00640 1 --2- 172.21.15.6:0/595614917 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13380cbe10 0x7f133815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.319+0000 7f1337e00640 1 --2- 172.21.15.6:0/595614917 >> v2:172.21.15.136:3300/0 conn(0x7f1338069840 0x7f13380cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.320+0000 7f132fe00640 1 -- 172.21.15.6:0/595614917 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13380cbe10 msgr2=0x7f133815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:29.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.320+0000 7f132fe00640 1 --2- 172.21.15.6:0/595614917 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13380cbe10 0x7f133815d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.320+0000 7f132fe00640 1 -- 172.21.15.6:0/595614917 >> v2:172.21.15.136:3300/0 conn(0x7f1338069840 msgr2=0x7f13380cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:29.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.320+0000 7f132fe00640 1 --2- 172.21.15.6:0/595614917 >> v2:172.21.15.136:3300/0 conn(0x7f1338069840 0x7f13380cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.320+0000 7f132fe00640 1 -- 172.21.15.6:0/595614917 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13380b0b10 con 0x7f13380cd550 2024-08-17T02:27:29.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.321+0000 7f132fe00640 1 --2- 172.21.15.6:0/595614917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380cd550 0x7f133815ce60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f133806d9d0 tx=0x7f13200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d81be184c04512 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:29.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.321+0000 7f1337400640 1 -- 172.21.15.6:0/595614917 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132002add0 con 0x7f13380cd550 2024-08-17T02:27:29.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.321+0000 7f1337400640 1 -- 172.21.15.6:0/595614917 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1320032440 con 0x7f13380cd550 2024-08-17T02:27:29.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.321+0000 7f1337400640 1 -- 172.21.15.6:0/595614917 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320032820 con 0x7f13380cd550 2024-08-17T02:27:29.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.321+0000 7f133d600640 1 -- 172.21.15.6:0/595614917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380cd550 msgr2=0x7f133815ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.321+0000 7f133d600640 1 --2- 172.21.15.6:0/595614917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380cd550 0x7f133815ce60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f133806d9d0 tx=0x7f13200091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.321+0000 7f133d600640 1 -- 172.21.15.6:0/595614917 shutdown_connections 2024-08-17T02:27:29.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.321+0000 7f133d600640 1 --2- 172.21.15.6:0/595614917 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13380cbe10 0x7f133815d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.322+0000 7f133d600640 1 --2- 172.21.15.6:0/595614917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380cd550 0x7f133815ce60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.322+0000 7f133d600640 1 --2- 172.21.15.6:0/595614917 >> v2:172.21.15.136:3300/0 conn(0x7f1338069840 0x7f13380cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.322+0000 7f133d600640 1 -- 172.21.15.6:0/595614917 >> 172.21.15.6:0/595614917 conn(0x7f1338066e60 msgr2=0x7f1338067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:29.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.322+0000 7f133d600640 1 -- 172.21.15.6:0/595614917 shutdown_connections 2024-08-17T02:27:29.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.322+0000 7f133d600640 1 -- 172.21.15.6:0/595614917 wait complete. 2024-08-17T02:27:29.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.323+0000 7f133d600640 1 Processor -- start 2024-08-17T02:27:29.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.323+0000 7f133d600640 1 -- start start 2024-08-17T02:27:29.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.324+0000 7f133d600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1338069840 0x7f133806c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.324+0000 7f133d600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380cbe10 0x7f1338153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.324+0000 7f133d600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f133806cd10 0x7f1338154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.324+0000 7f133d600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133815c790 con 0x7f13380cbe10 2024-08-17T02:27:29.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.324+0000 7f133d600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133815a5c0 con 0x7f133806cd10 2024-08-17T02:27:29.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.324+0000 7f133d600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133806c950 con 0x7f1338069840 2024-08-17T02:27:29.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.324+0000 7f132fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380cbe10 0x7f1338153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.324+0000 7f132fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380cbe10 0x7f1338153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41262/0 (socket says 172.21.15.6:41262) 2024-08-17T02:27:29.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.324+0000 7f132fe00640 1 -- 172.21.15.6:0/2141335431 learned_addr learned my addr 172.21.15.6:0/2141335431 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.324+0000 7f133cc00640 1 --2- 172.21.15.6:0/2141335431 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f133806cd10 0x7f1338154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.324+0000 7f1337e00640 1 --2- 172.21.15.6:0/2141335431 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1338069840 0x7f133806c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.325+0000 7f132fe00640 1 -- 172.21.15.6:0/2141335431 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1338069840 msgr2=0x7f133806c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.325+0000 7f132fe00640 1 --2- 172.21.15.6:0/2141335431 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1338069840 0x7f133806c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.325+0000 7f132fe00640 1 -- 172.21.15.6:0/2141335431 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f133806cd10 msgr2=0x7f1338154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.325+0000 7f132fe00640 1 --2- 172.21.15.6:0/2141335431 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f133806cd10 0x7f1338154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.325+0000 7f132fe00640 1 -- 172.21.15.6:0/2141335431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1320009450 con 0x7f13380cbe10 2024-08-17T02:27:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.325+0000 7f132fe00640 1 --2- 172.21.15.6:0/2141335431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380cbe10 0x7f1338153dd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1320009940 tx=0x7f1320032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.325+0000 7f132f400640 1 -- 172.21.15.6:0/2141335431 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320031de0 con 0x7f13380cbe10 2024-08-17T02:27:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.325+0000 7f132f400640 1 -- 172.21.15.6:0/2141335431 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1320000c40 con 0x7f13380cbe10 2024-08-17T02:27:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.325+0000 7f132f400640 1 -- 172.21.15.6:0/2141335431 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132003d690 con 0x7f13380cbe10 2024-08-17T02:27:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.325+0000 7f133d600640 1 -- 172.21.15.6:0/2141335431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133815c1d0 con 0x7f13380cbe10 2024-08-17T02:27:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.325+0000 7f133d600640 1 -- 172.21.15.6:0/2141335431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13380aa670 con 0x7f13380cbe10 2024-08-17T02:27:29.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.326+0000 7f133d600640 1 -- 172.21.15.6:0/2141335431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1338070720 con 0x7f13380cbe10 2024-08-17T02:27:29.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.327+0000 7f132f400640 1 -- 172.21.15.6:0/2141335431 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1320039040 con 0x7f13380cbe10 2024-08-17T02:27:29.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.328+0000 7f132f400640 1 --2- 172.21.15.6:0/2141335431 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1314065180 0x7f1314067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.328+0000 7f132f400640 1 -- 172.21.15.6:0/2141335431 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f13200a2760 con 0x7f13380cbe10 2024-08-17T02:27:29.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.328+0000 7f1337e00640 1 --2- 172.21.15.6:0/2141335431 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1314065180 0x7f1314067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.329+0000 7f1337e00640 1 --2- 172.21.15.6:0/2141335431 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1314065180 0x7f1314067630 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f132800bb40 tx=0x7f1328008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.332+0000 7f132f400640 1 -- 172.21.15.6:0/2141335431 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1320070840 con 0x7f13380cbe10 2024-08-17T02:27:29.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.551+0000 7f133d600640 1 -- 172.21.15.6:0/2141335431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f133815a700 con 0x7f13380cbe10 2024-08-17T02:27:29.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.551+0000 7f132f400640 1 -- 172.21.15.6:0/2141335431 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1320073e60 con 0x7f13380cbe10 2024-08-17T02:27:29.552 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:27:29.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.553+0000 7f133d600640 1 -- 172.21.15.6:0/2141335431 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1314065180 msgr2=0x7f1314067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.553+0000 7f133d600640 1 --2- 172.21.15.6:0/2141335431 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1314065180 0x7f1314067630 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f132800bb40 tx=0x7f1328008040 comp rx=0 tx=0).stop 2024-08-17T02:27:29.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.553+0000 7f133d600640 1 -- 172.21.15.6:0/2141335431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380cbe10 msgr2=0x7f1338153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.553+0000 7f133d600640 1 --2- 172.21.15.6:0/2141335431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380cbe10 0x7f1338153dd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1320009940 tx=0x7f1320032000 comp rx=0 tx=0).stop 2024-08-17T02:27:29.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.553+0000 7f133d600640 1 -- 172.21.15.6:0/2141335431 shutdown_connections 2024-08-17T02:27:29.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.553+0000 7f133d600640 1 --2- 172.21.15.6:0/2141335431 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1314065180 0x7f1314067630 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.553+0000 7f133d600640 1 --2- 172.21.15.6:0/2141335431 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f133806cd10 0x7f1338154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.553+0000 7f133d600640 1 --2- 172.21.15.6:0/2141335431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380cbe10 0x7f1338153dd0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.553+0000 7f133d600640 1 --2- 172.21.15.6:0/2141335431 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1338069840 0x7f133806c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.553+0000 7f133d600640 1 -- 172.21.15.6:0/2141335431 >> 172.21.15.6:0/2141335431 conn(0x7f1338066e60 msgr2=0x7f1338155250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.553+0000 7f133d600640 1 -- 172.21.15.6:0/2141335431 shutdown_connections 2024-08-17T02:27:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:29.553+0000 7f133d600640 1 -- 172.21.15.6:0/2141335431 wait complete. 2024-08-17T02:27:29.568 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:27:29.568 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:27:29.568 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2024-08-17T02:27:29.568 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:27:29.569 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:29.569 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:27:29.569 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:27:29.569 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:27:29.569 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:27:29.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:29.569 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2024-08-17T02:27:29.610 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:29.610 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:29.610 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:29.610 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:29.610 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:29.610 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:29.611 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:29.611 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:29.611 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2024-08-17T02:27:29.611 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:29.611 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:29.611 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2024-08-17T02:27:29.611 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:29.611 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:29.611 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:27:29.611 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:29.611 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:27:29.611 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42636sec preferred_lft 42636sec 2024-08-17T02:27:29.611 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec4:7aff:fe88:6e43/64 scope link 2024-08-17T02:27:29.612 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:29.612 INFO:teuthology.orchestra.run.smithi136.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:29.612 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 1a:23:6e:87:48:4b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:29.612 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:27:29.612 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:29.612 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::d489:d1ff:fe99:4ad7/64 scope link 2024-08-17T02:27:29.612 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:29.612 INFO:teuthology.orchestra.run.smithi136.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:29.612 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether b6:72:3e:1c:a3:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:27:29.612 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::b472:3eff:fe1c:a35b/64 scope link 2024-08-17T02:27:29.612 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:29.612 INFO:teuthology.orchestra.run.smithi136.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:29.612 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 1a:23:6e:87:48:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:27:29.612 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::1823:6eff:fe87:484b/64 scope link 2024-08-17T02:27:29.613 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:29.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:29.613 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:27:29.706 INFO:teuthology.orchestra.run.smithi136.stdout:1 2024-08-17T02:27:29.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:29.709 DEBUG:teuthology.orchestra.run.smithi136:> route 2024-08-17T02:27:29.747 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2024-08-17T02:27:29.747 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:27:29.747 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:27:29.747 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:27:29.747 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:27:29.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:29.748 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-08-17T02:27:29.748 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-08-17T02:27:29.748 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:27:29.748 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:27:29.748 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:27:29.748 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-08-17T02:27:29.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:29.899 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-08-17T02:27:29.934 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:27:29.934 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:27:29.935 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:27:29.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:29.935 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.0 up 2024-08-17T02:27:30.032 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:30.032 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:30.067 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:27:30.067 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:30.067 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:30.141 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:27:30.141 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:27:30.141 DEBUG:teuthology.orchestra.run.smithi136:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:30.262 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:30.262 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:30.291 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:30.291 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:30.292 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.136:3300,172.21.15.136:3301" 2024-08-17T02:27:30.292 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: trying mount with new device syntax: 1@61589148-c13d-47c7-8fbb-d1646bb8e5e2.cephfs=/ 2024-08-17T02:27:30.292 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2024-08-17T02:27:30.292 INFO:teuthology.orchestra.run.smithi136.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:27:30.293 INFO:teuthology.orchestra.run.smithi136.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:27:30.293 INFO:teuthology.orchestra.run.smithi136.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:27:30.293 INFO:teuthology.orchestra.run.smithi136.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:27:30.293 INFO:teuthology.orchestra.run.smithi136.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:27:30.296 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:27:30.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:30.296 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:30.354 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:27:30.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.514+0000 7f0052200640 1 Processor -- start 2024-08-17T02:27:30.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.514+0000 7f0052200640 1 -- start start 2024-08-17T02:27:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.515+0000 7f0052200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f004c0ac000 0x7f004c156a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.515+0000 7f0052200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f004c0ad020 0x7f004c159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.515+0000 7f0052200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004c159ad0 con 0x7f004c0afa00 2024-08-17T02:27:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.515+0000 7f0052200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f004c156f40 con 0x7f004c0ac000 2024-08-17T02:27:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.515+0000 7f0052200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004c0ad590 con 0x7f004c0ad020 2024-08-17T02:27:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.516+0000 7f004b400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f004c0ac000 0x7f004c156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.516+0000 7f004b400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f004c0ac000 0x7f004c156a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41274/0 (socket says 172.21.15.6:41274) 2024-08-17T02:27:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.516+0000 7f004b400640 1 -- 172.21.15.6:0/3649852015 learned_addr learned my addr 172.21.15.6:0/3649852015 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.516+0000 7f0043e00640 1 --2- 172.21.15.6:0/3649852015 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f004c0ad020 0x7f004c159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.516+0000 7f004b400640 1 -- 172.21.15.6:0/3649852015 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f004c0ad020 msgr2=0x7f004c159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.516+0000 7f004b400640 1 --2- 172.21.15.6:0/3649852015 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f004c0ad020 0x7f004c159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.516+0000 7f004b400640 1 -- 172.21.15.6:0/3649852015 >> v1:172.21.15.136:6789/0 conn(0x7f004c0afa00 legacy=0x7f004c157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.516+0000 7f004b400640 1 -- 172.21.15.6:0/3649852015 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c0ad870 con 0x7f004c0ac000 2024-08-17T02:27:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.517+0000 7f004b400640 1 --2- 172.21.15.6:0/3649852015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f004c0ac000 0x7f004c156a00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f003c009910 tx=0x7f003c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819d0935531d18d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.518+0000 7f004aa00640 1 -- 172.21.15.6:0/3649852015 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c02add0 con 0x7f004c0ac000 2024-08-17T02:27:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.518+0000 7f004aa00640 1 -- 172.21.15.6:0/3649852015 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c032440 con 0x7f004c0ac000 2024-08-17T02:27:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.518+0000 7f004aa00640 1 -- 172.21.15.6:0/3649852015 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c032820 con 0x7f004c0ac000 2024-08-17T02:27:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.518+0000 7f0052200640 1 -- 172.21.15.6:0/3649852015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f004c0ac000 msgr2=0x7f004c156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.518+0000 7f0052200640 1 --2- 172.21.15.6:0/3649852015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f004c0ac000 0x7f004c156a00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f003c009910 tx=0x7f003c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.518+0000 7f0052200640 1 -- 172.21.15.6:0/3649852015 shutdown_connections 2024-08-17T02:27:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.518+0000 7f0052200640 1 --2- 172.21.15.6:0/3649852015 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f004c0ad020 0x7f004c159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.518+0000 7f0052200640 1 --2- 172.21.15.6:0/3649852015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f004c0ac000 0x7f004c156a00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.518+0000 7f0052200640 1 -- 172.21.15.6:0/3649852015 >> 172.21.15.6:0/3649852015 conn(0x7f004c066e60 msgr2=0x7f004c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.518+0000 7f0052200640 1 -- 172.21.15.6:0/3649852015 shutdown_connections 2024-08-17T02:27:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.518+0000 7f0052200640 1 -- 172.21.15.6:0/3649852015 wait complete. 2024-08-17T02:27:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.520+0000 7f0052200640 1 Processor -- start 2024-08-17T02:27:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.520+0000 7f0052200640 1 -- start start 2024-08-17T02:27:30.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.521+0000 7f0052200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f004c0ac000 0x7f004c149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.521+0000 7f0052200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f004c0ad020 0x7f004c14e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.521+0000 7f0052200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f004c0afa00 0x7f004c14eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.521+0000 7f0052200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c14d0b0 con 0x7f004c0afa00 2024-08-17T02:27:30.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.521+0000 7f0052200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c14c4a0 con 0x7f004c0ad020 2024-08-17T02:27:30.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.521+0000 7f0052200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004c14c780 con 0x7f004c0ac000 2024-08-17T02:27:30.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.521+0000 7f004be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f004c0afa00 0x7f004c14eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.521+0000 7f004be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f004c0afa00 0x7f004c14eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41286/0 (socket says 172.21.15.6:41286) 2024-08-17T02:27:30.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.521+0000 7f004be00640 1 -- 172.21.15.6:0/482398530 learned_addr learned my addr 172.21.15.6:0/482398530 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:30.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.521+0000 7f0043e00640 1 --2- 172.21.15.6:0/482398530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f004c0ad020 0x7f004c14e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.521+0000 7f004b400640 1 --2- 172.21.15.6:0/482398530 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f004c0ac000 0x7f004c149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.522+0000 7f004be00640 1 -- 172.21.15.6:0/482398530 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f004c0ac000 msgr2=0x7f004c149510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.522+0000 7f004be00640 1 --2- 172.21.15.6:0/482398530 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f004c0ac000 0x7f004c149510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.522+0000 7f004be00640 1 -- 172.21.15.6:0/482398530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f004c0ad020 msgr2=0x7f004c14e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.522+0000 7f004be00640 1 --2- 172.21.15.6:0/482398530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f004c0ad020 0x7f004c14e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.522+0000 7f004be00640 1 -- 172.21.15.6:0/482398530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c009450 con 0x7f004c0afa00 2024-08-17T02:27:30.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.522+0000 7f004be00640 1 --2- 172.21.15.6:0/482398530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f004c0afa00 0x7f004c14eb80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f004400c860 tx=0x7f0044001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.522+0000 7f0042a00640 1 -- 172.21.15.6:0/482398530 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004400ce50 con 0x7f004c0afa00 2024-08-17T02:27:30.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.522+0000 7f0042a00640 1 -- 172.21.15.6:0/482398530 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004400a850 con 0x7f004c0afa00 2024-08-17T02:27:30.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.522+0000 7f0042a00640 1 -- 172.21.15.6:0/482398530 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004400ac10 con 0x7f004c0afa00 2024-08-17T02:27:30.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.522+0000 7f0052200640 1 -- 172.21.15.6:0/482398530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004c14ca60 con 0x7f004c0afa00 2024-08-17T02:27:30.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.522+0000 7f0052200640 1 -- 172.21.15.6:0/482398530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004c149a50 con 0x7f004c0afa00 2024-08-17T02:27:30.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.523+0000 7f0052200640 1 -- 172.21.15.6:0/482398530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004c063fb0 con 0x7f004c0afa00 2024-08-17T02:27:30.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.524+0000 7f0042a00640 1 -- 172.21.15.6:0/482398530 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0044012630 con 0x7f004c0afa00 2024-08-17T02:27:30.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.525+0000 7f0042a00640 1 --2- 172.21.15.6:0/482398530 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0028065150 0x7f0028067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.525+0000 7f0042a00640 1 -- 172.21.15.6:0/482398530 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0044082670 con 0x7f004c0afa00 2024-08-17T02:27:30.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.525+0000 7f004b400640 1 --2- 172.21.15.6:0/482398530 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0028065150 0x7f0028067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.526+0000 7f004b400640 1 --2- 172.21.15.6:0/482398530 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0028065150 0x7f0028067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f003c034000 tx=0x7f003c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.529+0000 7f0042a00640 1 -- 172.21.15.6:0/482398530 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0044050740 con 0x7f004c0afa00 2024-08-17T02:27:30.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.750+0000 7f0052200640 1 -- 172.21.15.6:0/482398530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f004c067c10 con 0x7f004c0afa00 2024-08-17T02:27:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.888+0000 7f0042a00640 1 -- 172.21.15.6:0/482398530 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 136+0+0 (secure 0 0 0) 0x7f0044053d60 con 0x7f004c0afa00 2024-08-17T02:27:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.891+0000 7f0052200640 1 -- 172.21.15.6:0/482398530 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0028065150 msgr2=0x7f0028067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.891+0000 7f0052200640 1 --2- 172.21.15.6:0/482398530 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0028065150 0x7f0028067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f003c034000 tx=0x7f003c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.891+0000 7f0052200640 1 -- 172.21.15.6:0/482398530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f004c0afa00 msgr2=0x7f004c14eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.891+0000 7f0052200640 1 --2- 172.21.15.6:0/482398530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f004c0afa00 0x7f004c14eb80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f004400c860 tx=0x7f0044001690 comp rx=0 tx=0).stop 2024-08-17T02:27:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.891+0000 7f0052200640 1 -- 172.21.15.6:0/482398530 shutdown_connections 2024-08-17T02:27:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.891+0000 7f0052200640 1 --2- 172.21.15.6:0/482398530 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0028065150 0x7f0028067600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.891+0000 7f0052200640 1 --2- 172.21.15.6:0/482398530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f004c0afa00 0x7f004c14eb80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.891+0000 7f0052200640 1 --2- 172.21.15.6:0/482398530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f004c0ad020 0x7f004c14e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.891+0000 7f0052200640 1 --2- 172.21.15.6:0/482398530 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f004c0ac000 0x7f004c149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.891+0000 7f0052200640 1 -- 172.21.15.6:0/482398530 >> 172.21.15.6:0/482398530 conn(0x7f004c066e60 msgr2=0x7f004c069970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.891+0000 7f0052200640 1 -- 172.21.15.6:0/482398530 shutdown_connections 2024-08-17T02:27:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:30.891+0000 7f0052200640 1 -- 172.21.15.6:0/482398530 wait complete. 2024-08-17T02:27:30.907 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:27:31.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.059+0000 7f3266200640 1 Processor -- start 2024-08-17T02:27:31.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.060+0000 7f3266200640 1 -- start start 2024-08-17T02:27:31.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.061+0000 7f3266200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f32600ae540 0x7f3260068950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.061+0000 7f3266200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3260068e90 0x7f32600ae910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.061+0000 7f3266200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32600aab10 con 0x7f32600aee50 2024-08-17T02:27:31.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.061+0000 7f3266200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32600ac250 con 0x7f32600ae540 2024-08-17T02:27:31.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.061+0000 7f3266200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32600693e0 con 0x7f3260068e90 2024-08-17T02:27:31.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.061+0000 7f3264e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f32600ae540 0x7f3260068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.061+0000 7f3264e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f32600ae540 0x7f3260068950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41298/0 (socket says 172.21.15.6:41298) 2024-08-17T02:27:31.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.061+0000 7f3264e00640 1 -- 172.21.15.6:0/4130504200 learned_addr learned my addr 172.21.15.6:0/4130504200 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:31.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.061+0000 7f3257e00640 1 --2- 172.21.15.6:0/4130504200 >> v2:172.21.15.136:3300/0 conn(0x7f3260068e90 0x7f32600ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.062+0000 7f3264e00640 1 -- 172.21.15.6:0/4130504200 >> v2:172.21.15.136:3300/0 conn(0x7f3260068e90 msgr2=0x7f32600ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.062+0000 7f3264e00640 1 --2- 172.21.15.6:0/4130504200 >> v2:172.21.15.136:3300/0 conn(0x7f3260068e90 0x7f32600ae910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.062+0000 7f3264e00640 1 -- 172.21.15.6:0/4130504200 >> v1:172.21.15.136:6789/0 conn(0x7f32600aee50 legacy=0x7f32600aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.062+0000 7f3264e00640 1 -- 172.21.15.6:0/4130504200 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32600696c0 con 0x7f32600ae540 2024-08-17T02:27:31.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.063+0000 7f3264e00640 1 --2- 172.21.15.6:0/4130504200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32600ae540 0x7f3260068950 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f326006f4a0 tx=0x7f32500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8597898f295e11a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.063+0000 7f325fe00640 1 -- 172.21.15.6:0/4130504200 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325002adf0 con 0x7f32600ae540 2024-08-17T02:27:31.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.063+0000 7f325fe00640 1 -- 172.21.15.6:0/4130504200 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3250032440 con 0x7f32600ae540 2024-08-17T02:27:31.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.063+0000 7f325fe00640 1 -- 172.21.15.6:0/4130504200 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250032820 con 0x7f32600ae540 2024-08-17T02:27:31.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.063+0000 7f3266200640 1 -- 172.21.15.6:0/4130504200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32600ae540 msgr2=0x7f3260068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.063+0000 7f3266200640 1 --2- 172.21.15.6:0/4130504200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32600ae540 0x7f3260068950 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f326006f4a0 tx=0x7f32500091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.064+0000 7f3266200640 1 -- 172.21.15.6:0/4130504200 shutdown_connections 2024-08-17T02:27:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.064+0000 7f3266200640 1 --2- 172.21.15.6:0/4130504200 >> v2:172.21.15.136:3300/0 conn(0x7f3260068e90 0x7f32600ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.064+0000 7f3266200640 1 --2- 172.21.15.6:0/4130504200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32600ae540 0x7f3260068950 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.064+0000 7f3266200640 1 -- 172.21.15.6:0/4130504200 >> 172.21.15.6:0/4130504200 conn(0x7f32600ce400 msgr2=0x7f3260095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.064+0000 7f3266200640 1 -- 172.21.15.6:0/4130504200 shutdown_connections 2024-08-17T02:27:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.064+0000 7f3266200640 1 -- 172.21.15.6:0/4130504200 wait complete. 2024-08-17T02:27:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.065+0000 7f3266200640 1 Processor -- start 2024-08-17T02:27:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.065+0000 7f3266200640 1 -- start start 2024-08-17T02:27:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.066+0000 7f3266200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3260068e90 0x7f3260145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.066+0000 7f3266200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f32600ae540 0x7f326009ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.066+0000 7f3266200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32600aee50 0x7f326009b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.066+0000 7f3266200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3260098110 con 0x7f32600aee50 2024-08-17T02:27:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.066+0000 7f3266200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3260098f00 con 0x7f3260068e90 2024-08-17T02:27:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.066+0000 7f3266200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32601462e0 con 0x7f32600ae540 2024-08-17T02:27:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.066+0000 7f3265800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32600aee50 0x7f326009b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.066+0000 7f3265800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32600aee50 0x7f326009b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41300/0 (socket says 172.21.15.6:41300) 2024-08-17T02:27:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.066+0000 7f3264e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3260068e90 0x7f3260145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.066+0000 7f3265800640 1 -- 172.21.15.6:0/1293047154 learned_addr learned my addr 172.21.15.6:0/1293047154 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.066+0000 7f3257e00640 1 --2- 172.21.15.6:0/1293047154 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f32600ae540 0x7f326009ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.067+0000 7f3265800640 1 -- 172.21.15.6:0/1293047154 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f32600ae540 msgr2=0x7f326009ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.067+0000 7f3265800640 1 --2- 172.21.15.6:0/1293047154 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f32600ae540 0x7f326009ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.067+0000 7f3265800640 1 -- 172.21.15.6:0/1293047154 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3260068e90 msgr2=0x7f3260145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.067+0000 7f3265800640 1 --2- 172.21.15.6:0/1293047154 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3260068e90 0x7f3260145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.067+0000 7f3265800640 1 -- 172.21.15.6:0/1293047154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3250009450 con 0x7f32600aee50 2024-08-17T02:27:31.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.067+0000 7f3265800640 1 --2- 172.21.15.6:0/1293047154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32600aee50 0x7f326009b040 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f325800c860 tx=0x7f3258001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.067+0000 7f325cc00640 1 -- 172.21.15.6:0/1293047154 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325800ce50 con 0x7f32600aee50 2024-08-17T02:27:31.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.067+0000 7f325cc00640 1 -- 172.21.15.6:0/1293047154 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325800a850 con 0x7f32600aee50 2024-08-17T02:27:31.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.067+0000 7f3266200640 1 -- 172.21.15.6:0/1293047154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32600982f0 con 0x7f32600aee50 2024-08-17T02:27:31.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.067+0000 7f325cc00640 1 -- 172.21.15.6:0/1293047154 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325800ac10 con 0x7f32600aee50 2024-08-17T02:27:31.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.067+0000 7f3266200640 1 -- 172.21.15.6:0/1293047154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32600988b0 con 0x7f32600aee50 2024-08-17T02:27:31.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.069+0000 7f3266200640 1 -- 172.21.15.6:0/1293047154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32600990b0 con 0x7f32600aee50 2024-08-17T02:27:31.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.069+0000 7f325cc00640 1 -- 172.21.15.6:0/1293047154 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3258012630 con 0x7f32600aee50 2024-08-17T02:27:31.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.070+0000 7f325cc00640 1 --2- 172.21.15.6:0/1293047154 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f323c065150 0x7f323c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.070+0000 7f325cc00640 1 -- 172.21.15.6:0/1293047154 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f32580825d0 con 0x7f32600aee50 2024-08-17T02:27:31.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.070+0000 7f3264e00640 1 --2- 172.21.15.6:0/1293047154 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f323c065150 0x7f323c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.071+0000 7f3264e00640 1 --2- 172.21.15.6:0/1293047154 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f323c065150 0x7f323c067600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3250034000 tx=0x7f3250032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.073+0000 7f325cc00640 1 -- 172.21.15.6:0/1293047154 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f32600990b0 con 0x7f32600aee50 2024-08-17T02:27:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.279+0000 7f3266200640 1 -- 172.21.15.6:0/1293047154 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3260099070 con 0x7f323c065150 2024-08-17T02:27:31.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.281+0000 7f325cc00640 1 -- 172.21.15.6:0/1293047154 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3260099070 con 0x7f323c065150 2024-08-17T02:27:31.282 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-08-17T02:27:31.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:31.282 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephfs" 2024-08-17T02:27:31.282 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:31.282 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-08-17T02:27:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.283+0000 7f3266200640 1 -- 172.21.15.6:0/1293047154 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f323c065150 msgr2=0x7f323c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.283+0000 7f3266200640 1 --2- 172.21.15.6:0/1293047154 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f323c065150 0x7f323c067600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3250034000 tx=0x7f3250032000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.283+0000 7f3266200640 1 -- 172.21.15.6:0/1293047154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32600aee50 msgr2=0x7f326009b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.283+0000 7f3266200640 1 --2- 172.21.15.6:0/1293047154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32600aee50 0x7f326009b040 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f325800c860 tx=0x7f3258001690 comp rx=0 tx=0).stop 2024-08-17T02:27:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.283+0000 7f3266200640 1 -- 172.21.15.6:0/1293047154 shutdown_connections 2024-08-17T02:27:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.283+0000 7f3266200640 1 --2- 172.21.15.6:0/1293047154 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f323c065150 0x7f323c067600 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.283+0000 7f3266200640 1 --2- 172.21.15.6:0/1293047154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32600aee50 0x7f326009b040 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.283+0000 7f3266200640 1 --2- 172.21.15.6:0/1293047154 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f32600ae540 0x7f326009ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.283+0000 7f3266200640 1 --2- 172.21.15.6:0/1293047154 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3260068e90 0x7f3260145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.283+0000 7f3266200640 1 -- 172.21.15.6:0/1293047154 >> 172.21.15.6:0/1293047154 conn(0x7f32600ce400 msgr2=0x7f32600b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.283+0000 7f3266200640 1 -- 172.21.15.6:0/1293047154 shutdown_connections 2024-08-17T02:27:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.283+0000 7f3266200640 1 -- 172.21.15.6:0/1293047154 wait complete. 2024-08-17T02:27:31.299 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:27:31.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.452+0000 7f1abc600640 1 Processor -- start 2024-08-17T02:27:31.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.452+0000 7f1abc600640 1 -- start start 2024-08-17T02:27:31.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.453+0000 7f1abc600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1ab40afca0 0x7f1ab40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.453+0000 7f1abc600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1ab40acf10 0x7f1ab4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.453+0000 7f1abc600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ab41589a0 0x7f1ab4158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.454+0000 7f1abc600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab40b0980 con 0x7f1ab41589a0 2024-08-17T02:27:31.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.454+0000 7f1abc600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab415a4e0 con 0x7f1ab40acf10 2024-08-17T02:27:31.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.454+0000 7f1abc600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40c92b0 con 0x7f1ab40afca0 2024-08-17T02:27:31.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.454+0000 7f1aba600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ab41589a0 0x7f1ab4158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.454+0000 7f1aba600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ab41589a0 0x7f1ab4158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41306/0 (socket says 172.21.15.6:41306) 2024-08-17T02:27:31.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.454+0000 7f1ab9200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1ab40acf10 0x7f1ab4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.454+0000 7f1aba600640 1 -- 172.21.15.6:0/922207177 learned_addr learned my addr 172.21.15.6:0/922207177 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:31.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.454+0000 7f1ab9c00640 1 --2- 172.21.15.6:0/922207177 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1ab40afca0 0x7f1ab40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.454+0000 7f1aba600640 1 -- 172.21.15.6:0/922207177 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1ab40afca0 msgr2=0x7f1ab40b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.454+0000 7f1aba600640 1 --2- 172.21.15.6:0/922207177 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1ab40afca0 0x7f1ab40b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.454+0000 7f1aba600640 1 -- 172.21.15.6:0/922207177 >> v2:172.21.15.136:3300/0 conn(0x7f1ab40acf10 msgr2=0x7f1ab4159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.454+0000 7f1aba600640 1 --2- 172.21.15.6:0/922207177 >> v2:172.21.15.136:3300/0 conn(0x7f1ab40acf10 0x7f1ab4159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.454+0000 7f1aba600640 1 -- 172.21.15.6:0/922207177 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab4159360 con 0x7f1ab41589a0 2024-08-17T02:27:31.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.455+0000 7f1aba600640 1 --2- 172.21.15.6:0/922207177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ab41589a0 0x7f1ab4158e20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009f50 tx=0x7f1aac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ab9309a3da0c9b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.456+0000 7f1ab3e00640 1 -- 172.21.15.6:0/922207177 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac007400 con 0x7f1ab41589a0 2024-08-17T02:27:31.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.456+0000 7f1ab3e00640 1 -- 172.21.15.6:0/922207177 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac007560 con 0x7f1ab41589a0 2024-08-17T02:27:31.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.456+0000 7f1ab3e00640 1 -- 172.21.15.6:0/922207177 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac007900 con 0x7f1ab41589a0 2024-08-17T02:27:31.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.456+0000 7f1abc600640 1 -- 172.21.15.6:0/922207177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ab41589a0 msgr2=0x7f1ab4158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.456+0000 7f1abc600640 1 --2- 172.21.15.6:0/922207177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ab41589a0 0x7f1ab4158e20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009f50 tx=0x7f1aac009840 comp rx=0 tx=0).stop 2024-08-17T02:27:31.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.456+0000 7f1abc600640 1 -- 172.21.15.6:0/922207177 shutdown_connections 2024-08-17T02:27:31.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.456+0000 7f1abc600640 1 --2- 172.21.15.6:0/922207177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ab41589a0 0x7f1ab4158e20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.456+0000 7f1abc600640 1 --2- 172.21.15.6:0/922207177 >> v2:172.21.15.136:3300/0 conn(0x7f1ab40acf10 0x7f1ab4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.456+0000 7f1abc600640 1 --2- 172.21.15.6:0/922207177 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1ab40afca0 0x7f1ab40b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.456+0000 7f1abc600640 1 -- 172.21.15.6:0/922207177 >> 172.21.15.6:0/922207177 conn(0x7f1ab4066e60 msgr2=0x7f1ab4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.456+0000 7f1abc600640 1 -- 172.21.15.6:0/922207177 shutdown_connections 2024-08-17T02:27:31.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.456+0000 7f1abc600640 1 -- 172.21.15.6:0/922207177 wait complete. 2024-08-17T02:27:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.458+0000 7f1abc600640 1 Processor -- start 2024-08-17T02:27:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.458+0000 7f1abc600640 1 -- start start 2024-08-17T02:27:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.459+0000 7f1abc600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ab40acf10 0x7f1ab41453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.459+0000 7f1abc600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ab40afca0 0x7f1ab414aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.459+0000 7f1abc600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1ab41589a0 0x7f1ab40ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.459+0000 7f1abc600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab4145e20 con 0x7f1ab40afca0 2024-08-17T02:27:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.459+0000 7f1abc600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab4146070 con 0x7f1ab40acf10 2024-08-17T02:27:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.459+0000 7f1abc600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab4146350 con 0x7f1ab41589a0 2024-08-17T02:27:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.459+0000 7f1ab9200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ab40afca0 0x7f1ab414aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.459+0000 7f1ab9200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ab40afca0 0x7f1ab414aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41312/0 (socket says 172.21.15.6:41312) 2024-08-17T02:27:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.459+0000 7f1ab9200640 1 -- 172.21.15.6:0/3898460079 learned_addr learned my addr 172.21.15.6:0/3898460079 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.459+0000 7f1ab9c00640 1 --2- 172.21.15.6:0/3898460079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ab40acf10 0x7f1ab41453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.459+0000 7f1aba600640 1 --2- 172.21.15.6:0/3898460079 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1ab41589a0 0x7f1ab40ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.459+0000 7f1ab9200640 1 -- 172.21.15.6:0/3898460079 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1ab41589a0 msgr2=0x7f1ab40ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.459+0000 7f1ab9200640 1 --2- 172.21.15.6:0/3898460079 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1ab41589a0 0x7f1ab40ca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.459+0000 7f1ab9200640 1 -- 172.21.15.6:0/3898460079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ab40acf10 msgr2=0x7f1ab41453b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.459+0000 7f1ab9200640 1 --2- 172.21.15.6:0/3898460079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ab40acf10 0x7f1ab41453b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.459+0000 7f1ab9200640 1 -- 172.21.15.6:0/3898460079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac009ae0 con 0x7f1ab40afca0 2024-08-17T02:27:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.460+0000 7f1ab9200640 1 --2- 172.21.15.6:0/3898460079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ab40afca0 0x7f1ab414aca0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000e900 tx=0x7f1aa00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.460+0000 7f1ab0c00640 1 -- 172.21.15.6:0/3898460079 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa000c970 con 0x7f1ab40afca0 2024-08-17T02:27:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.460+0000 7f1ab0c00640 1 -- 172.21.15.6:0/3898460079 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa000cad0 con 0x7f1ab40afca0 2024-08-17T02:27:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.460+0000 7f1abc600640 1 -- 172.21.15.6:0/3898460079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab4146630 con 0x7f1ab40afca0 2024-08-17T02:27:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.460+0000 7f1ab0c00640 1 -- 172.21.15.6:0/3898460079 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa000ce70 con 0x7f1ab40afca0 2024-08-17T02:27:31.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.460+0000 7f1abc600640 1 -- 172.21.15.6:0/3898460079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab4146bf0 con 0x7f1ab40afca0 2024-08-17T02:27:31.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.461+0000 7f1abc600640 1 -- 172.21.15.6:0/3898460079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab4063fb0 con 0x7f1ab40afca0 2024-08-17T02:27:31.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.462+0000 7f1ab0c00640 1 -- 172.21.15.6:0/3898460079 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1aa0013680 con 0x7f1ab40afca0 2024-08-17T02:27:31.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.463+0000 7f1ab0c00640 1 --2- 172.21.15.6:0/3898460079 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1a94065150 0x7f1a94067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.463+0000 7f1ab0c00640 1 -- 172.21.15.6:0/3898460079 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1aa00826a0 con 0x7f1ab40afca0 2024-08-17T02:27:31.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.463+0000 7f1ab9c00640 1 --2- 172.21.15.6:0/3898460079 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1a94065150 0x7f1a94067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.464+0000 7f1ab9c00640 1 --2- 172.21.15.6:0/3898460079 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1a94065150 0x7f1a94067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009c80 tx=0x7f1aa80090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.467+0000 7f1ab0c00640 1 -- 172.21.15.6:0/3898460079 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1aa0050770 con 0x7f1ab40afca0 2024-08-17T02:27:31.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.648+0000 7f1abc600640 1 -- 172.21.15.6:0/3898460079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1ab4067b70 con 0x7f1ab40afca0 2024-08-17T02:27:31.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.648+0000 7f1ab0c00640 1 -- 172.21.15.6:0/3898460079 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1aa0053d90 con 0x7f1ab40afca0 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.650+0000 7f1abc600640 1 -- 172.21.15.6:0/3898460079 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1a94065150 msgr2=0x7f1a94067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.650+0000 7f1abc600640 1 --2- 172.21.15.6:0/3898460079 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1a94065150 0x7f1a94067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009c80 tx=0x7f1aa80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.650+0000 7f1abc600640 1 -- 172.21.15.6:0/3898460079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ab40afca0 msgr2=0x7f1ab414aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.650+0000 7f1abc600640 1 --2- 172.21.15.6:0/3898460079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ab40afca0 0x7f1ab414aca0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000e900 tx=0x7f1aa00090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.650+0000 7f1abc600640 1 -- 172.21.15.6:0/3898460079 shutdown_connections 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.650+0000 7f1abc600640 1 --2- 172.21.15.6:0/3898460079 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1a94065150 0x7f1a94067600 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.650+0000 7f1abc600640 1 --2- 172.21.15.6:0/3898460079 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1ab41589a0 0x7f1ab40ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.650+0000 7f1abc600640 1 --2- 172.21.15.6:0/3898460079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ab40afca0 0x7f1ab414aca0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.650+0000 7f1abc600640 1 --2- 172.21.15.6:0/3898460079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ab40acf10 0x7f1ab41453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.650+0000 7f1abc600640 1 -- 172.21.15.6:0/3898460079 >> 172.21.15.6:0/3898460079 conn(0x7f1ab4066e60 msgr2=0x7f1ab40ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.650+0000 7f1abc600640 1 -- 172.21.15.6:0/3898460079 shutdown_connections 2024-08-17T02:27:31.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.650+0000 7f1abc600640 1 -- 172.21.15.6:0/3898460079 wait complete. 2024-08-17T02:27:31.666 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000329200 2024-08-17T02:27:31.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.818+0000 7f5bc6e00640 1 Processor -- start 2024-08-17T02:27:31.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.818+0000 7f5bc6e00640 1 -- start start 2024-08-17T02:27:31.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.819+0000 7f5bc6e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bc0158b90 0x7f5bc00b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.819+0000 7f5bc6e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bc00af130 0x7f5bc00ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.819+0000 7f5bc6e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc00afd20 con 0x7f5bc00b2370 2024-08-17T02:27:31.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.819+0000 7f5bc6e00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc00affe0 con 0x7f5bc0158b90 2024-08-17T02:27:31.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.819+0000 7f5bc6e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00b02c0 con 0x7f5bc00af130 2024-08-17T02:27:31.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.820+0000 7f5bbfe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bc0158b90 0x7f5bc00b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.820+0000 7f5bbfe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bc0158b90 0x7f5bc00b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41318/0 (socket says 172.21.15.6:41318) 2024-08-17T02:27:31.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.820+0000 7f5bbfe00640 1 -- 172.21.15.6:0/1332949885 learned_addr learned my addr 172.21.15.6:0/1332949885 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:31.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.820+0000 7f5bc4e00640 1 --2- 172.21.15.6:0/1332949885 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bc00af130 0x7f5bc00ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.820+0000 7f5bbfe00640 1 -- 172.21.15.6:0/1332949885 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bc00af130 msgr2=0x7f5bc00ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.820+0000 7f5bbfe00640 1 --2- 172.21.15.6:0/1332949885 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bc00af130 0x7f5bc00ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.820+0000 7f5bbfe00640 1 -- 172.21.15.6:0/1332949885 >> v1:172.21.15.136:6789/0 conn(0x7f5bc00b2370 legacy=0x7f5bc00aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.820+0000 7f5bbfe00640 1 -- 172.21.15.6:0/1332949885 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc00ca3c0 con 0x7f5bc0158b90 2024-08-17T02:27:31.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.820+0000 7f5bc4e00640 1 --2- 172.21.15.6:0/1332949885 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bc00af130 0x7f5bc00ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:31.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.821+0000 7f5bbfe00640 1 --2- 172.21.15.6:0/1332949885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc0158b90 0x7f5bc00b1e30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009910 tx=0x7f5bb00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2038457a1bd2279d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.822+0000 7f5bbf400640 1 -- 172.21.15.6:0/1332949885 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb002ae40 con 0x7f5bc0158b90 2024-08-17T02:27:31.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.822+0000 7f5bbf400640 1 -- 172.21.15.6:0/1332949885 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb0032440 con 0x7f5bc0158b90 2024-08-17T02:27:31.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.822+0000 7f5bbf400640 1 -- 172.21.15.6:0/1332949885 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0032820 con 0x7f5bc0158b90 2024-08-17T02:27:31.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.822+0000 7f5bc6e00640 1 -- 172.21.15.6:0/1332949885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc0158b90 msgr2=0x7f5bc00b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.822+0000 7f5bc6e00640 1 --2- 172.21.15.6:0/1332949885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc0158b90 0x7f5bc00b1e30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009910 tx=0x7f5bb00091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.822+0000 7f5bc6e00640 1 -- 172.21.15.6:0/1332949885 shutdown_connections 2024-08-17T02:27:31.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.822+0000 7f5bc6e00640 1 --2- 172.21.15.6:0/1332949885 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bc00af130 0x7f5bc00ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.822+0000 7f5bc6e00640 1 --2- 172.21.15.6:0/1332949885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc0158b90 0x7f5bc00b1e30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.822+0000 7f5bc6e00640 1 -- 172.21.15.6:0/1332949885 >> 172.21.15.6:0/1332949885 conn(0x7f5bc006e590 msgr2=0x7f5bc006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.822+0000 7f5bc6e00640 1 -- 172.21.15.6:0/1332949885 shutdown_connections 2024-08-17T02:27:31.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.822+0000 7f5bc6e00640 1 -- 172.21.15.6:0/1332949885 wait complete. 2024-08-17T02:27:31.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.824+0000 7f5bc6e00640 1 Processor -- start 2024-08-17T02:27:31.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.824+0000 7f5bc6e00640 1 -- start start 2024-08-17T02:27:31.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bc6e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc00af130 0x7f5bc015b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bc6e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bc00b2370 0x7f5bc015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bc6e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bc0158b90 0x7f5bc0158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bc6e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00a6660 con 0x7f5bc00af130 2024-08-17T02:27:31.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bc6e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00a74c0 con 0x7f5bc0158b90 2024-08-17T02:27:31.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bc6e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00a68b0 con 0x7f5bc00b2370 2024-08-17T02:27:31.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bbfe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc00af130 0x7f5bc015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bbfe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc00af130 0x7f5bc015b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41320/0 (socket says 172.21.15.6:41320) 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bbfe00640 1 -- 172.21.15.6:0/660461657 learned_addr learned my addr 172.21.15.6:0/660461657 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bbfe00640 1 -- 172.21.15.6:0/660461657 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bc00b2370 msgr2=0x7f5bc015bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bc4e00640 1 --2- 172.21.15.6:0/660461657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bc0158b90 0x7f5bc0158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bb7e00640 1 --2- 172.21.15.6:0/660461657 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bc00b2370 0x7f5bc015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bbfe00640 1 --2- 172.21.15.6:0/660461657 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bc00b2370 0x7f5bc015bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bbfe00640 1 -- 172.21.15.6:0/660461657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bc0158b90 msgr2=0x7f5bc0158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bbfe00640 1 --2- 172.21.15.6:0/660461657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bc0158b90 0x7f5bc0158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bbfe00640 1 -- 172.21.15.6:0/660461657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb0009450 con 0x7f5bc00af130 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bc4e00640 1 --2- 172.21.15.6:0/660461657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bc0158b90 0x7f5bc0158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.825+0000 7f5bb7e00640 1 --2- 172.21.15.6:0/660461657 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bc00b2370 0x7f5bc015bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:31.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.826+0000 7f5bbfe00640 1 --2- 172.21.15.6:0/660461657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc00af130 0x7f5bc015b600 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009970 tx=0x7f5bb0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.826+0000 7f5bb7400640 1 -- 172.21.15.6:0/660461657 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0000c90 con 0x7f5bc00af130 2024-08-17T02:27:31.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.826+0000 7f5bb7400640 1 -- 172.21.15.6:0/660461657 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb0031a40 con 0x7f5bc00af130 2024-08-17T02:27:31.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.826+0000 7f5bc6e00640 1 -- 172.21.15.6:0/660461657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc00a6b90 con 0x7f5bc00af130 2024-08-17T02:27:31.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.826+0000 7f5bb7400640 1 -- 172.21.15.6:0/660461657 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0031e00 con 0x7f5bc00af130 2024-08-17T02:27:31.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.826+0000 7f5bc6e00640 1 -- 172.21.15.6:0/660461657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc00a7150 con 0x7f5bc00af130 2024-08-17T02:27:31.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.827+0000 7f5bc6e00640 1 -- 172.21.15.6:0/660461657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc0063fb0 con 0x7f5bc00af130 2024-08-17T02:27:31.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.828+0000 7f5bb7400640 1 -- 172.21.15.6:0/660461657 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5bb0039040 con 0x7f5bc00af130 2024-08-17T02:27:31.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.829+0000 7f5bb7400640 1 --2- 172.21.15.6:0/660461657 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5b9c065150 0x7f5b9c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.829+0000 7f5bb7400640 1 -- 172.21.15.6:0/660461657 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5bb002ae40 con 0x7f5bc00af130 2024-08-17T02:27:31.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.829+0000 7f5bb7e00640 1 --2- 172.21.15.6:0/660461657 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5b9c065150 0x7f5b9c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.830+0000 7f5bb7e00640 1 --2- 172.21.15.6:0/660461657 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5b9c065150 0x7f5b9c067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00c6460 tx=0x7f5ba8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:31.833+0000 7f5bb7400640 1 -- 172.21.15.6:0/660461657 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5bb00700f0 con 0x7f5bc00af130 2024-08-17T02:27:32.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:32.042+0000 7f5bc6e00640 1 -- 172.21.15.6:0/660461657 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000329200", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bc00a7600 con 0x7f5b9c065150 2024-08-17T02:27:34.177 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:34.182 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:34.917+0000 7f5bb7400640 1 -- 172.21.15.6:0/660461657 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f5ba8001d50 con 0x7f5b9c065150 2024-08-17T02:27:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:27:34.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:34.923+0000 7f5bc6e00640 1 -- 172.21.15.6:0/660461657 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5b9c065150 msgr2=0x7f5b9c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:34.923+0000 7f5bc6e00640 1 --2- 172.21.15.6:0/660461657 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5b9c065150 0x7f5b9c067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00c6460 tx=0x7f5ba8009040 comp rx=0 tx=0).stop 2024-08-17T02:27:34.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:34.923+0000 7f5bc6e00640 1 -- 172.21.15.6:0/660461657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc00af130 msgr2=0x7f5bc015b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:34.923+0000 7f5bc6e00640 1 --2- 172.21.15.6:0/660461657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc00af130 0x7f5bc015b600 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009970 tx=0x7f5bb0032000 comp rx=0 tx=0).stop 2024-08-17T02:27:34.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:34.924+0000 7f5bc6e00640 1 -- 172.21.15.6:0/660461657 shutdown_connections 2024-08-17T02:27:34.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:34.924+0000 7f5bc6e00640 1 --2- 172.21.15.6:0/660461657 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f5b9c065150 0x7f5b9c067600 secure :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00c6460 tx=0x7f5ba8009040 comp rx=0 tx=0).stop 2024-08-17T02:27:34.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:34.924+0000 7f5bc6e00640 1 --2- 172.21.15.6:0/660461657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bc0158b90 0x7f5bc0158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:34.924+0000 7f5bc6e00640 1 --2- 172.21.15.6:0/660461657 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bc00b2370 0x7f5bc015bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:34.924+0000 7f5bc6e00640 1 --2- 172.21.15.6:0/660461657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc00af130 0x7f5bc015b600 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:34.924+0000 7f5bc6e00640 1 -- 172.21.15.6:0/660461657 >> 172.21.15.6:0/660461657 conn(0x7f5bc006e590 msgr2=0x7f5bc01582a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:34.924+0000 7f5bc6e00640 1 -- 172.21.15.6:0/660461657 shutdown_connections 2024-08-17T02:27:34.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:34.925+0000 7f5bc6e00640 1 -- 172.21.15.6:0/660461657 wait complete. 2024-08-17T02:27:34.951 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:27:35.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.106+0000 7f6c8fc00640 1 Processor -- start 2024-08-17T02:27:35.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.106+0000 7f6c8fc00640 1 -- start start 2024-08-17T02:27:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.107+0000 7f6c8fc00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6c88155040 0x7f6c88158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.107+0000 7f6c8fc00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c8806e770 0x7f6c880af340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.107+0000 7f6c8fc00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c880aeeb0 con 0x7f6c881591c0 2024-08-17T02:27:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.107+0000 7f6c8fc00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c88159610 con 0x7f6c8806e770 2024-08-17T02:27:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.107+0000 7f6c8fc00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c880aadd0 con 0x7f6c88155040 2024-08-17T02:27:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.108+0000 7f6c8dc00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c8806e770 0x7f6c880af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.108+0000 7f6c87e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6c881591c0 0x7f6c8806e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39238/0 (socket says 172.21.15.6:39238) 2024-08-17T02:27:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.108+0000 7f6c87e00640 1 -- 172.21.15.6:0/3244642593 learned_addr learned my addr 172.21.15.6:0/3244642593 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.108+0000 7f6c8dc00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c8806e770 0x7f6c880af340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56878/0 (socket says 172.21.15.6:56878) 2024-08-17T02:27:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.108+0000 7f6c8d200640 1 --2- 172.21.15.6:0/3244642593 >> v2:172.21.15.136:3300/0 conn(0x7f6c88155040 0x7f6c88158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.108+0000 7f6c8dc00640 1 -- 172.21.15.6:0/3244642593 >> v2:172.21.15.136:3300/0 conn(0x7f6c88155040 msgr2=0x7f6c88158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.108+0000 7f6c8dc00640 1 --2- 172.21.15.6:0/3244642593 >> v2:172.21.15.136:3300/0 conn(0x7f6c88155040 0x7f6c88158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.108+0000 7f6c8dc00640 1 -- 172.21.15.6:0/3244642593 >> v1:172.21.15.6:6789/0 conn(0x7f6c881591c0 legacy=0x7f6c8806e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.108+0000 7f6c87400640 1 -- 172.21.15.6:0/3244642593 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273478908 0 0) 0x7f6c880aeeb0 con 0x7f6c881591c0 2024-08-17T02:27:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.108+0000 7f6c8dc00640 1 -- 172.21.15.6:0/3244642593 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c881597f0 con 0x7f6c8806e770 2024-08-17T02:27:35.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.109+0000 7f6c8dc00640 1 --2- 172.21.15.6:0/3244642593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c8806e770 0x7f6c880af340 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6c8806c660 tx=0x7f6c80009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c203a06ff04b64d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.110+0000 7f6c87400640 1 -- 172.21.15.6:0/3244642593 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80007550 con 0x7f6c8806e770 2024-08-17T02:27:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.110+0000 7f6c87400640 1 -- 172.21.15.6:0/3244642593 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8002d050 con 0x7f6c8806e770 2024-08-17T02:27:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.110+0000 7f6c87400640 1 -- 172.21.15.6:0/3244642593 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c800078e0 con 0x7f6c8806e770 2024-08-17T02:27:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.110+0000 7f6c8fc00640 1 -- 172.21.15.6:0/3244642593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c8806e770 msgr2=0x7f6c880af340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.110+0000 7f6c8fc00640 1 --2- 172.21.15.6:0/3244642593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c8806e770 0x7f6c880af340 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6c8806c660 tx=0x7f6c80009780 comp rx=0 tx=0).stop 2024-08-17T02:27:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.110+0000 7f6c8fc00640 1 -- 172.21.15.6:0/3244642593 shutdown_connections 2024-08-17T02:27:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.110+0000 7f6c8fc00640 1 --2- 172.21.15.6:0/3244642593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c8806e770 0x7f6c880af340 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.110+0000 7f6c8fc00640 1 --2- 172.21.15.6:0/3244642593 >> v2:172.21.15.136:3300/0 conn(0x7f6c88155040 0x7f6c88158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.110+0000 7f6c8fc00640 1 -- 172.21.15.6:0/3244642593 >> 172.21.15.6:0/3244642593 conn(0x7f6c88066e60 msgr2=0x7f6c88067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.110+0000 7f6c8fc00640 1 -- 172.21.15.6:0/3244642593 shutdown_connections 2024-08-17T02:27:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.110+0000 7f6c8fc00640 1 -- 172.21.15.6:0/3244642593 wait complete. 2024-08-17T02:27:35.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.112+0000 7f6c8fc00640 1 Processor -- start 2024-08-17T02:27:35.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.112+0000 7f6c8fc00640 1 -- start start 2024-08-17T02:27:35.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.112+0000 7f6c8fc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c8806e770 0x7f6c88148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.112+0000 7f6c8fc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c88155040 0x7f6c8814ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.112+0000 7f6c8fc00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c881591c0 0x7f6c880c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.113+0000 7f6c8fc00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880a9aa0 con 0x7f6c8806e770 2024-08-17T02:27:35.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.113+0000 7f6c8fc00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880a9470 con 0x7f6c88155040 2024-08-17T02:27:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.113+0000 7f6c8fc00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c881548c0 con 0x7f6c881591c0 2024-08-17T02:27:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.113+0000 7f6c8d200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c8806e770 0x7f6c88148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.113+0000 7f6c8d200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c8806e770 0x7f6c88148ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56892/0 (socket says 172.21.15.6:56892) 2024-08-17T02:27:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.113+0000 7f6c8d200640 1 -- 172.21.15.6:0/1793558735 learned_addr learned my addr 172.21.15.6:0/1793558735 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.113+0000 7f6c8dc00640 1 --2- 172.21.15.6:0/1793558735 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c881591c0 0x7f6c880c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.113+0000 7f6c87e00640 1 --2- 172.21.15.6:0/1793558735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c88155040 0x7f6c8814ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.113+0000 7f6c8d200640 1 -- 172.21.15.6:0/1793558735 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c881591c0 msgr2=0x7f6c880c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.113+0000 7f6c8d200640 1 --2- 172.21.15.6:0/1793558735 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c881591c0 0x7f6c880c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.113+0000 7f6c8d200640 1 -- 172.21.15.6:0/1793558735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c88155040 msgr2=0x7f6c8814ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.113+0000 7f6c8d200640 1 --2- 172.21.15.6:0/1793558735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c88155040 0x7f6c8814ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.113+0000 7f6c8d200640 1 -- 172.21.15.6:0/1793558735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c80009a20 con 0x7f6c8806e770 2024-08-17T02:27:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.113+0000 7f6c87e00640 1 --2- 172.21.15.6:0/1793558735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c88155040 0x7f6c8814ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.114+0000 7f6c8d200640 1 --2- 172.21.15.6:0/1793558735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c8806e770 0x7f6c88148ef0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00d890 tx=0x7f6c7c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.114+0000 7f6c7be00640 1 -- 172.21.15.6:0/1793558735 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00de20 con 0x7f6c8806e770 2024-08-17T02:27:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.114+0000 7f6c7be00640 1 -- 172.21.15.6:0/1793558735 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c00b8d0 con 0x7f6c8806e770 2024-08-17T02:27:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.114+0000 7f6c7be00640 1 -- 172.21.15.6:0/1793558735 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00bc70 con 0x7f6c8806e770 2024-08-17T02:27:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.114+0000 7f6c8fc00640 1 -- 172.21.15.6:0/1793558735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c880a8e70 con 0x7f6c8806e770 2024-08-17T02:27:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.114+0000 7f6c8fc00640 1 -- 172.21.15.6:0/1793558735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c880a9730 con 0x7f6c8806e770 2024-08-17T02:27:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.115+0000 7f6c8fc00640 1 -- 172.21.15.6:0/1793558735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c88063fb0 con 0x7f6c8806e770 2024-08-17T02:27:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.116+0000 7f6c7be00640 1 -- 172.21.15.6:0/1793558735 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6c7c014640 con 0x7f6c8806e770 2024-08-17T02:27:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.117+0000 7f6c7be00640 1 --2- 172.21.15.6:0/1793558735 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6c68065150 0x7f6c68067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.117+0000 7f6c7be00640 1 -- 172.21.15.6:0/1793558735 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6c7c082ec0 con 0x7f6c8806e770 2024-08-17T02:27:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.117+0000 7f6c87e00640 1 --2- 172.21.15.6:0/1793558735 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6c68065150 0x7f6c68067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.118+0000 7f6c87e00640 1 --2- 172.21.15.6:0/1793558735 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6c68065150 0x7f6c68067600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6c74007fd0 tx=0x7f6c74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.122+0000 7f6c7be00640 1 -- 172.21.15.6:0/1793558735 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6c7c050b60 con 0x7f6c8806e770 2024-08-17T02:27:35.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.332+0000 7f6c8fc00640 1 -- 172.21.15.6:0/1793558735 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c880a9be0 con 0x7f6c68065150 2024-08-17T02:27:35.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.334+0000 7f6c7be00640 1 -- 172.21.15.6:0/1793558735 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f6c74001d80 con 0x7f6c68065150 2024-08-17T02:27:35.335 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-08-17T02:27:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephfs" 2024-08-17T02:27:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-08-17T02:27:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-08-17T02:27:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volume_0000000000329200" 2024-08-17T02:27:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-08-17T02:27:35.335 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-08-17T02:27:35.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.336+0000 7f6c8fc00640 1 -- 172.21.15.6:0/1793558735 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6c68065150 msgr2=0x7f6c68067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.336+0000 7f6c8fc00640 1 --2- 172.21.15.6:0/1793558735 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6c68065150 0x7f6c68067600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6c74007fd0 tx=0x7f6c74009040 comp rx=0 tx=0).stop 2024-08-17T02:27:35.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.336+0000 7f6c8fc00640 1 -- 172.21.15.6:0/1793558735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c8806e770 msgr2=0x7f6c88148ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.336+0000 7f6c8fc00640 1 --2- 172.21.15.6:0/1793558735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c8806e770 0x7f6c88148ef0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00d890 tx=0x7f6c7c008040 comp rx=0 tx=0).stop 2024-08-17T02:27:35.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.336+0000 7f6c8fc00640 1 -- 172.21.15.6:0/1793558735 shutdown_connections 2024-08-17T02:27:35.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.336+0000 7f6c8fc00640 1 --2- 172.21.15.6:0/1793558735 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6c68065150 0x7f6c68067600 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.336+0000 7f6c8fc00640 1 --2- 172.21.15.6:0/1793558735 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c881591c0 0x7f6c880c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.336+0000 7f6c8fc00640 1 --2- 172.21.15.6:0/1793558735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c88155040 0x7f6c8814ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.336+0000 7f6c8fc00640 1 --2- 172.21.15.6:0/1793558735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c8806e770 0x7f6c88148ef0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.336+0000 7f6c8fc00640 1 -- 172.21.15.6:0/1793558735 >> 172.21.15.6:0/1793558735 conn(0x7f6c88066e60 msgr2=0x7f6c88158930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.336+0000 7f6c8fc00640 1 -- 172.21.15.6:0/1793558735 shutdown_connections 2024-08-17T02:27:35.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.336+0000 7f6c8fc00640 1 -- 172.21.15.6:0/1793558735 wait complete. 2024-08-17T02:27:35.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:27:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.506+0000 7f16cee00640 1 Processor -- start 2024-08-17T02:27:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.506+0000 7f16cee00640 1 -- start start 2024-08-17T02:27:35.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.507+0000 7f16cee00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16c80afca0 0x7f16c80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.507+0000 7f16cee00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f16c81590b0 0x7f16c8159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.507+0000 7f16cee00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c815a4e0 con 0x7f16c80acf10 2024-08-17T02:27:35.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.507+0000 7f16cee00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c80b0980 con 0x7f16c80afca0 2024-08-17T02:27:35.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.507+0000 7f16cee00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c80c92b0 con 0x7f16c81590b0 2024-08-17T02:27:35.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.507+0000 7f16c7e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16c80afca0 0x7f16c80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.507+0000 7f16c7e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16c80afca0 0x7f16c80b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56906/0 (socket says 172.21.15.6:56906) 2024-08-17T02:27:35.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.507+0000 7f16c7e00640 1 -- 172.21.15.6:0/2088730329 learned_addr learned my addr 172.21.15.6:0/2088730329 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:35.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.507+0000 7f16bfe00640 1 --1- 172.21.15.6:0/2088730329 >> v1:172.21.15.6:6789/0 conn(0x7f16c80acf10 0x7f16c81589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39248/0 (socket says 172.21.15.6:39248) 2024-08-17T02:27:35.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.508+0000 7f16cce00640 1 --2- 172.21.15.6:0/2088730329 >> v2:172.21.15.136:3300/0 conn(0x7f16c81590b0 0x7f16c8159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.508+0000 7f16c7e00640 1 -- 172.21.15.6:0/2088730329 >> v2:172.21.15.136:3300/0 conn(0x7f16c81590b0 msgr2=0x7f16c8159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:35.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.508+0000 7f16c7e00640 1 --2- 172.21.15.6:0/2088730329 >> v2:172.21.15.136:3300/0 conn(0x7f16c81590b0 0x7f16c8159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.508+0000 7f16c7e00640 1 -- 172.21.15.6:0/2088730329 >> v1:172.21.15.6:6789/0 conn(0x7f16c80acf10 legacy=0x7f16c81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.508+0000 7f16c7e00640 1 -- 172.21.15.6:0/2088730329 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c80ad480 con 0x7f16c80afca0 2024-08-17T02:27:35.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.508+0000 7f16cce00640 1 --2- 172.21.15.6:0/2088730329 >> v2:172.21.15.136:3300/0 conn(0x7f16c81590b0 0x7f16c8159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:35.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.509+0000 7f16c7e00640 1 --2- 172.21.15.6:0/2088730329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c80afca0 0x7f16c80b0070 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f16c80cb4a0 tx=0x7f16b800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cdbbc9489054226 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.509+0000 7f16c7400640 1 -- 172.21.15.6:0/2088730329 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8031650 con 0x7f16c80afca0 2024-08-17T02:27:35.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.509+0000 7f16c7400640 1 -- 172.21.15.6:0/2088730329 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b80317b0 con 0x7f16c80afca0 2024-08-17T02:27:35.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.509+0000 7f16c7400640 1 -- 172.21.15.6:0/2088730329 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8031b90 con 0x7f16c80afca0 2024-08-17T02:27:35.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.509+0000 7f16cee00640 1 -- 172.21.15.6:0/2088730329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c80afca0 msgr2=0x7f16c80b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.510+0000 7f16cee00640 1 --2- 172.21.15.6:0/2088730329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c80afca0 0x7f16c80b0070 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f16c80cb4a0 tx=0x7f16b800b460 comp rx=0 tx=0).stop 2024-08-17T02:27:35.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.510+0000 7f16cee00640 1 -- 172.21.15.6:0/2088730329 shutdown_connections 2024-08-17T02:27:35.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.510+0000 7f16cee00640 1 --2- 172.21.15.6:0/2088730329 >> v2:172.21.15.136:3300/0 conn(0x7f16c81590b0 0x7f16c8159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.510+0000 7f16cee00640 1 --2- 172.21.15.6:0/2088730329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c80afca0 0x7f16c80b0070 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.510+0000 7f16cee00640 1 -- 172.21.15.6:0/2088730329 >> 172.21.15.6:0/2088730329 conn(0x7f16c8066e60 msgr2=0x7f16c8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.510+0000 7f16cee00640 1 -- 172.21.15.6:0/2088730329 shutdown_connections 2024-08-17T02:27:35.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.510+0000 7f16cee00640 1 -- 172.21.15.6:0/2088730329 wait complete. 2024-08-17T02:27:35.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.511+0000 7f16cee00640 1 Processor -- start 2024-08-17T02:27:35.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.511+0000 7f16cee00640 1 -- start start 2024-08-17T02:27:35.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.512+0000 7f16cee00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16c80acf10 0x7f16c81544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.512+0000 7f16cee00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f16c80afca0 0x7f16c8153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.512+0000 7f16cee00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c81590b0 0x7f16c80ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.512+0000 7f16cee00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8158070 con 0x7f16c81590b0 2024-08-17T02:27:35.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.512+0000 7f16cee00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8157460 con 0x7f16c80acf10 2024-08-17T02:27:35.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.512+0000 7f16cee00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8157740 con 0x7f16c80afca0 2024-08-17T02:27:35.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.512+0000 7f16cce00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c81590b0 0x7f16c80ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.512+0000 7f16cce00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c81590b0 0x7f16c80ca710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56922/0 (socket says 172.21.15.6:56922) 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.512+0000 7f16cce00640 1 -- 172.21.15.6:0/4103678508 learned_addr learned my addr 172.21.15.6:0/4103678508 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.512+0000 7f16c7e00640 1 --2- 172.21.15.6:0/4103678508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16c80acf10 0x7f16c81544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.513+0000 7f16bfe00640 1 --2- 172.21.15.6:0/4103678508 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f16c80afca0 0x7f16c8153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.513+0000 7f16cce00640 1 -- 172.21.15.6:0/4103678508 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f16c80afca0 msgr2=0x7f16c8153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.513+0000 7f16cce00640 1 --2- 172.21.15.6:0/4103678508 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f16c80afca0 0x7f16c8153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.513+0000 7f16cce00640 1 -- 172.21.15.6:0/4103678508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16c80acf10 msgr2=0x7f16c81544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.513+0000 7f16cce00640 1 --2- 172.21.15.6:0/4103678508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16c80acf10 0x7f16c81544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.513+0000 7f16cce00640 1 -- 172.21.15.6:0/4103678508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b800b700 con 0x7f16c81590b0 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.513+0000 7f16cce00640 1 --2- 172.21.15.6:0/4103678508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c81590b0 0x7f16c80ca710 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f16c000a380 tx=0x7f16c00078f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.513+0000 7f16bf400640 1 -- 172.21.15.6:0/4103678508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c000d650 con 0x7f16c81590b0 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.513+0000 7f16cee00640 1 -- 172.21.15.6:0/4103678508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c8157a20 con 0x7f16c81590b0 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.513+0000 7f16bf400640 1 -- 172.21.15.6:0/4103678508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c000d7d0 con 0x7f16c81590b0 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.513+0000 7f16bf400640 1 -- 172.21.15.6:0/4103678508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c000db90 con 0x7f16c81590b0 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.514+0000 7f16cee00640 1 -- 172.21.15.6:0/4103678508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c81537d0 con 0x7f16c81590b0 2024-08-17T02:27:35.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.515+0000 7f16cee00640 1 -- 172.21.15.6:0/4103678508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c8158220 con 0x7f16c81590b0 2024-08-17T02:27:35.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.515+0000 7f16bf400640 1 -- 172.21.15.6:0/4103678508 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f16c0003020 con 0x7f16c81590b0 2024-08-17T02:27:35.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.517+0000 7f16bf400640 1 --2- 172.21.15.6:0/4103678508 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f16a4065150 0x7f16a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.517+0000 7f16bf400640 1 -- 172.21.15.6:0/4103678508 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f16c0082ff0 con 0x7f16c81590b0 2024-08-17T02:27:35.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.517+0000 7f16c7e00640 1 --2- 172.21.15.6:0/4103678508 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f16a4065150 0x7f16a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.518+0000 7f16c7e00640 1 --2- 172.21.15.6:0/4103678508 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f16a4065150 0x7f16a4067600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f16b8037000 tx=0x7f16b803a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.521+0000 7f16bf400640 1 -- 172.21.15.6:0/4103678508 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f16c004de40 con 0x7f16c81590b0 2024-08-17T02:27:35.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.706+0000 7f16cee00640 1 -- 172.21.15.6:0/4103678508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f16c8063fb0 con 0x7f16c81590b0 2024-08-17T02:27:35.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.707+0000 7f16bf400640 1 -- 172.21.15.6:0/4103678508 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v36) v1 ==== 97+0+8037 (secure 0 0 0) 0x7f16c8158220 con 0x7f16c81590b0 2024-08-17T02:27:35.707 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:35.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.709+0000 7f16cee00640 1 -- 172.21.15.6:0/4103678508 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f16a4065150 msgr2=0x7f16a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.709+0000 7f16cee00640 1 --2- 172.21.15.6:0/4103678508 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f16a4065150 0x7f16a4067600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f16b8037000 tx=0x7f16b803a000 comp rx=0 tx=0).stop 2024-08-17T02:27:35.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.709+0000 7f16cee00640 1 -- 172.21.15.6:0/4103678508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c81590b0 msgr2=0x7f16c80ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.709+0000 7f16cee00640 1 --2- 172.21.15.6:0/4103678508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c81590b0 0x7f16c80ca710 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f16c000a380 tx=0x7f16c00078f0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.709+0000 7f16cee00640 1 -- 172.21.15.6:0/4103678508 shutdown_connections 2024-08-17T02:27:35.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.709+0000 7f16cee00640 1 --2- 172.21.15.6:0/4103678508 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f16a4065150 0x7f16a4067600 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.709+0000 7f16cee00640 1 --2- 172.21.15.6:0/4103678508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c81590b0 0x7f16c80ca710 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.709+0000 7f16cee00640 1 --2- 172.21.15.6:0/4103678508 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f16c80afca0 0x7f16c8153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.709+0000 7f16cee00640 1 --2- 172.21.15.6:0/4103678508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16c80acf10 0x7f16c81544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.709+0000 7f16cee00640 1 -- 172.21.15.6:0/4103678508 >> 172.21.15.6:0/4103678508 conn(0x7f16c8066e60 msgr2=0x7f16c806af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.709+0000 7f16cee00640 1 -- 172.21.15.6:0/4103678508 shutdown_connections 2024-08-17T02:27:35.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.709+0000 7f16cee00640 1 -- 172.21.15.6:0/4103678508 wait complete. 2024-08-17T02:27:35.724 INFO:teuthology.orchestra.run.smithi006.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:19.345254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:20.195251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000329200.meta","create_time":"2024-08-17T02:27:32.084585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000329200"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000329200.data","create_time":"2024-08-17T02:27:32.953304+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000329200"}}}] 2024-08-17T02:27:35.725 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000329200 --format=json 2024-08-17T02:27:35.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.877+0000 7f56f5800640 1 Processor -- start 2024-08-17T02:27:35.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.877+0000 7f56f5800640 1 -- start start 2024-08-17T02:27:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.878+0000 7f56f5800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56f00ccfe0 0x7f56f0163b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.878+0000 7f56f5800640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f00c40a0 con 0x7f56f0158e10 2024-08-17T02:27:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.878+0000 7f56f5800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f0069240 con 0x7f56f01591e0 2024-08-17T02:27:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.878+0000 7f56f5800640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f00694e0 con 0x7f56f00ccfe0 2024-08-17T02:27:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.878+0000 7f56ef400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56f00ccfe0 0x7f56f0163b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.879+0000 7f56ef400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56f00ccfe0 0x7f56f0163b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56934/0 (socket says 172.21.15.6:56934) 2024-08-17T02:27:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.879+0000 7f56ef400640 1 -- 172.21.15.6:0/1963752220 learned_addr learned my addr 172.21.15.6:0/1963752220 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.879+0000 7f56eea00640 1 --1- 172.21.15.6:0/1963752220 >> v1:172.21.15.6:6789/0 conn(0x7f56f0158e10 0x7f56f0068180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39254/0 (socket says 172.21.15.6:39254) 2024-08-17T02:27:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.879+0000 7f56ef400640 1 -- 172.21.15.6:0/1963752220 >> v1:172.21.15.136:6789/0 conn(0x7f56f01591e0 legacy=0x7f56f0068890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.879+0000 7f56ef400640 1 -- 172.21.15.6:0/1963752220 >> v1:172.21.15.6:6789/0 conn(0x7f56f0158e10 legacy=0x7f56f0068180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.879+0000 7f56ef400640 1 -- 172.21.15.6:0/1963752220 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f0068fa0 con 0x7f56f00ccfe0 2024-08-17T02:27:35.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.880+0000 7f56ef400640 1 --2- 172.21.15.6:0/1963752220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f00ccfe0 0x7f56f0163b00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009f20 tx=0x7f56e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64920986cd1843c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.880+0000 7f56ed600640 1 -- 172.21.15.6:0/1963752220 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e8032460 con 0x7f56f00ccfe0 2024-08-17T02:27:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.880+0000 7f56ed600640 1 -- 172.21.15.6:0/1963752220 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e80325c0 con 0x7f56f00ccfe0 2024-08-17T02:27:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.880+0000 7f56ed600640 1 -- 172.21.15.6:0/1963752220 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e80329a0 con 0x7f56f00ccfe0 2024-08-17T02:27:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.881+0000 7f56f5800640 1 -- 172.21.15.6:0/1963752220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f00ccfe0 msgr2=0x7f56f0163b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.881+0000 7f56f5800640 1 --2- 172.21.15.6:0/1963752220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f00ccfe0 0x7f56f0163b00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009f20 tx=0x7f56e8009840 comp rx=0 tx=0).stop 2024-08-17T02:27:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.881+0000 7f56f5800640 1 -- 172.21.15.6:0/1963752220 shutdown_connections 2024-08-17T02:27:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.881+0000 7f56f5800640 1 --2- 172.21.15.6:0/1963752220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f00ccfe0 0x7f56f0163b00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.881+0000 7f56f5800640 1 -- 172.21.15.6:0/1963752220 >> 172.21.15.6:0/1963752220 conn(0x7f56f00ce590 msgr2=0x7f56f00ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.881+0000 7f56f5800640 1 -- 172.21.15.6:0/1963752220 shutdown_connections 2024-08-17T02:27:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.881+0000 7f56f5800640 1 -- 172.21.15.6:0/1963752220 wait complete. 2024-08-17T02:27:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.882+0000 7f56f5800640 1 Processor -- start 2024-08-17T02:27:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.882+0000 7f56f5800640 1 -- start start 2024-08-17T02:27:35.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.883+0000 7f56f5800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f56f00ccfe0 0x7f56f015e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.883+0000 7f56f5800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f56f0158e10 0x7f56f00c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.883+0000 7f56f5800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f01591e0 0x7f56f0155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.883+0000 7f56f5800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f00c7a70 con 0x7f56f01591e0 2024-08-17T02:27:35.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.883+0000 7f56f5800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f015d1d0 con 0x7f56f0158e10 2024-08-17T02:27:35.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.883+0000 7f56f5800640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f015d4b0 con 0x7f56f00ccfe0 2024-08-17T02:27:35.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.884+0000 7f56ef400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f01591e0 0x7f56f0155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.884+0000 7f56ef400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f01591e0 0x7f56f0155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56950/0 (socket says 172.21.15.6:56950) 2024-08-17T02:27:35.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.884+0000 7f56ef400640 1 -- 172.21.15.6:0/3372047421 learned_addr learned my addr 172.21.15.6:0/3372047421 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:35.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.884+0000 7f56ee000640 1 --2- 172.21.15.6:0/3372047421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f56f0158e10 0x7f56f00c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.884+0000 7f56eea00640 1 --2- 172.21.15.6:0/3372047421 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f56f00ccfe0 0x7f56f015e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.884+0000 7f56ef400640 1 -- 172.21.15.6:0/3372047421 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f56f00ccfe0 msgr2=0x7f56f015e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.884+0000 7f56ef400640 1 --2- 172.21.15.6:0/3372047421 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f56f00ccfe0 0x7f56f015e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.884+0000 7f56ef400640 1 -- 172.21.15.6:0/3372047421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f56f0158e10 msgr2=0x7f56f00c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.884+0000 7f56ef400640 1 --2- 172.21.15.6:0/3372047421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f56f0158e10 0x7f56f00c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.884+0000 7f56ef400640 1 -- 172.21.15.6:0/3372047421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e8009ae0 con 0x7f56f01591e0 2024-08-17T02:27:35.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.884+0000 7f56ef400640 1 --2- 172.21.15.6:0/3372047421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f01591e0 0x7f56f0155910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009f20 tx=0x7f56e8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.885+0000 7f56e6000640 1 -- 172.21.15.6:0/3372047421 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e8032460 con 0x7f56f01591e0 2024-08-17T02:27:35.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.885+0000 7f56e6000640 1 -- 172.21.15.6:0/3372047421 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e8008e30 con 0x7f56f01591e0 2024-08-17T02:27:35.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.885+0000 7f56e6000640 1 -- 172.21.15.6:0/3372047421 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e803c680 con 0x7f56f01591e0 2024-08-17T02:27:35.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.885+0000 7f56f5800640 1 -- 172.21.15.6:0/3372047421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f015d790 con 0x7f56f01591e0 2024-08-17T02:27:35.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.885+0000 7f56f5800640 1 -- 172.21.15.6:0/3372047421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f015dd50 con 0x7f56f01591e0 2024-08-17T02:27:35.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.886+0000 7f56f5800640 1 -- 172.21.15.6:0/3372047421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f015df40 con 0x7f56f01591e0 2024-08-17T02:27:35.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.887+0000 7f56e6000640 1 -- 172.21.15.6:0/3372047421 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f56e8039050 con 0x7f56f01591e0 2024-08-17T02:27:35.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.887+0000 7f56e6000640 1 --2- 172.21.15.6:0/3372047421 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f56d0065150 0x7f56d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.888+0000 7f56e6000640 1 -- 172.21.15.6:0/3372047421 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f56e80a39b0 con 0x7f56f01591e0 2024-08-17T02:27:35.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.888+0000 7f56eea00640 1 --2- 172.21.15.6:0/3372047421 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f56d0065150 0x7f56d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.889+0000 7f56eea00640 1 --2- 172.21.15.6:0/3372047421 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f56d0065150 0x7f56d0067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f56e0007800 tx=0x7f56e0007e20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:35.892+0000 7f56e6000640 1 -- 172.21.15.6:0/3372047421 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f56e8071700 con 0x7f56f01591e0 2024-08-17T02:27:36.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.120+0000 7f56f5800640 1 -- 172.21.15.6:0/3372047421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000329200", "format": "json"} v 0) v1 -- 0x7f56f0063fb0 con 0x7f56f01591e0 2024-08-17T02:27:36.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.121+0000 7f56e6000640 1 -- 172.21.15.6:0/3372047421 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000329200", "format": "json"}]=0 v19) v1 ==== 110+0+1841 (secure 0 0 0) 0x7f56e8040750 con 0x7f56f01591e0 2024-08-17T02:27:36.122 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:27:36.122 INFO:teuthology.orchestra.run.smithi006.stdout:{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:33.919463+0000","modified":"2024-08-17T02:27:35.926590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4935":{"gid":4935,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.6:6834/2620799775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2620799775},{"type":"v1","addr":"172.21.15.6:6834","nonce":2620799775}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000329200","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:27:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.123+0000 7f56f5800640 1 -- 172.21.15.6:0/3372047421 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f56d0065150 msgr2=0x7f56d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.123+0000 7f56f5800640 1 --2- 172.21.15.6:0/3372047421 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f56d0065150 0x7f56d0067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f56e0007800 tx=0x7f56e0007e20 comp rx=0 tx=0).stop 2024-08-17T02:27:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.123+0000 7f56f5800640 1 -- 172.21.15.6:0/3372047421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f01591e0 msgr2=0x7f56f0155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.123+0000 7f56f5800640 1 --2- 172.21.15.6:0/3372047421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f01591e0 0x7f56f0155910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009f20 tx=0x7f56e8037000 comp rx=0 tx=0).stop 2024-08-17T02:27:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.123+0000 7f56f5800640 1 -- 172.21.15.6:0/3372047421 shutdown_connections 2024-08-17T02:27:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.123+0000 7f56f5800640 1 --2- 172.21.15.6:0/3372047421 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f56d0065150 0x7f56d0067600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.123+0000 7f56f5800640 1 --2- 172.21.15.6:0/3372047421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f01591e0 0x7f56f0155910 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.123+0000 7f56f5800640 1 --2- 172.21.15.6:0/3372047421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f56f0158e10 0x7f56f00c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.123+0000 7f56f5800640 1 --2- 172.21.15.6:0/3372047421 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f56f00ccfe0 0x7f56f015e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.123+0000 7f56f5800640 1 -- 172.21.15.6:0/3372047421 >> 172.21.15.6:0/3372047421 conn(0x7f56f00ce590 msgr2=0x7f56f006b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.123+0000 7f56f5800640 1 -- 172.21.15.6:0/3372047421 shutdown_connections 2024-08-17T02:27:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.123+0000 7f56f5800640 1 -- 172.21.15.6:0/3372047421 wait complete. 2024-08-17T02:27:36.140 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000329200 --yes-i-really-mean-it 2024-08-17T02:27:36.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.294+0000 7f724f800640 1 Processor -- start 2024-08-17T02:27:36.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.294+0000 7f724f800640 1 -- start start 2024-08-17T02:27:36.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.295+0000 7f724f800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f724806e4b0 0x7f72480afa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.295+0000 7f724f800640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72480aeeb0 con 0x7f7248155040 2024-08-17T02:27:36.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.296+0000 7f724f800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72480aadd0 con 0x7f724806e060 2024-08-17T02:27:36.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.296+0000 7f724f800640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72481597f0 con 0x7f724806e4b0 2024-08-17T02:27:36.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.296+0000 7f724d800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f724806e4b0 0x7f72480afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.296+0000 7f724ce00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7248155040 0x7f7248158c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39266/0 (socket says 172.21.15.6:39266) 2024-08-17T02:27:36.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.296+0000 7f724ce00640 1 -- 172.21.15.6:0/728462117 learned_addr learned my addr 172.21.15.6:0/728462117 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:27:36.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.296+0000 7f724d800640 1 -- 172.21.15.6:0/728462117 >> v1:172.21.15.136:6789/0 conn(0x7f724806e060 legacy=0x7f72480af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.296+0000 7f724d800640 1 -- 172.21.15.6:0/728462117 >> v1:172.21.15.6:6789/0 conn(0x7f7248155040 legacy=0x7f7248158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.296+0000 7f7247400640 1 -- 172.21.15.6:0/728462117 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584875594 0 0) 0x7f72480aeeb0 con 0x7f7248155040 2024-08-17T02:27:36.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.296+0000 7f724d800640 1 -- 172.21.15.6:0/728462117 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7248159ad0 con 0x7f724806e4b0 2024-08-17T02:27:36.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.297+0000 7f724d800640 1 --2- 172.21.15.6:0/728462117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724806e4b0 0x7f72480afa50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7240009e60 tx=0x7f7240009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799fffa608139cfc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.298+0000 7f7247400640 1 -- 172.21.15.6:0/728462117 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7240007550 con 0x7f724806e4b0 2024-08-17T02:27:36.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.298+0000 7f7247400640 1 -- 172.21.15.6:0/728462117 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724002d050 con 0x7f724806e4b0 2024-08-17T02:27:36.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.298+0000 7f7247400640 1 -- 172.21.15.6:0/728462117 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72400078e0 con 0x7f724806e4b0 2024-08-17T02:27:36.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.298+0000 7f724f800640 1 -- 172.21.15.6:0/728462117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724806e4b0 msgr2=0x7f72480afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.298+0000 7f724f800640 1 --2- 172.21.15.6:0/728462117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724806e4b0 0x7f72480afa50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7240009e60 tx=0x7f7240009780 comp rx=0 tx=0).stop 2024-08-17T02:27:36.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.298+0000 7f724f800640 1 -- 172.21.15.6:0/728462117 shutdown_connections 2024-08-17T02:27:36.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.298+0000 7f724f800640 1 --2- 172.21.15.6:0/728462117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724806e4b0 0x7f72480afa50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.298+0000 7f724f800640 1 -- 172.21.15.6:0/728462117 >> 172.21.15.6:0/728462117 conn(0x7f7248066e60 msgr2=0x7f7248067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.298+0000 7f724f800640 1 -- 172.21.15.6:0/728462117 shutdown_connections 2024-08-17T02:27:36.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.298+0000 7f724f800640 1 -- 172.21.15.6:0/728462117 wait complete. 2024-08-17T02:27:36.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.300+0000 7f724f800640 1 Processor -- start 2024-08-17T02:27:36.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.300+0000 7f724f800640 1 -- start start 2024-08-17T02:27:36.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.300+0000 7f724f800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f724806e060 0x7f7248141460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.301+0000 7f724f800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724806e4b0 0x7f7248150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.301+0000 7f724f800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7248155040 0x7f72481509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.301+0000 7f724f800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72480aa420 con 0x7f724806e4b0 2024-08-17T02:27:36.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.301+0000 7f724f800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72481692e0 con 0x7f7248155040 2024-08-17T02:27:36.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.301+0000 7f724f800640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72481495b0 con 0x7f724806e060 2024-08-17T02:27:36.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.301+0000 7f7247e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724806e4b0 0x7f7248150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.301+0000 7f7247e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724806e4b0 0x7f7248150490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56970/0 (socket says 172.21.15.6:56970) 2024-08-17T02:27:36.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.301+0000 7f7247e00640 1 -- 172.21.15.6:0/3961322174 learned_addr learned my addr 172.21.15.6:0/3961322174 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:27:36.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.301+0000 7f724ce00640 1 --2- 172.21.15.6:0/3961322174 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f724806e060 0x7f7248141460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.301+0000 7f724d800640 1 --2- 172.21.15.6:0/3961322174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7248155040 0x7f72481509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.301+0000 7f7247e00640 1 -- 172.21.15.6:0/3961322174 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f724806e060 msgr2=0x7f7248141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.301+0000 7f7247e00640 1 --2- 172.21.15.6:0/3961322174 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f724806e060 0x7f7248141460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.301+0000 7f7247e00640 1 -- 172.21.15.6:0/3961322174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7248155040 msgr2=0x7f72481509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.301+0000 7f7247e00640 1 --2- 172.21.15.6:0/3961322174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7248155040 0x7f72481509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.301+0000 7f7247e00640 1 -- 172.21.15.6:0/3961322174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7240009a20 con 0x7f724806e4b0 2024-08-17T02:27:36.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.302+0000 7f7247e00640 1 --2- 172.21.15.6:0/3961322174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724806e4b0 0x7f7248150490 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f723400c590 tx=0x7f7234007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.302+0000 7f723be00640 1 -- 172.21.15.6:0/3961322174 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7234012630 con 0x7f724806e4b0 2024-08-17T02:27:36.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.302+0000 7f723be00640 1 -- 172.21.15.6:0/3961322174 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72340127b0 con 0x7f724806e4b0 2024-08-17T02:27:36.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.302+0000 7f723be00640 1 -- 172.21.15.6:0/3961322174 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7234012b70 con 0x7f724806e4b0 2024-08-17T02:27:36.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.302+0000 7f724f800640 1 -- 172.21.15.6:0/3961322174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72480aa140 con 0x7f724806e4b0 2024-08-17T02:27:36.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.302+0000 7f724f800640 1 -- 172.21.15.6:0/3961322174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7248149240 con 0x7f724806e4b0 2024-08-17T02:27:36.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.303+0000 7f724f800640 1 -- 172.21.15.6:0/3961322174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7248148dc0 con 0x7f724806e4b0 2024-08-17T02:27:36.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.304+0000 7f723be00640 1 -- 172.21.15.6:0/3961322174 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f723401b400 con 0x7f724806e4b0 2024-08-17T02:27:36.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.305+0000 7f723be00640 1 --2- 172.21.15.6:0/3961322174 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7228065150 0x7f7228067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.305+0000 7f723be00640 1 -- 172.21.15.6:0/3961322174 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f7234082360 con 0x7f724806e4b0 2024-08-17T02:27:36.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.305+0000 7f724ce00640 1 --2- 172.21.15.6:0/3961322174 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7228065150 0x7f7228067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.306+0000 7f724ce00640 1 --2- 172.21.15.6:0/3961322174 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7228065150 0x7f7228067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f723c000c00 tx=0x7f723c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.309+0000 7f723be00640 1 -- 172.21.15.6:0/3961322174 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7248148dc0 con 0x7f724806e4b0 2024-08-17T02:27:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:27:36.514+0000 7f724f800640 1 -- 172.21.15.6:0/3961322174 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000329200", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f7248148dc0 con 0x7f7228065150 2024-08-17T02:27:40.769 INFO:tasks.ceph.mds.c.smithi006.stderr:2024-08-17T02:27:40.768+0000 7fd95aa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:28:04.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:04.287 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:34.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:34.383 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:04.475 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:04.480 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:34.570 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:34.576 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:36.209 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:29:36.210 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:29:36.210 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:29:36.314 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:29:36.410 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:29:36.410 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:29:36.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:29:36.411 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-17T02:29:36.478 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-08-17T02:29:36.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:36.478 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:29:36.515 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:29:36.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:29:36.516 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-08-17T02:29:36.580 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2024-08-17T02:29:36.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:36.580 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:29:36.616 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.768+0000 7fbb1f200640 1 Processor -- start 2024-08-17T02:29:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.768+0000 7fbb1f200640 1 -- start start 2024-08-17T02:29:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.769+0000 7fbb1f200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb181589e0 0x7fbb18158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.769+0000 7fbb1f200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbb180ce140 0x7fbb180cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.769+0000 7fbb1f200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb180af9a0 con 0x7fbb180ca9c0 2024-08-17T02:29:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.769+0000 7fbb1f200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb180af810 con 0x7fbb181589e0 2024-08-17T02:29:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.769+0000 7fbb1f200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb180cb340 con 0x7fbb180ce140 2024-08-17T02:29:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.770+0000 7fbb17e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb181589e0 0x7fbb18158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.770+0000 7fbb17400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbb180ca9c0 0x7fbb180cda30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37164/0 (socket says 172.21.15.6:37164) 2024-08-17T02:29:36.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.770+0000 7fbb17400640 1 -- 172.21.15.6:0/1167355523 learned_addr learned my addr 172.21.15.6:0/1167355523 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:36.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.770+0000 7fbb1d200640 1 --2- 172.21.15.6:0/1167355523 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbb180ce140 0x7fbb180cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.770+0000 7fbb17e00640 1 -- 172.21.15.6:0/1167355523 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbb180ce140 msgr2=0x7fbb180cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.770+0000 7fbb17e00640 1 --2- 172.21.15.6:0/1167355523 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbb180ce140 0x7fbb180cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.770+0000 7fbb17e00640 1 -- 172.21.15.6:0/1167355523 >> v1:172.21.15.6:6789/0 conn(0x7fbb180ca9c0 legacy=0x7fbb180cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.770+0000 7fbb17e00640 1 -- 172.21.15.6:0/1167355523 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb180ce740 con 0x7fbb181589e0 2024-08-17T02:29:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.770+0000 7fbb16a00640 1 -- 172.21.15.6:0/1167355523 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411944624 0 0) 0x7fbb180af9a0 con 0x7fbb180ca9c0 2024-08-17T02:29:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.770+0000 7fbb1d200640 1 --2- 172.21.15.6:0/1167355523 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbb180ce140 0x7fbb180cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.771+0000 7fbb17e00640 1 --2- 172.21.15.6:0/1167355523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb181589e0 0x7fbb18158db0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009850 tx=0x7fbb080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a585fe5d6cc2af server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.771+0000 7fbb16a00640 1 -- 172.21.15.6:0/1167355523 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0802ad90 con 0x7fbb181589e0 2024-08-17T02:29:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.771+0000 7fbb16a00640 1 -- 172.21.15.6:0/1167355523 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb08032440 con 0x7fbb181589e0 2024-08-17T02:29:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.771+0000 7fbb16a00640 1 -- 172.21.15.6:0/1167355523 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb080327e0 con 0x7fbb181589e0 2024-08-17T02:29:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.772+0000 7fbb1f200640 1 -- 172.21.15.6:0/1167355523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb181589e0 msgr2=0x7fbb18158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.772+0000 7fbb1f200640 1 --2- 172.21.15.6:0/1167355523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb181589e0 0x7fbb18158db0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009850 tx=0x7fbb080090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.772+0000 7fbb1f200640 1 -- 172.21.15.6:0/1167355523 shutdown_connections 2024-08-17T02:29:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.772+0000 7fbb1f200640 1 --2- 172.21.15.6:0/1167355523 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbb180ce140 0x7fbb180cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.772+0000 7fbb1f200640 1 --2- 172.21.15.6:0/1167355523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb181589e0 0x7fbb18158db0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.772+0000 7fbb1f200640 1 -- 172.21.15.6:0/1167355523 >> 172.21.15.6:0/1167355523 conn(0x7fbb1806e590 msgr2=0x7fbb1806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.772+0000 7fbb1f200640 1 -- 172.21.15.6:0/1167355523 shutdown_connections 2024-08-17T02:29:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.772+0000 7fbb1f200640 1 -- 172.21.15.6:0/1167355523 wait complete. 2024-08-17T02:29:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.773+0000 7fbb1f200640 1 Processor -- start 2024-08-17T02:29:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.773+0000 7fbb1f200640 1 -- start start 2024-08-17T02:29:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.774+0000 7fbb1f200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbb180ca9c0 0x7fbb18169850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.774+0000 7fbb1f200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbb180ce140 0x7fbb18159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.774+0000 7fbb1f200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb181589e0 0x7fbb18144660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.774+0000 7fbb1f200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb18159860 con 0x7fbb181589e0 2024-08-17T02:29:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.774+0000 7fbb1f200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb18159a90 con 0x7fbb180ce140 2024-08-17T02:29:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.774+0000 7fbb1f200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb18159d70 con 0x7fbb180ca9c0 2024-08-17T02:29:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.774+0000 7fbb1d200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb181589e0 0x7fbb18144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.775+0000 7fbb1d200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb181589e0 0x7fbb18144660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44392/0 (socket says 172.21.15.6:44392) 2024-08-17T02:29:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.775+0000 7fbb1d200640 1 -- 172.21.15.6:0/1585888096 learned_addr learned my addr 172.21.15.6:0/1585888096 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.775+0000 7fbb17400640 1 --2- 172.21.15.6:0/1585888096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbb180ce140 0x7fbb18159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.775+0000 7fbb17e00640 1 --2- 172.21.15.6:0/1585888096 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbb180ca9c0 0x7fbb18169850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.775+0000 7fbb1d200640 1 -- 172.21.15.6:0/1585888096 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbb180ca9c0 msgr2=0x7fbb18169850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.775+0000 7fbb1d200640 1 --2- 172.21.15.6:0/1585888096 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbb180ca9c0 0x7fbb18169850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.775+0000 7fbb1d200640 1 -- 172.21.15.6:0/1585888096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbb180ce140 msgr2=0x7fbb18159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.775+0000 7fbb1d200640 1 --2- 172.21.15.6:0/1585888096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbb180ce140 0x7fbb18159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.775+0000 7fbb1d200640 1 -- 172.21.15.6:0/1585888096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb08009390 con 0x7fbb181589e0 2024-08-17T02:29:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.775+0000 7fbb17400640 1 --2- 172.21.15.6:0/1585888096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbb180ce140 0x7fbb18159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.775+0000 7fbb1d200640 1 --2- 172.21.15.6:0/1585888096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb181589e0 0x7fbb18144660 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000a380 tx=0x7fbb10007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.775+0000 7fbb0f400640 1 -- 172.21.15.6:0/1585888096 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1000d650 con 0x7fbb181589e0 2024-08-17T02:29:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.776+0000 7fbb0f400640 1 -- 172.21.15.6:0/1585888096 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1000d7b0 con 0x7fbb181589e0 2024-08-17T02:29:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.776+0000 7fbb0f400640 1 -- 172.21.15.6:0/1585888096 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1000db70 con 0x7fbb181589e0 2024-08-17T02:29:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.776+0000 7fbb1f200640 1 -- 172.21.15.6:0/1585888096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1815a050 con 0x7fbb181589e0 2024-08-17T02:29:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.776+0000 7fbb1f200640 1 -- 172.21.15.6:0/1585888096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1815a610 con 0x7fbb181589e0 2024-08-17T02:29:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.777+0000 7fbb1f200640 1 -- 172.21.15.6:0/1585888096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1815a860 con 0x7fbb181589e0 2024-08-17T02:29:36.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.778+0000 7fbb0f400640 1 -- 172.21.15.6:0/1585888096 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbb1001e3b0 con 0x7fbb181589e0 2024-08-17T02:29:36.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.778+0000 7fbb0f400640 1 --2- 172.21.15.6:0/1585888096 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbaf8065150 0x7fbaf8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.779+0000 7fbb0f400640 1 -- 172.21.15.6:0/1585888096 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fbb10083280 con 0x7fbb181589e0 2024-08-17T02:29:36.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.779+0000 7fbb17e00640 1 --2- 172.21.15.6:0/1585888096 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbaf8065150 0x7fbaf8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.780+0000 7fbb17e00640 1 --2- 172.21.15.6:0/1585888096 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbaf8065150 0x7fbaf8067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbb08034000 tx=0x7fbb08032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:36.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:36.783+0000 7fbb0f400640 1 -- 172.21.15.6:0/1585888096 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbb10050fc0 con 0x7fbb181589e0 2024-08-17T02:29:37.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.006+0000 7fbb1f200640 1 -- 172.21.15.6:0/1585888096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb18063fb0 con 0x7fbb181589e0 2024-08-17T02:29:37.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.007+0000 7fbb0f400640 1 -- 172.21.15.6:0/1585888096 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5681 (secure 0 0 0) 0x7fbb100545e0 con 0x7fbb181589e0 2024-08-17T02:29:37.007 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:37.008 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/4280185456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":4280185456},{"type":"v1","addr":"172.21.15.136:6836","nonce":4280185456}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2517061869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":2517061869},{"type":"v1","addr":"172.21.15.136:6837","nonce":2517061869}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:21.208240+0000","modified":"2024-08-17T02:27:24.818513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/285178879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":285178879},{"type":"v1","addr":"172.21.15.6:6835","nonce":285178879}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:33.919463+0000","modified":"2024-08-17T02:27:35.926590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4935":{"gid":4935,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.6:6834/2620799775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2620799775},{"type":"v1","addr":"172.21.15.6:6834","nonce":2620799775}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000329200","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:37.008 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 19 2024-08-17T02:29:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.009+0000 7fbb1f200640 1 -- 172.21.15.6:0/1585888096 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbaf8065150 msgr2=0x7fbaf8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.009+0000 7fbb1f200640 1 --2- 172.21.15.6:0/1585888096 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbaf8065150 0x7fbaf8067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbb08034000 tx=0x7fbb08032000 comp rx=0 tx=0).stop 2024-08-17T02:29:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.009+0000 7fbb1f200640 1 -- 172.21.15.6:0/1585888096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb181589e0 msgr2=0x7fbb18144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.009+0000 7fbb1f200640 1 --2- 172.21.15.6:0/1585888096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb181589e0 0x7fbb18144660 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000a380 tx=0x7fbb10007900 comp rx=0 tx=0).stop 2024-08-17T02:29:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.009+0000 7fbb1f200640 1 -- 172.21.15.6:0/1585888096 shutdown_connections 2024-08-17T02:29:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.009+0000 7fbb1f200640 1 --2- 172.21.15.6:0/1585888096 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbaf8065150 0x7fbaf8067600 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.009+0000 7fbb1f200640 1 --2- 172.21.15.6:0/1585888096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb181589e0 0x7fbb18144660 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.009+0000 7fbb1f200640 1 --2- 172.21.15.6:0/1585888096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbb180ce140 0x7fbb18159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.009+0000 7fbb1f200640 1 --2- 172.21.15.6:0/1585888096 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbb180ca9c0 0x7fbb18169850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.009+0000 7fbb1f200640 1 -- 172.21.15.6:0/1585888096 >> 172.21.15.6:0/1585888096 conn(0x7fbb1806e590 msgr2=0x7fbb180cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.009+0000 7fbb1f200640 1 -- 172.21.15.6:0/1585888096 shutdown_connections 2024-08-17T02:29:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.009+0000 7fbb1f200640 1 -- 172.21.15.6:0/1585888096 wait complete. 2024-08-17T02:29:37.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:37.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.176+0000 7f676ae00640 1 Processor -- start 2024-08-17T02:29:37.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.176+0000 7f676ae00640 1 -- start start 2024-08-17T02:29:37.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.177+0000 7f676ae00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67640add30 0x7f6764156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.177+0000 7f676ae00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67640cb160 con 0x7f67640ad960 2024-08-17T02:29:37.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.177+0000 7f676ae00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67640b0d10 con 0x7f67640ca050 2024-08-17T02:29:37.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.177+0000 7f676ae00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67640ca550 con 0x7f67640add30 2024-08-17T02:29:37.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.178+0000 7f6763e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f67640ad960 0x7f6764156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37180/0 (socket says 172.21.15.6:37180) 2024-08-17T02:29:37.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.178+0000 7f6763e00640 1 -- 172.21.15.6:0/1028613446 learned_addr learned my addr 172.21.15.6:0/1028613446 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:37.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.178+0000 7f6768e00640 1 --2- 172.21.15.6:0/1028613446 >> v2:172.21.15.6:3300/0 conn(0x7f67640add30 0x7f6764156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.178+0000 7f6763400640 1 -- 172.21.15.6:0/1028613446 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920421158 0 0) 0x7f67640cb160 con 0x7f67640ad960 2024-08-17T02:29:37.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.178+0000 7f6763400640 1 -- 172.21.15.6:0/1028613446 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67480034e0 con 0x7f67640ad960 2024-08-17T02:29:37.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.178+0000 7f6763400640 1 -- 172.21.15.6:0/1028613446 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300556344 0 0) 0x7f67640b0d10 con 0x7f67640ca050 2024-08-17T02:29:37.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.178+0000 7f6768e00640 1 -- 172.21.15.6:0/1028613446 >> v1:172.21.15.136:6789/0 conn(0x7f67640ca050 legacy=0x7f67640aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.178+0000 7f6768e00640 1 -- 172.21.15.6:0/1028613446 >> v1:172.21.15.6:6789/0 conn(0x7f67640ad960 legacy=0x7f6764156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.178+0000 7f6768e00640 1 -- 172.21.15.6:0/1028613446 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67640ca830 con 0x7f67640add30 2024-08-17T02:29:37.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.179+0000 7f6768e00640 1 --2- 172.21.15.6:0/1028613446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640add30 0x7f6764156b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f675c009e60 tx=0x7f675c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4235dc9ab3761eac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.179+0000 7f6763400640 1 -- 172.21.15.6:0/1028613446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c030560 con 0x7f67640add30 2024-08-17T02:29:37.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.179+0000 7f6763400640 1 -- 172.21.15.6:0/1028613446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c0306c0 con 0x7f67640add30 2024-08-17T02:29:37.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.179+0000 7f6763400640 1 -- 172.21.15.6:0/1028613446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c030a40 con 0x7f67640add30 2024-08-17T02:29:37.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.180+0000 7f676ae00640 1 -- 172.21.15.6:0/1028613446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640add30 msgr2=0x7f6764156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.180+0000 7f676ae00640 1 --2- 172.21.15.6:0/1028613446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640add30 0x7f6764156b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f675c009e60 tx=0x7f675c009780 comp rx=0 tx=0).stop 2024-08-17T02:29:37.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.180+0000 7f676ae00640 1 -- 172.21.15.6:0/1028613446 shutdown_connections 2024-08-17T02:29:37.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.180+0000 7f676ae00640 1 --2- 172.21.15.6:0/1028613446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640add30 0x7f6764156b30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.180+0000 7f676ae00640 1 -- 172.21.15.6:0/1028613446 >> 172.21.15.6:0/1028613446 conn(0x7f6764066e60 msgr2=0x7f6764067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:37.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.180+0000 7f676ae00640 1 -- 172.21.15.6:0/1028613446 shutdown_connections 2024-08-17T02:29:37.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.180+0000 7f676ae00640 1 -- 172.21.15.6:0/1028613446 wait complete. 2024-08-17T02:29:37.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.182+0000 7f676ae00640 1 Processor -- start 2024-08-17T02:29:37.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.182+0000 7f676ae00640 1 -- start start 2024-08-17T02:29:37.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.183+0000 7f676ae00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f67640ad960 0x7f67641444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.183+0000 7f676ae00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67640add30 0x7f676406a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.183+0000 7f676ae00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640ca050 0x7f676406ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.183+0000 7f676ae00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67640a44d0 con 0x7f67640ca050 2024-08-17T02:29:37.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.183+0000 7f676ae00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67640a5010 con 0x7f67640add30 2024-08-17T02:29:37.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.183+0000 7f676ae00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67640a46e0 con 0x7f67640ad960 2024-08-17T02:29:37.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.183+0000 7f6768e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640ca050 0x7f676406ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.183+0000 7f6768e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640ca050 0x7f676406ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44404/0 (socket says 172.21.15.6:44404) 2024-08-17T02:29:37.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.183+0000 7f6768e00640 1 -- 172.21.15.6:0/1075775076 learned_addr learned my addr 172.21.15.6:0/1075775076 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:37.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.183+0000 7f6763e00640 1 --2- 172.21.15.6:0/1075775076 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f67640ad960 0x7f67641444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.183+0000 7f675be00640 1 --2- 172.21.15.6:0/1075775076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67640add30 0x7f676406a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.183+0000 7f6768e00640 1 -- 172.21.15.6:0/1075775076 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f67640ad960 msgr2=0x7f67641444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.183+0000 7f6768e00640 1 --2- 172.21.15.6:0/1075775076 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f67640ad960 0x7f67641444a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.183+0000 7f6768e00640 1 -- 172.21.15.6:0/1075775076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67640add30 msgr2=0x7f676406a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.183+0000 7f6768e00640 1 --2- 172.21.15.6:0/1075775076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67640add30 0x7f676406a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.184+0000 7f6768e00640 1 -- 172.21.15.6:0/1075775076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c009a20 con 0x7f67640ca050 2024-08-17T02:29:37.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.184+0000 7f6768e00640 1 --2- 172.21.15.6:0/1075775076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640ca050 0x7f676406ae90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f675c009e60 tx=0x7f675c038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.184+0000 7f675b400640 1 -- 172.21.15.6:0/1075775076 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c03c8f0 con 0x7f67640ca050 2024-08-17T02:29:37.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.184+0000 7f675b400640 1 -- 172.21.15.6:0/1075775076 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c03ca50 con 0x7f67640ca050 2024-08-17T02:29:37.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.184+0000 7f676ae00640 1 -- 172.21.15.6:0/1075775076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67640a49c0 con 0x7f67640ca050 2024-08-17T02:29:37.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.184+0000 7f675b400640 1 -- 172.21.15.6:0/1075775076 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c03ce10 con 0x7f67640ca050 2024-08-17T02:29:37.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.184+0000 7f676ae00640 1 -- 172.21.15.6:0/1075775076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67640a54a0 con 0x7f67640ca050 2024-08-17T02:29:37.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.185+0000 7f676ae00640 1 -- 172.21.15.6:0/1075775076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67640a5180 con 0x7f67640ca050 2024-08-17T02:29:37.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.186+0000 7f675b400640 1 -- 172.21.15.6:0/1075775076 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f675c03a610 con 0x7f67640ca050 2024-08-17T02:29:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.187+0000 7f675b400640 1 --2- 172.21.15.6:0/1075775076 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6740065150 0x7f6740067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.187+0000 7f675b400640 1 -- 172.21.15.6:0/1075775076 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f675c02e050 con 0x7f67640ca050 2024-08-17T02:29:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.187+0000 7f6763e00640 1 --2- 172.21.15.6:0/1075775076 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6740065150 0x7f6740067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.188+0000 7f6763e00640 1 --2- 172.21.15.6:0/1075775076 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6740065150 0x7f6740067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6754005840 tx=0x7f6754009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.191+0000 7f675b400640 1 -- 172.21.15.6:0/1075775076 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f675c071c70 con 0x7f67640ca050 2024-08-17T02:29:37.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.374+0000 7f676ae00640 1 -- 172.21.15.6:0/1075775076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6764063fb0 con 0x7f67640ca050 2024-08-17T02:29:37.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.375+0000 7f675b400640 1 -- 172.21.15.6:0/1075775076 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18551 (secure 0 0 0) 0x7f675c075290 con 0x7f67640ca050 2024-08-17T02:29:37.376 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:37.376 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":37,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:27:35.934220+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:19.345254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:20.195251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000329200.meta","create_time":"2024-08-17T02:27:32.084585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000329200"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000329200.data","create_time":"2024-08-17T02:27:32.953304+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000329200"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.377+0000 7f676ae00640 1 -- 172.21.15.6:0/1075775076 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6740065150 msgr2=0x7f6740067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.377+0000 7f676ae00640 1 --2- 172.21.15.6:0/1075775076 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6740065150 0x7f6740067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6754005840 tx=0x7f6754009040 comp rx=0 tx=0).stop 2024-08-17T02:29:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.377+0000 7f676ae00640 1 -- 172.21.15.6:0/1075775076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640ca050 msgr2=0x7f676406ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.377+0000 7f676ae00640 1 --2- 172.21.15.6:0/1075775076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640ca050 0x7f676406ae90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f675c009e60 tx=0x7f675c038000 comp rx=0 tx=0).stop 2024-08-17T02:29:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.377+0000 7f676ae00640 1 -- 172.21.15.6:0/1075775076 shutdown_connections 2024-08-17T02:29:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.377+0000 7f676ae00640 1 --2- 172.21.15.6:0/1075775076 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6740065150 0x7f6740067600 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.377+0000 7f676ae00640 1 --2- 172.21.15.6:0/1075775076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640ca050 0x7f676406ae90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.377+0000 7f676ae00640 1 --2- 172.21.15.6:0/1075775076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67640add30 0x7f676406a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.377+0000 7f676ae00640 1 --2- 172.21.15.6:0/1075775076 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f67640ad960 0x7f67641444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.377+0000 7f676ae00640 1 -- 172.21.15.6:0/1075775076 >> 172.21.15.6:0/1075775076 conn(0x7f6764066e60 msgr2=0x7f6764155460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.377+0000 7f676ae00640 1 -- 172.21.15.6:0/1075775076 shutdown_connections 2024-08-17T02:29:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.377+0000 7f676ae00640 1 -- 172.21.15.6:0/1075775076 wait complete. 2024-08-17T02:29:37.393 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:25.463503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:19.345254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:20.195251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000329200.meta', 'create_time': '2024-08-17T02:27:32.084585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000329200'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000329200.data', 'create_time': '2024-08-17T02:27:32.953304+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000329200'}}}] 2024-08-17T02:29:37.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.546+0000 7f44f2c00640 1 Processor -- start 2024-08-17T02:29:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.547+0000 7f44f2c00640 1 -- start start 2024-08-17T02:29:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.548+0000 7f44f2c00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44ec158ad0 0x7f44ec0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.548+0000 7f44f2c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f44ec0cc480 0x7f44ec0cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.548+0000 7f44f2c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f44ec0ca4d0 0x7f44ec0ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.548+0000 7f44f2c00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ec0af500 con 0x7f44ec158ad0 2024-08-17T02:29:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.548+0000 7f44f2c00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ec0ced30 con 0x7f44ec0cc480 2024-08-17T02:29:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.548+0000 7f44f2c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec0cd770 con 0x7f44ec0ca4d0 2024-08-17T02:29:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.548+0000 7f44f1800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44ec158ad0 0x7f44ec0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.548+0000 7f44f1800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44ec158ad0 0x7f44ec0ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44406/0 (socket says 172.21.15.6:44406) 2024-08-17T02:29:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.548+0000 7f44f1800640 1 -- 172.21.15.6:0/3563418544 learned_addr learned my addr 172.21.15.6:0/3563418544 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.548+0000 7f44f0e00640 1 --2- 172.21.15.6:0/3563418544 >> v2:172.21.15.136:3300/0 conn(0x7f44ec0cc480 0x7f44ec0cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.548+0000 7f44f2200640 1 --2- 172.21.15.6:0/3563418544 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f44ec0ca4d0 0x7f44ec0ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.548+0000 7f44f1800640 1 -- 172.21.15.6:0/3563418544 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f44ec0ca4d0 msgr2=0x7f44ec0ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.548+0000 7f44f1800640 1 --2- 172.21.15.6:0/3563418544 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f44ec0ca4d0 0x7f44ec0ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.548+0000 7f44f1800640 1 -- 172.21.15.6:0/3563418544 >> v2:172.21.15.136:3300/0 conn(0x7f44ec0cc480 msgr2=0x7f44ec0cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.548+0000 7f44f1800640 1 --2- 172.21.15.6:0/3563418544 >> v2:172.21.15.136:3300/0 conn(0x7f44ec0cc480 0x7f44ec0cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.548+0000 7f44f1800640 1 -- 172.21.15.6:0/3563418544 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec0cda30 con 0x7f44ec158ad0 2024-08-17T02:29:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.549+0000 7f44f1800640 1 --2- 172.21.15.6:0/3563418544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ec158ad0 0x7f44ec0ce7f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0cb260 tx=0x7f44e00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7938428b54526369 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.550+0000 7f44ebe00640 1 -- 172.21.15.6:0/3563418544 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e002ae60 con 0x7f44ec158ad0 2024-08-17T02:29:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.550+0000 7f44ebe00640 1 -- 172.21.15.6:0/3563418544 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e0032440 con 0x7f44ec158ad0 2024-08-17T02:29:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.550+0000 7f44ebe00640 1 -- 172.21.15.6:0/3563418544 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e00327e0 con 0x7f44ec158ad0 2024-08-17T02:29:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.550+0000 7f44f2c00640 1 -- 172.21.15.6:0/3563418544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ec158ad0 msgr2=0x7f44ec0ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.550+0000 7f44f2c00640 1 --2- 172.21.15.6:0/3563418544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ec158ad0 0x7f44ec0ce7f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0cb260 tx=0x7f44e00091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.550+0000 7f44f2c00640 1 -- 172.21.15.6:0/3563418544 shutdown_connections 2024-08-17T02:29:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.550+0000 7f44f2c00640 1 --2- 172.21.15.6:0/3563418544 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f44ec0ca4d0 0x7f44ec0ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.550+0000 7f44f2c00640 1 --2- 172.21.15.6:0/3563418544 >> v2:172.21.15.136:3300/0 conn(0x7f44ec0cc480 0x7f44ec0cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.550+0000 7f44f2c00640 1 --2- 172.21.15.6:0/3563418544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ec158ad0 0x7f44ec0ce7f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.550+0000 7f44f2c00640 1 -- 172.21.15.6:0/3563418544 >> 172.21.15.6:0/3563418544 conn(0x7f44ec087ad0 msgr2=0x7f44ec06e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.550+0000 7f44f2c00640 1 -- 172.21.15.6:0/3563418544 shutdown_connections 2024-08-17T02:29:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.550+0000 7f44f2c00640 1 -- 172.21.15.6:0/3563418544 wait complete. 2024-08-17T02:29:37.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.552+0000 7f44f2c00640 1 Processor -- start 2024-08-17T02:29:37.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.552+0000 7f44f2c00640 1 -- start start 2024-08-17T02:29:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.553+0000 7f44f2c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f44ec0ca4d0 0x7f44ec0b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.553+0000 7f44f2c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ec0cc480 0x7f44ec1564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.553+0000 7f44f2c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44ec158ad0 0x7f44ec15b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.553+0000 7f44f2c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec0b2fa0 con 0x7f44ec0cc480 2024-08-17T02:29:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.553+0000 7f44f2c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec0b29e0 con 0x7f44ec158ad0 2024-08-17T02:29:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.553+0000 7f44f2c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec0b2cc0 con 0x7f44ec0ca4d0 2024-08-17T02:29:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.553+0000 7f44f0e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ec0cc480 0x7f44ec1564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.553+0000 7f44f0e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ec0cc480 0x7f44ec1564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44412/0 (socket says 172.21.15.6:44412) 2024-08-17T02:29:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.553+0000 7f44f0e00640 1 -- 172.21.15.6:0/3170548458 learned_addr learned my addr 172.21.15.6:0/3170548458 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.553+0000 7f44f2200640 1 --2- 172.21.15.6:0/3170548458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44ec158ad0 0x7f44ec15b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.553+0000 7f44f1800640 1 --2- 172.21.15.6:0/3170548458 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f44ec0ca4d0 0x7f44ec0b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.554+0000 7f44f0e00640 1 -- 172.21.15.6:0/3170548458 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f44ec0ca4d0 msgr2=0x7f44ec0b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.554+0000 7f44f0e00640 1 --2- 172.21.15.6:0/3170548458 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f44ec0ca4d0 0x7f44ec0b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.554+0000 7f44f0e00640 1 -- 172.21.15.6:0/3170548458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44ec158ad0 msgr2=0x7f44ec15b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.554+0000 7f44f0e00640 1 --2- 172.21.15.6:0/3170548458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44ec158ad0 0x7f44ec15b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.554+0000 7f44f0e00640 1 -- 172.21.15.6:0/3170548458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e0009450 con 0x7f44ec0cc480 2024-08-17T02:29:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.554+0000 7f44f0e00640 1 --2- 172.21.15.6:0/3170548458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ec0cc480 0x7f44ec1564f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f44d800d890 tx=0x7f44d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.554+0000 7f44e8c00640 1 -- 172.21.15.6:0/3170548458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d800de20 con 0x7f44ec0cc480 2024-08-17T02:29:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.554+0000 7f44e8c00640 1 -- 172.21.15.6:0/3170548458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d800b8d0 con 0x7f44ec0cc480 2024-08-17T02:29:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.554+0000 7f44e8c00640 1 -- 172.21.15.6:0/3170548458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d800bc70 con 0x7f44ec0cc480 2024-08-17T02:29:37.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.554+0000 7f44f2c00640 1 -- 172.21.15.6:0/3170548458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ec0c7e40 con 0x7f44ec0cc480 2024-08-17T02:29:37.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.555+0000 7f44f2c00640 1 -- 172.21.15.6:0/3170548458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ec0b58c0 con 0x7f44ec0cc480 2024-08-17T02:29:37.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.555+0000 7f44f2c00640 1 -- 172.21.15.6:0/3170548458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ec070720 con 0x7f44ec0cc480 2024-08-17T02:29:37.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.556+0000 7f44e8c00640 1 -- 172.21.15.6:0/3170548458 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f44d8014640 con 0x7f44ec0cc480 2024-08-17T02:29:37.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.558+0000 7f44e8c00640 1 --2- 172.21.15.6:0/3170548458 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f44cc065150 0x7f44cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.558+0000 7f44e8c00640 1 -- 172.21.15.6:0/3170548458 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f44d8082d80 con 0x7f44ec0cc480 2024-08-17T02:29:37.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.558+0000 7f44f1800640 1 --2- 172.21.15.6:0/3170548458 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f44cc065150 0x7f44cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.559+0000 7f44f1800640 1 --2- 172.21.15.6:0/3170548458 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f44cc065150 0x7f44cc067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f44e0034000 tx=0x7f44e0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.562+0000 7f44e8c00640 1 -- 172.21.15.6:0/3170548458 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f44d8050b90 con 0x7f44ec0cc480 2024-08-17T02:29:37.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.745+0000 7f44f2c00640 1 -- 172.21.15.6:0/3170548458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f44ec0ccb50 con 0x7f44ec0cc480 2024-08-17T02:29:37.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.745+0000 7f44e8c00640 1 -- 172.21.15.6:0/3170548458 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f44d80541b0 con 0x7f44ec0cc480 2024-08-17T02:29:37.746 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-08-17T02:29:37.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.747+0000 7f44f2c00640 1 -- 172.21.15.6:0/3170548458 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f44cc065150 msgr2=0x7f44cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.747+0000 7f44f2c00640 1 --2- 172.21.15.6:0/3170548458 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f44cc065150 0x7f44cc067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f44e0034000 tx=0x7f44e0032000 comp rx=0 tx=0).stop 2024-08-17T02:29:37.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.747+0000 7f44f2c00640 1 -- 172.21.15.6:0/3170548458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ec0cc480 msgr2=0x7f44ec1564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.747+0000 7f44f2c00640 1 --2- 172.21.15.6:0/3170548458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ec0cc480 0x7f44ec1564f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f44d800d890 tx=0x7f44d8008040 comp rx=0 tx=0).stop 2024-08-17T02:29:37.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.747+0000 7f44f2c00640 1 -- 172.21.15.6:0/3170548458 shutdown_connections 2024-08-17T02:29:37.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.747+0000 7f44f2c00640 1 --2- 172.21.15.6:0/3170548458 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f44cc065150 0x7f44cc067600 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.747+0000 7f44f2c00640 1 --2- 172.21.15.6:0/3170548458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44ec158ad0 0x7f44ec15b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.747+0000 7f44f2c00640 1 --2- 172.21.15.6:0/3170548458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ec0cc480 0x7f44ec1564f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.747+0000 7f44f2c00640 1 --2- 172.21.15.6:0/3170548458 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f44ec0ca4d0 0x7f44ec0b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.747+0000 7f44f2c00640 1 -- 172.21.15.6:0/3170548458 >> 172.21.15.6:0/3170548458 conn(0x7f44ec087ad0 msgr2=0x7f44ec0cfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:37.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.747+0000 7f44f2c00640 1 -- 172.21.15.6:0/3170548458 shutdown_connections 2024-08-17T02:29:37.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.747+0000 7f44f2c00640 1 -- 172.21.15.6:0/3170548458 wait complete. 2024-08-17T02:29:37.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:29:37.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.919+0000 7f9196200640 1 Processor -- start 2024-08-17T02:29:37.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.919+0000 7f9196200640 1 -- start start 2024-08-17T02:29:37.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.920+0000 7f9196200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91900ad960 0x7f919015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.920+0000 7f9196200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f91900add30 0x7f9190156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.920+0000 7f9196200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919015b5e0 con 0x7f91900ca050 2024-08-17T02:29:37.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.920+0000 7f9196200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91900cb160 con 0x7f91900add30 2024-08-17T02:29:37.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.920+0000 7f9196200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91900b0d10 con 0x7f91900ad960 2024-08-17T02:29:37.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.920+0000 7f918fe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f91900add30 0x7f9190156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.920+0000 7f918f400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91900ad960 0x7f919015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.921+0000 7f918fe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f91900add30 0x7f9190156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:57190/0 (socket says 172.21.15.6:57190) 2024-08-17T02:29:37.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.921+0000 7f9187e00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f91900ca050 0x7f9190156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:59018/0 (socket says 172.21.15.6:59018) 2024-08-17T02:29:37.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.921+0000 7f918fe00640 1 -- 172.21.15.6:0/2551978452 learned_addr learned my addr 172.21.15.6:0/2551978452 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:37.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.921+0000 7f918f400640 1 -- 172.21.15.6:0/2551978452 >> v2:172.21.15.136:3300/0 conn(0x7f91900add30 msgr2=0x7f9190156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:37.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.921+0000 7f918f400640 1 --2- 172.21.15.6:0/2551978452 >> v2:172.21.15.136:3300/0 conn(0x7f91900add30 0x7f9190156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.921+0000 7f918f400640 1 -- 172.21.15.6:0/2551978452 >> v1:172.21.15.136:6789/0 conn(0x7f91900ca050 legacy=0x7f9190156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.921+0000 7f918f400640 1 -- 172.21.15.6:0/2551978452 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91900ca550 con 0x7f91900ad960 2024-08-17T02:29:37.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.921+0000 7f918ea00640 1 -- 172.21.15.6:0/2551978452 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080400783 0 0) 0x7f9178001110 con 0x7f91900ca050 2024-08-17T02:29:37.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.921+0000 7f918fe00640 1 --2- 172.21.15.6:0/2551978452 >> v2:172.21.15.136:3300/0 conn(0x7f91900add30 0x7f9190156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.922+0000 7f918f400640 1 --2- 172.21.15.6:0/2551978452 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91900ad960 0x7f919015b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9180009850 tx=0x7f91800090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6670dc03dd3714d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.922+0000 7f918ea00640 1 -- 172.21.15.6:0/2551978452 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918002ae10 con 0x7f91900ad960 2024-08-17T02:29:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.923+0000 7f918ea00640 1 -- 172.21.15.6:0/2551978452 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9180032440 con 0x7f91900ad960 2024-08-17T02:29:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.923+0000 7f918ea00640 1 -- 172.21.15.6:0/2551978452 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91800327e0 con 0x7f91900ad960 2024-08-17T02:29:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.923+0000 7f9196200640 1 -- 172.21.15.6:0/2551978452 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91900ad960 msgr2=0x7f919015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.923+0000 7f9196200640 1 --2- 172.21.15.6:0/2551978452 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91900ad960 0x7f919015b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9180009850 tx=0x7f91800090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.923+0000 7f9196200640 1 -- 172.21.15.6:0/2551978452 shutdown_connections 2024-08-17T02:29:37.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.923+0000 7f9196200640 1 --2- 172.21.15.6:0/2551978452 >> v2:172.21.15.136:3300/0 conn(0x7f91900add30 0x7f9190156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.923+0000 7f9196200640 1 --2- 172.21.15.6:0/2551978452 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91900ad960 0x7f919015b0a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.923+0000 7f9196200640 1 -- 172.21.15.6:0/2551978452 >> 172.21.15.6:0/2551978452 conn(0x7f9190066e60 msgr2=0x7f9190067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:37.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.923+0000 7f9196200640 1 -- 172.21.15.6:0/2551978452 shutdown_connections 2024-08-17T02:29:37.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.923+0000 7f9196200640 1 -- 172.21.15.6:0/2551978452 wait complete. 2024-08-17T02:29:37.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.925+0000 7f9196200640 1 Processor -- start 2024-08-17T02:29:37.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.925+0000 7f9196200640 1 -- start start 2024-08-17T02:29:37.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.925+0000 7f9196200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91900ad960 0x7f91901473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.925+0000 7f9196200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91900add30 0x7f9190159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.926+0000 7f9196200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91900ca050 0x7f91900a9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.926+0000 7f9196200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91900a9590 con 0x7f91900add30 2024-08-17T02:29:37.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.926+0000 7f9196200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91901478e0 con 0x7f91900ad960 2024-08-17T02:29:37.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.926+0000 7f9196200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91900a8980 con 0x7f91900ca050 2024-08-17T02:29:37.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.926+0000 7f9187e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91900add30 0x7f9190159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.926+0000 7f9187e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91900add30 0x7f9190159910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44418/0 (socket says 172.21.15.6:44418) 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.926+0000 7f9187e00640 1 -- 172.21.15.6:0/1593195838 learned_addr learned my addr 172.21.15.6:0/1593195838 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.926+0000 7f918fe00640 1 --2- 172.21.15.6:0/1593195838 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91900ca050 0x7f91900a9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.926+0000 7f918f400640 1 --2- 172.21.15.6:0/1593195838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91900ad960 0x7f91901473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.926+0000 7f9187e00640 1 -- 172.21.15.6:0/1593195838 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91900ca050 msgr2=0x7f91900a9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.926+0000 7f9187e00640 1 --2- 172.21.15.6:0/1593195838 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91900ca050 0x7f91900a9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.926+0000 7f9187e00640 1 -- 172.21.15.6:0/1593195838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91900ad960 msgr2=0x7f91901473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.926+0000 7f9187e00640 1 --2- 172.21.15.6:0/1593195838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91900ad960 0x7f91901473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.926+0000 7f9187e00640 1 -- 172.21.15.6:0/1593195838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9188009ae0 con 0x7f91900add30 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.926+0000 7f918f400640 1 --2- 172.21.15.6:0/1593195838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91900ad960 0x7f91901473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.927+0000 7f9187e00640 1 --2- 172.21.15.6:0/1593195838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91900add30 0x7f9190159910 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f917800c4f0 tx=0x7f9178007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.927+0000 7f9186a00640 1 -- 172.21.15.6:0/1593195838 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91780072e0 con 0x7f91900add30 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.927+0000 7f9186a00640 1 -- 172.21.15.6:0/1593195838 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9178007460 con 0x7f91900add30 2024-08-17T02:29:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.927+0000 7f9186a00640 1 -- 172.21.15.6:0/1593195838 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91780049f0 con 0x7f91900add30 2024-08-17T02:29:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.927+0000 7f9196200640 1 -- 172.21.15.6:0/1593195838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9180009390 con 0x7f91900add30 2024-08-17T02:29:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.927+0000 7f9196200640 1 -- 172.21.15.6:0/1593195838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91900a8f40 con 0x7f91900add30 2024-08-17T02:29:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.928+0000 7f9196200640 1 -- 172.21.15.6:0/1593195838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9190063fb0 con 0x7f91900add30 2024-08-17T02:29:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.929+0000 7f9186a00640 1 -- 172.21.15.6:0/1593195838 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9178013400 con 0x7f91900add30 2024-08-17T02:29:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.930+0000 7f9186a00640 1 --2- 172.21.15.6:0/1593195838 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f916c065150 0x7f916c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.930+0000 7f9186a00640 1 -- 172.21.15.6:0/1593195838 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f9178082030 con 0x7f91900add30 2024-08-17T02:29:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.930+0000 7f918f400640 1 --2- 172.21.15.6:0/1593195838 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f916c065150 0x7f916c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.931+0000 7f918f400640 1 --2- 172.21.15.6:0/1593195838 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f916c065150 0x7f916c067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9180034000 tx=0x7f9180032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:37.934+0000 7f9186a00640 1 -- 172.21.15.6:0/1593195838 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f917804fcd0 con 0x7f91900add30 2024-08-17T02:29:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.115+0000 7f9196200640 1 -- 172.21.15.6:0/1593195838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f919015b5e0 con 0x7f91900add30 2024-08-17T02:29:38.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.115+0000 7f9186a00640 1 -- 172.21.15.6:0/1593195838 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f919015b5e0 con 0x7f91900add30 2024-08-17T02:29:38.116 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-08-17T02:29:38.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.117+0000 7f9196200640 1 -- 172.21.15.6:0/1593195838 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f916c065150 msgr2=0x7f916c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.117+0000 7f9196200640 1 --2- 172.21.15.6:0/1593195838 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f916c065150 0x7f916c067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9180034000 tx=0x7f9180032000 comp rx=0 tx=0).stop 2024-08-17T02:29:38.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.117+0000 7f9196200640 1 -- 172.21.15.6:0/1593195838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91900add30 msgr2=0x7f9190159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.117+0000 7f9196200640 1 --2- 172.21.15.6:0/1593195838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91900add30 0x7f9190159910 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f917800c4f0 tx=0x7f9178007ef0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.117+0000 7f9196200640 1 -- 172.21.15.6:0/1593195838 shutdown_connections 2024-08-17T02:29:38.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.117+0000 7f9196200640 1 --2- 172.21.15.6:0/1593195838 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f916c065150 0x7f916c067600 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.117+0000 7f9196200640 1 --2- 172.21.15.6:0/1593195838 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f91900ca050 0x7f91900a9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.117+0000 7f9196200640 1 --2- 172.21.15.6:0/1593195838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91900add30 0x7f9190159910 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.117+0000 7f9196200640 1 --2- 172.21.15.6:0/1593195838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91900ad960 0x7f91901473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.117+0000 7f9196200640 1 -- 172.21.15.6:0/1593195838 >> 172.21.15.6:0/1593195838 conn(0x7f9190066e60 msgr2=0x7f9190151080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:38.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.117+0000 7f9196200640 1 -- 172.21.15.6:0/1593195838 shutdown_connections 2024-08-17T02:29:38.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.117+0000 7f9196200640 1 -- 172.21.15.6:0/1593195838 wait complete. 2024-08-17T02:29:38.133 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:29:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.287+0000 7f8938600640 1 Processor -- start 2024-08-17T02:29:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.287+0000 7f8938600640 1 -- start start 2024-08-17T02:29:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.288+0000 7f8938600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f89300afca0 0x7f89300b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.288+0000 7f8938600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89300acf10 0x7f8930159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.289+0000 7f8938600640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893015a4e0 con 0x7f89301589a0 2024-08-17T02:29:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.289+0000 7f8938600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89300b0980 con 0x7f89300acf10 2024-08-17T02:29:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.289+0000 7f8938600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89300c92b0 con 0x7f89300afca0 2024-08-17T02:29:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.289+0000 7f8935200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89300acf10 0x7f8930159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.289+0000 7f8936600640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f89301589a0 0x7f893006d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37196/0 (socket says 172.21.15.6:37196) 2024-08-17T02:29:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.289+0000 7f8936600640 1 -- 172.21.15.6:0/692244873 learned_addr learned my addr 172.21.15.6:0/692244873 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.289+0000 7f8935c00640 1 --2- 172.21.15.6:0/692244873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f89300afca0 0x7f89300b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.289+0000 7f8935200640 1 -- 172.21.15.6:0/692244873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f89300afca0 msgr2=0x7f89300b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.289+0000 7f8935200640 1 --2- 172.21.15.6:0/692244873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f89300afca0 0x7f89300b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.289+0000 7f8935200640 1 -- 172.21.15.6:0/692244873 >> v1:172.21.15.6:6789/0 conn(0x7f89301589a0 legacy=0x7f893006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.289+0000 7f8935200640 1 -- 172.21.15.6:0/692244873 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89300ad480 con 0x7f89300acf10 2024-08-17T02:29:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.289+0000 7f892fe00640 1 -- 172.21.15.6:0/692244873 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741700032 0 0) 0x7f8928001490 con 0x7f89301589a0 2024-08-17T02:29:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.290+0000 7f8935200640 1 --2- 172.21.15.6:0/692244873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89300acf10 0x7f8930159fa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f891c009880 tx=0x7f891c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ceb8eea6639ae9a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.291+0000 7f892fe00640 1 -- 172.21.15.6:0/692244873 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c02ad70 con 0x7f89300acf10 2024-08-17T02:29:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.291+0000 7f892fe00640 1 -- 172.21.15.6:0/692244873 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c032440 con 0x7f89300acf10 2024-08-17T02:29:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.291+0000 7f892fe00640 1 -- 172.21.15.6:0/692244873 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c0327e0 con 0x7f89300acf10 2024-08-17T02:29:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.291+0000 7f8938600640 1 -- 172.21.15.6:0/692244873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89300acf10 msgr2=0x7f8930159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.291+0000 7f8938600640 1 --2- 172.21.15.6:0/692244873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89300acf10 0x7f8930159fa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f891c009880 tx=0x7f891c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.291+0000 7f8938600640 1 -- 172.21.15.6:0/692244873 shutdown_connections 2024-08-17T02:29:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.291+0000 7f8938600640 1 --2- 172.21.15.6:0/692244873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89300acf10 0x7f8930159fa0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.291+0000 7f8938600640 1 --2- 172.21.15.6:0/692244873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f89300afca0 0x7f89300b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.291+0000 7f8938600640 1 -- 172.21.15.6:0/692244873 >> 172.21.15.6:0/692244873 conn(0x7f8930066e60 msgr2=0x7f8930067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.291+0000 7f8938600640 1 -- 172.21.15.6:0/692244873 shutdown_connections 2024-08-17T02:29:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.291+0000 7f8938600640 1 -- 172.21.15.6:0/692244873 wait complete. 2024-08-17T02:29:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.293+0000 7f8938600640 1 Processor -- start 2024-08-17T02:29:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.293+0000 7f8938600640 1 -- start start 2024-08-17T02:29:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.294+0000 7f8938600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f89300acf10 0x7f893015da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.294+0000 7f8938600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f89300afca0 0x7f8930157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.294+0000 7f8938600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89301589a0 0x7f893013f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.294+0000 7f8938600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893015cc50 con 0x7f89301589a0 2024-08-17T02:29:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.294+0000 7f8938600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893015cf30 con 0x7f89300afca0 2024-08-17T02:29:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.294+0000 7f8938600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893015d210 con 0x7f89300acf10 2024-08-17T02:29:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.294+0000 7f8936600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89301589a0 0x7f893013f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.294+0000 7f8936600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89301589a0 0x7f893013f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44438/0 (socket says 172.21.15.6:44438) 2024-08-17T02:29:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.294+0000 7f8936600640 1 -- 172.21.15.6:0/3270613843 learned_addr learned my addr 172.21.15.6:0/3270613843 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.294+0000 7f8935200640 1 --2- 172.21.15.6:0/3270613843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f89300afca0 0x7f8930157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.294+0000 7f8935c00640 1 --2- 172.21.15.6:0/3270613843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f89300acf10 0x7f893015da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.294+0000 7f8936600640 1 -- 172.21.15.6:0/3270613843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f89300acf10 msgr2=0x7f893015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.294+0000 7f8936600640 1 --2- 172.21.15.6:0/3270613843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f89300acf10 0x7f893015da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.294+0000 7f8936600640 1 -- 172.21.15.6:0/3270613843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f89300afca0 msgr2=0x7f8930157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.294+0000 7f8936600640 1 --2- 172.21.15.6:0/3270613843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f89300afca0 0x7f8930157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.294+0000 7f8936600640 1 -- 172.21.15.6:0/3270613843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c009390 con 0x7f89301589a0 2024-08-17T02:29:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.294+0000 7f8935200640 1 --2- 172.21.15.6:0/3270613843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f89300afca0 0x7f8930157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.295+0000 7f8936600640 1 --2- 172.21.15.6:0/3270613843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89301589a0 0x7f893013f2b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f892800cc10 tx=0x7f8928001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.295+0000 7f892cc00640 1 -- 172.21.15.6:0/3270613843 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892800ce30 con 0x7f89301589a0 2024-08-17T02:29:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.295+0000 7f892cc00640 1 -- 172.21.15.6:0/3270613843 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892800a7f0 con 0x7f89301589a0 2024-08-17T02:29:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.295+0000 7f8938600640 1 -- 172.21.15.6:0/3270613843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893015d4f0 con 0x7f89301589a0 2024-08-17T02:29:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.295+0000 7f892cc00640 1 -- 172.21.15.6:0/3270613843 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892800abf0 con 0x7f89301589a0 2024-08-17T02:29:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.295+0000 7f8938600640 1 -- 172.21.15.6:0/3270613843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893015c870 con 0x7f89301589a0 2024-08-17T02:29:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.296+0000 7f8938600640 1 -- 172.21.15.6:0/3270613843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893015d6e0 con 0x7f89301589a0 2024-08-17T02:29:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.297+0000 7f892cc00640 1 -- 172.21.15.6:0/3270613843 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f892800ad50 con 0x7f89301589a0 2024-08-17T02:29:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.298+0000 7f892cc00640 1 --2- 172.21.15.6:0/3270613843 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8910065150 0x7f8910067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.298+0000 7f892cc00640 1 -- 172.21.15.6:0/3270613843 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f8928082700 con 0x7f89301589a0 2024-08-17T02:29:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.298+0000 7f8935c00640 1 --2- 172.21.15.6:0/3270613843 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8910065150 0x7f8910067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.299+0000 7f8935c00640 1 --2- 172.21.15.6:0/3270613843 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8910065150 0x7f8910067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8924009cb0 tx=0x7f8924008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.302+0000 7f892cc00640 1 -- 172.21.15.6:0/3270613843 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f89280504c0 con 0x7f89301589a0 2024-08-17T02:29:38.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.482+0000 7f8938600640 1 -- 172.21.15.6:0/3270613843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f893015a4e0 con 0x7f89301589a0 2024-08-17T02:29:38.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.483+0000 7f892cc00640 1 -- 172.21.15.6:0/3270613843 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f893015a4e0 con 0x7f89301589a0 2024-08-17T02:29:38.484 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-08-17T02:29:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.485+0000 7f8938600640 1 -- 172.21.15.6:0/3270613843 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8910065150 msgr2=0x7f8910067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.485+0000 7f8938600640 1 --2- 172.21.15.6:0/3270613843 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8910065150 0x7f8910067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8924009cb0 tx=0x7f8924008040 comp rx=0 tx=0).stop 2024-08-17T02:29:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.485+0000 7f8938600640 1 -- 172.21.15.6:0/3270613843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89301589a0 msgr2=0x7f893013f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.485+0000 7f8938600640 1 --2- 172.21.15.6:0/3270613843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89301589a0 0x7f893013f2b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f892800cc10 tx=0x7f8928001970 comp rx=0 tx=0).stop 2024-08-17T02:29:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.485+0000 7f8938600640 1 -- 172.21.15.6:0/3270613843 shutdown_connections 2024-08-17T02:29:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.485+0000 7f8938600640 1 --2- 172.21.15.6:0/3270613843 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8910065150 0x7f8910067600 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.485+0000 7f8938600640 1 --2- 172.21.15.6:0/3270613843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89301589a0 0x7f893013f2b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.485+0000 7f8938600640 1 --2- 172.21.15.6:0/3270613843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f89300afca0 0x7f8930157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.485+0000 7f8938600640 1 --2- 172.21.15.6:0/3270613843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f89300acf10 0x7f893015da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.485+0000 7f8938600640 1 -- 172.21.15.6:0/3270613843 >> 172.21.15.6:0/3270613843 conn(0x7f8930066e60 msgr2=0x7f89301597c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:38.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.485+0000 7f8938600640 1 -- 172.21.15.6:0/3270613843 shutdown_connections 2024-08-17T02:29:38.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.485+0000 7f8938600640 1 -- 172.21.15.6:0/3270613843 wait complete. 2024-08-17T02:29:38.500 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000329200.meta pg_num 2024-08-17T02:29:38.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.654+0000 7f3665800640 1 Processor -- start 2024-08-17T02:29:38.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.654+0000 7f3665800640 1 -- start start 2024-08-17T02:29:38.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.655+0000 7f3665800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36600ad960 0x7f366015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.655+0000 7f3665800640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366015b5e0 con 0x7f36600add30 2024-08-17T02:29:38.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.655+0000 7f3665800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36600cb160 con 0x7f36600ca050 2024-08-17T02:29:38.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.655+0000 7f3665800640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36600b0d10 con 0x7f36600ad960 2024-08-17T02:29:38.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.655+0000 7f365f400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f36600add30 0x7f36600aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37204/0 (socket says 172.21.15.6:37204) 2024-08-17T02:29:38.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.655+0000 7f365f400640 1 -- 172.21.15.6:0/1621514094 learned_addr learned my addr 172.21.15.6:0/1621514094 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:38.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.655+0000 7f365ea00640 1 --2- 172.21.15.6:0/1621514094 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36600ad960 0x7f366015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.656+0000 7f365e000640 1 -- 172.21.15.6:0/1621514094 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692338790 0 0) 0x7f3658001490 con 0x7f36600add30 2024-08-17T02:29:38.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.656+0000 7f365e000640 1 -- 172.21.15.6:0/1621514094 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36440034e0 con 0x7f36600add30 2024-08-17T02:29:38.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.656+0000 7f365ea00640 1 -- 172.21.15.6:0/1621514094 >> v1:172.21.15.136:6789/0 conn(0x7f36600ca050 legacy=0x7f3660156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.656+0000 7f365e000640 1 -- 172.21.15.6:0/1621514094 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359471990 0 0) 0x7f36600cb160 con 0x7f36600ca050 2024-08-17T02:29:38.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.656+0000 7f365ea00640 1 -- 172.21.15.6:0/1621514094 >> v1:172.21.15.6:6789/0 conn(0x7f36600add30 legacy=0x7f36600aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.656+0000 7f365ea00640 1 -- 172.21.15.6:0/1621514094 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36600ca550 con 0x7f36600ad960 2024-08-17T02:29:38.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.657+0000 7f365ea00640 1 --2- 172.21.15.6:0/1621514094 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36600ad960 0x7f366015b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3650009880 tx=0x7f36500090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54e9ad3d9f33e9f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:38.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.657+0000 7f365e000640 1 -- 172.21.15.6:0/1621514094 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365002aea0 con 0x7f36600ad960 2024-08-17T02:29:38.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.657+0000 7f365e000640 1 -- 172.21.15.6:0/1621514094 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3650032440 con 0x7f36600ad960 2024-08-17T02:29:38.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.657+0000 7f365e000640 1 -- 172.21.15.6:0/1621514094 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36500327e0 con 0x7f36600ad960 2024-08-17T02:29:38.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.658+0000 7f3665800640 1 -- 172.21.15.6:0/1621514094 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36600ad960 msgr2=0x7f366015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.658+0000 7f3665800640 1 --2- 172.21.15.6:0/1621514094 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36600ad960 0x7f366015b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3650009880 tx=0x7f36500090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.658+0000 7f3665800640 1 -- 172.21.15.6:0/1621514094 shutdown_connections 2024-08-17T02:29:38.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.658+0000 7f3665800640 1 --2- 172.21.15.6:0/1621514094 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36600ad960 0x7f366015b0a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.658+0000 7f3665800640 1 -- 172.21.15.6:0/1621514094 >> 172.21.15.6:0/1621514094 conn(0x7f3660066e60 msgr2=0x7f3660067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:38.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.658+0000 7f3665800640 1 -- 172.21.15.6:0/1621514094 shutdown_connections 2024-08-17T02:29:38.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.658+0000 7f3665800640 1 -- 172.21.15.6:0/1621514094 wait complete. 2024-08-17T02:29:38.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.659+0000 7f3665800640 1 Processor -- start 2024-08-17T02:29:38.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.660+0000 7f3665800640 1 -- start start 2024-08-17T02:29:38.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.660+0000 7f3665800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36600ad960 0x7f3660151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.660+0000 7f3665800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36600add30 0x7f366016a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.660+0000 7f3665800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36600ca050 0x7f366016a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.660+0000 7f3665800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366016b0c0 con 0x7f36600ad960 2024-08-17T02:29:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.660+0000 7f3665800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36600a4600 con 0x7f36600add30 2024-08-17T02:29:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.660+0000 7f3665800640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3660159780 con 0x7f36600ca050 2024-08-17T02:29:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.661+0000 7f365ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36600ad960 0x7f3660151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.661+0000 7f365ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36600ad960 0x7f3660151590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44448/0 (socket says 172.21.15.6:44448) 2024-08-17T02:29:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.661+0000 7f365ea00640 1 -- 172.21.15.6:0/3474173721 learned_addr learned my addr 172.21.15.6:0/3474173721 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.661+0000 7f365f400640 1 --2- 172.21.15.6:0/3474173721 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36600ca050 0x7f366016a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.661+0000 7f3657e00640 1 --2- 172.21.15.6:0/3474173721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36600add30 0x7f366016a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.661+0000 7f365ea00640 1 -- 172.21.15.6:0/3474173721 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36600ca050 msgr2=0x7f366016a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.661+0000 7f365ea00640 1 --2- 172.21.15.6:0/3474173721 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36600ca050 0x7f366016a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.661+0000 7f365ea00640 1 -- 172.21.15.6:0/3474173721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36600add30 msgr2=0x7f366016a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.661+0000 7f365ea00640 1 --2- 172.21.15.6:0/3474173721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36600add30 0x7f366016a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.661+0000 7f365ea00640 1 -- 172.21.15.6:0/3474173721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3650009390 con 0x7f36600ad960 2024-08-17T02:29:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.661+0000 7f3657e00640 1 --2- 172.21.15.6:0/3474173721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36600add30 0x7f366016a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.662+0000 7f365ea00640 1 --2- 172.21.15.6:0/3474173721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36600ad960 0x7f3660151590 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3650009880 tx=0x7f3650032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.662+0000 7f3656000640 1 -- 172.21.15.6:0/3474173721 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365002aea0 con 0x7f36600ad960 2024-08-17T02:29:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.662+0000 7f3656000640 1 -- 172.21.15.6:0/3474173721 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3650031a60 con 0x7f36600ad960 2024-08-17T02:29:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.662+0000 7f3656000640 1 -- 172.21.15.6:0/3474173721 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650031e40 con 0x7f36600ad960 2024-08-17T02:29:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.662+0000 7f3665800640 1 -- 172.21.15.6:0/3474173721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36601591c0 con 0x7f36600ad960 2024-08-17T02:29:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.662+0000 7f3665800640 1 -- 172.21.15.6:0/3474173721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3660151ad0 con 0x7f36600ad960 2024-08-17T02:29:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.663+0000 7f3665800640 1 -- 172.21.15.6:0/3474173721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3660063fb0 con 0x7f36600ad960 2024-08-17T02:29:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.664+0000 7f3656000640 1 -- 172.21.15.6:0/3474173721 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3650039040 con 0x7f36600ad960 2024-08-17T02:29:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.665+0000 7f3656000640 1 --2- 172.21.15.6:0/3474173721 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f363c065150 0x7f363c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.665+0000 7f3656000640 1 -- 172.21.15.6:0/3474173721 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f36500a21f0 con 0x7f36600ad960 2024-08-17T02:29:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.665+0000 7f3657e00640 1 --2- 172.21.15.6:0/3474173721 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f363c065150 0x7f363c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.666+0000 7f3657e00640 1 --2- 172.21.15.6:0/3474173721 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f363c065150 0x7f363c067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3660159eb0 tx=0x7f3648009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:38.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.669+0000 7f3656000640 1 -- 172.21.15.6:0/3474173721 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f365006ff40 con 0x7f36600ad960 2024-08-17T02:29:38.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.855+0000 7f3665800640 1 -- 172.21.15.6:0/3474173721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000329200.meta", "var": "pg_num"} v 0) v1 -- 0x7f36600cbd70 con 0x7f36600ad960 2024-08-17T02:29:38.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.856+0000 7f3656000640 1 -- 172.21.15.6:0/3474173721 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000329200.meta", "var": "pg_num"}]=0 v37) v1 ==== 124+0+11 (secure 0 0 0) 0x7f3650073560 con 0x7f36600ad960 2024-08-17T02:29:38.856 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-08-17T02:29:38.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.858+0000 7f3665800640 1 -- 172.21.15.6:0/3474173721 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f363c065150 msgr2=0x7f363c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.858+0000 7f3665800640 1 --2- 172.21.15.6:0/3474173721 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f363c065150 0x7f363c067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3660159eb0 tx=0x7f3648009040 comp rx=0 tx=0).stop 2024-08-17T02:29:38.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.858+0000 7f3665800640 1 -- 172.21.15.6:0/3474173721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36600ad960 msgr2=0x7f3660151590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.858+0000 7f3665800640 1 --2- 172.21.15.6:0/3474173721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36600ad960 0x7f3660151590 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3650009880 tx=0x7f3650032000 comp rx=0 tx=0).stop 2024-08-17T02:29:38.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.858+0000 7f3665800640 1 -- 172.21.15.6:0/3474173721 shutdown_connections 2024-08-17T02:29:38.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.858+0000 7f3665800640 1 --2- 172.21.15.6:0/3474173721 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f363c065150 0x7f363c067600 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.858+0000 7f3665800640 1 --2- 172.21.15.6:0/3474173721 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36600ca050 0x7f366016a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.858+0000 7f3665800640 1 --2- 172.21.15.6:0/3474173721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36600add30 0x7f366016a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.858+0000 7f3665800640 1 --2- 172.21.15.6:0/3474173721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36600ad960 0x7f3660151590 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.858+0000 7f3665800640 1 -- 172.21.15.6:0/3474173721 >> 172.21.15.6:0/3474173721 conn(0x7f3660066e60 msgr2=0x7f366006a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:38.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.858+0000 7f3665800640 1 -- 172.21.15.6:0/3474173721 shutdown_connections 2024-08-17T02:29:38.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:38.858+0000 7f3665800640 1 -- 172.21.15.6:0/3474173721 wait complete. 2024-08-17T02:29:38.874 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000329200.data pg_num 2024-08-17T02:29:39.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.027+0000 7f24f2c00640 1 Processor -- start 2024-08-17T02:29:39.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.027+0000 7f24f2c00640 1 -- start start 2024-08-17T02:29:39.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.029+0000 7f24f2c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f24ec0acf10 0x7f24ec0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.029+0000 7f24f2c00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ec0c92b0 con 0x7f24ec0afca0 2024-08-17T02:29:39.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.029+0000 7f24f2c00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ec0ad480 con 0x7f24ec1590b0 2024-08-17T02:29:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.029+0000 7f24f2c00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ec0b0980 con 0x7f24ec0acf10 2024-08-17T02:29:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.029+0000 7f24ebe00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f24ec0afca0 0x7f24ec1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37214/0 (socket says 172.21.15.6:37214) 2024-08-17T02:29:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.029+0000 7f24ebe00640 1 -- 172.21.15.6:0/1803366126 learned_addr learned my addr 172.21.15.6:0/1803366126 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.029+0000 7f24f0c00640 1 --2- 172.21.15.6:0/1803366126 >> v2:172.21.15.136:3300/0 conn(0x7f24ec0acf10 0x7f24ec0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.029+0000 7f24eb400640 1 -- 172.21.15.6:0/1803366126 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492370371 0 0) 0x7f24ec0c92b0 con 0x7f24ec0afca0 2024-08-17T02:29:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.029+0000 7f24eb400640 1 -- 172.21.15.6:0/1803366126 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24d00034e0 con 0x7f24ec0afca0 2024-08-17T02:29:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.030+0000 7f24eb400640 1 -- 172.21.15.6:0/1803366126 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2240707776 0 0) 0x7f24d00034e0 con 0x7f24ec0afca0 2024-08-17T02:29:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.030+0000 7f24eb400640 1 -- 172.21.15.6:0/1803366126 >> v2:172.21.15.136:3300/0 conn(0x7f24ec0acf10 msgr2=0x7f24ec0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.030+0000 7f24eb400640 1 --2- 172.21.15.6:0/1803366126 >> v2:172.21.15.136:3300/0 conn(0x7f24ec0acf10 0x7f24ec0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.030+0000 7f24eb400640 1 -- 172.21.15.6:0/1803366126 >> v1:172.21.15.136:6789/0 conn(0x7f24ec1590b0 legacy=0x7f24ec0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.030+0000 7f24eb400640 1 -- 172.21.15.6:0/1803366126 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec0ad760 con 0x7f24ec0afca0 2024-08-17T02:29:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.030+0000 7f24eb400640 1 -- 172.21.15.6:0/1803366126 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f24dc001470 con 0x7f24ec0afca0 2024-08-17T02:29:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.030+0000 7f24eb400640 1 -- 172.21.15.6:0/1803366126 >> v1:172.21.15.6:6789/0 conn(0x7f24ec0afca0 legacy=0x7f24ec1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.030+0000 7f24eb400640 1 --2- 172.21.15.6:0/1803366126 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24d00039d0 0x7f24d0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.030+0000 7f24eb400640 1 --2- 172.21.15.6:0/1803366126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24d0004780 0x7f24d0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.030+0000 7f24eb400640 1 --2- 172.21.15.6:0/1803366126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24d0005130 0x7f24d000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.030+0000 7f24eb400640 1 -- 172.21.15.6:0/1803366126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d000e220 con 0x7f24d0005130 2024-08-17T02:29:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.030+0000 7f24eb400640 1 -- 172.21.15.6:0/1803366126 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d000e390 con 0x7f24d0004780 2024-08-17T02:29:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.030+0000 7f24eb400640 1 -- 172.21.15.6:0/1803366126 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d000e550 con 0x7f24d00039d0 2024-08-17T02:29:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.030+0000 7f24f0c00640 1 --2- 172.21.15.6:0/1803366126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24d0005130 0x7f24d000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.030+0000 7f24ebe00640 1 --2- 172.21.15.6:0/1803366126 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24d00039d0 0x7f24d0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.030+0000 7f24e3e00640 1 --2- 172.21.15.6:0/1803366126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24d0004780 0x7f24d0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.031+0000 7f24f0c00640 1 -- 172.21.15.6:0/1803366126 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24d00039d0 msgr2=0x7f24d0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:39.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.031+0000 7f24f0c00640 1 --2- 172.21.15.6:0/1803366126 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24d00039d0 0x7f24d0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.031+0000 7f24f0c00640 1 -- 172.21.15.6:0/1803366126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24d0004780 msgr2=0x7f24d0004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:39.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.031+0000 7f24f0c00640 1 --2- 172.21.15.6:0/1803366126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24d0004780 0x7f24d0004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.031+0000 7f24f0c00640 1 -- 172.21.15.6:0/1803366126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d00034e0 con 0x7f24d0005130 2024-08-17T02:29:39.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.031+0000 7f24f0c00640 1 -- 172.21.15.6:0/1803366126 reap_dead start 2024-08-17T02:29:39.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.032+0000 7f24f0c00640 1 --2- 172.21.15.6:0/1803366126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24d0005130 0x7f24d000dbe0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f24e400e210 tx=0x7f24e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf38b7a1ec605fe0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.032+0000 7f24eb400640 1 -- 172.21.15.6:0/1803366126 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e402c040 con 0x7f24d0005130 2024-08-17T02:29:39.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.032+0000 7f24eb400640 1 -- 172.21.15.6:0/1803366126 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e400f040 con 0x7f24d0005130 2024-08-17T02:29:39.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.032+0000 7f24eb400640 1 -- 172.21.15.6:0/1803366126 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e4030650 con 0x7f24d0005130 2024-08-17T02:29:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.032+0000 7f24f2c00640 1 -- 172.21.15.6:0/1803366126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24d0005130 msgr2=0x7f24d000dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.032+0000 7f24f2c00640 1 --2- 172.21.15.6:0/1803366126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24d0005130 0x7f24d000dbe0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f24e400e210 tx=0x7f24e400b040 comp rx=0 tx=0).stop 2024-08-17T02:29:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.032+0000 7f24f2c00640 1 -- 172.21.15.6:0/1803366126 shutdown_connections 2024-08-17T02:29:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.032+0000 7f24f2c00640 1 --2- 172.21.15.6:0/1803366126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24d0005130 0x7f24d000dbe0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.032+0000 7f24f2c00640 1 -- 172.21.15.6:0/1803366126 >> 172.21.15.6:0/1803366126 conn(0x7f24ec066e60 msgr2=0x7f24ec067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.033+0000 7f24f2c00640 1 -- 172.21.15.6:0/1803366126 shutdown_connections 2024-08-17T02:29:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.033+0000 7f24f2c00640 1 -- 172.21.15.6:0/1803366126 wait complete. 2024-08-17T02:29:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.034+0000 7f24f2c00640 1 Processor -- start 2024-08-17T02:29:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.034+0000 7f24f2c00640 1 -- start start 2024-08-17T02:29:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.035+0000 7f24f2c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24d0005130 0x7f24ec0c0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.035+0000 7f24f2c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24ec0c0f50 0x7f24ec14fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.035+0000 7f24f2c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24ec14ffc0 0x7f24ec15a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.035+0000 7f24f2c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec167070 con 0x7f24ec0c0f50 2024-08-17T02:29:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.035+0000 7f24f2c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec150440 con 0x7f24d0005130 2024-08-17T02:29:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.035+0000 7f24f2c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec15b690 con 0x7f24ec14ffc0 2024-08-17T02:29:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.035+0000 7f24e3e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24ec0c0f50 0x7f24ec14fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.035+0000 7f24e3e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24ec0c0f50 0x7f24ec14fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44470/0 (socket says 172.21.15.6:44470) 2024-08-17T02:29:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.035+0000 7f24e3e00640 1 -- 172.21.15.6:0/2492430182 learned_addr learned my addr 172.21.15.6:0/2492430182 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.035+0000 7f24ebe00640 1 --2- 172.21.15.6:0/2492430182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24d0005130 0x7f24ec0c0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.035+0000 7f24f0c00640 1 --2- 172.21.15.6:0/2492430182 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24ec14ffc0 0x7f24ec15a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.036+0000 7f24e3e00640 1 -- 172.21.15.6:0/2492430182 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24ec14ffc0 msgr2=0x7f24ec15a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.036+0000 7f24e3e00640 1 --2- 172.21.15.6:0/2492430182 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24ec14ffc0 0x7f24ec15a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.036+0000 7f24e3e00640 1 -- 172.21.15.6:0/2492430182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24d0005130 msgr2=0x7f24ec0c0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.036+0000 7f24e3e00640 1 --2- 172.21.15.6:0/2492430182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24d0005130 0x7f24ec0c0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.036+0000 7f24e3e00640 1 -- 172.21.15.6:0/2492430182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec15b970 con 0x7f24ec0c0f50 2024-08-17T02:29:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.036+0000 7f24ebe00640 1 --2- 172.21.15.6:0/2492430182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24d0005130 0x7f24ec0c0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.036+0000 7f24e3e00640 1 --2- 172.21.15.6:0/2492430182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24ec0c0f50 0x7f24ec14fa80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f24d40028c0 tx=0x7f24d4007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.036+0000 7f24e3400640 1 -- 172.21.15.6:0/2492430182 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d400f7b0 con 0x7f24ec0c0f50 2024-08-17T02:29:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.036+0000 7f24e3400640 1 -- 172.21.15.6:0/2492430182 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d400f910 con 0x7f24ec0c0f50 2024-08-17T02:29:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.036+0000 7f24e3400640 1 -- 172.21.15.6:0/2492430182 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d400fcb0 con 0x7f24ec0c0f50 2024-08-17T02:29:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.036+0000 7f24f2c00640 1 -- 172.21.15.6:0/2492430182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ec15bc50 con 0x7f24ec0c0f50 2024-08-17T02:29:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.036+0000 7f24f2c00640 1 -- 172.21.15.6:0/2492430182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ec15aea0 con 0x7f24ec0c0f50 2024-08-17T02:29:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.038+0000 7f24f2c00640 1 -- 172.21.15.6:0/2492430182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24ec167220 con 0x7f24ec0c0f50 2024-08-17T02:29:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.038+0000 7f24e3400640 1 -- 172.21.15.6:0/2492430182 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f24d4013600 con 0x7f24ec0c0f50 2024-08-17T02:29:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.039+0000 7f24e3400640 1 --2- 172.21.15.6:0/2492430182 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f24c8065150 0x7f24c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.039+0000 7f24e3400640 1 -- 172.21.15.6:0/2492430182 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f24d4082a70 con 0x7f24ec0c0f50 2024-08-17T02:29:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.040+0000 7f24ebe00640 1 --2- 172.21.15.6:0/2492430182 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f24c8065150 0x7f24c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.040+0000 7f24ebe00640 1 --2- 172.21.15.6:0/2492430182 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f24c8065150 0x7f24c8067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f24dc001050 tx=0x7f24dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.043+0000 7f24e3400640 1 -- 172.21.15.6:0/2492430182 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f24ec167220 con 0x7f24ec0c0f50 2024-08-17T02:29:39.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.223+0000 7f24f2c00640 1 -- 172.21.15.6:0/2492430182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000329200.data", "var": "pg_num"} v 0) v1 -- 0x7f24ec063fb0 con 0x7f24ec0c0f50 2024-08-17T02:29:39.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.224+0000 7f24e3400640 1 -- 172.21.15.6:0/2492430182 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000329200.data", "var": "pg_num"}]=0 v37) v1 ==== 124+0+11 (secure 0 0 0) 0x7f24d4050710 con 0x7f24ec0c0f50 2024-08-17T02:29:39.225 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-08-17T02:29:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.226+0000 7f24f2c00640 1 -- 172.21.15.6:0/2492430182 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f24c8065150 msgr2=0x7f24c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.226+0000 7f24f2c00640 1 --2- 172.21.15.6:0/2492430182 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f24c8065150 0x7f24c8067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f24dc001050 tx=0x7f24dc009040 comp rx=0 tx=0).stop 2024-08-17T02:29:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.226+0000 7f24f2c00640 1 -- 172.21.15.6:0/2492430182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24ec0c0f50 msgr2=0x7f24ec14fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.226+0000 7f24f2c00640 1 --2- 172.21.15.6:0/2492430182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24ec0c0f50 0x7f24ec14fa80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f24d40028c0 tx=0x7f24d4007ca0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.226+0000 7f24f2c00640 1 -- 172.21.15.6:0/2492430182 shutdown_connections 2024-08-17T02:29:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.226+0000 7f24f2c00640 1 --2- 172.21.15.6:0/2492430182 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f24c8065150 0x7f24c8067600 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.226+0000 7f24f2c00640 1 --2- 172.21.15.6:0/2492430182 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24ec14ffc0 0x7f24ec15a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.226+0000 7f24f2c00640 1 --2- 172.21.15.6:0/2492430182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24ec0c0f50 0x7f24ec14fa80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.226+0000 7f24f2c00640 1 --2- 172.21.15.6:0/2492430182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24d0005130 0x7f24ec0c0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.226+0000 7f24f2c00640 1 -- 172.21.15.6:0/2492430182 >> 172.21.15.6:0/2492430182 conn(0x7f24ec066e60 msgr2=0x7f24ec06a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.226+0000 7f24f2c00640 1 -- 172.21.15.6:0/2492430182 shutdown_connections 2024-08-17T02:29:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.226+0000 7f24f2c00640 1 -- 172.21.15.6:0/2492430182 wait complete. 2024-08-17T02:29:39.243 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:39.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.394+0000 7f4881c00640 1 Processor -- start 2024-08-17T02:29:39.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.394+0000 7f4881c00640 1 -- start start 2024-08-17T02:29:39.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.395+0000 7f4881c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f487c15a490 0x7f487c0ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.395+0000 7f4881c00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f487c0b1920 0x7f487c0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.395+0000 7f4881c00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c15a880 con 0x7f487c158c60 2024-08-17T02:29:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.395+0000 7f4881c00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487c0b0540 con 0x7f487c0b1920 2024-08-17T02:29:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.395+0000 7f4881c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c15b6b0 con 0x7f487c15a490 2024-08-17T02:29:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.395+0000 7f4881200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f487c0b1920 0x7f487c0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.395+0000 7f4881200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f487c0b1920 0x7f487c0b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44474/0 (socket says 172.21.15.6:44474) 2024-08-17T02:29:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.395+0000 7f4881200640 1 -- 172.21.15.6:0/43357981 learned_addr learned my addr 172.21.15.6:0/43357981 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.395+0000 7f4873e00640 1 --2- 172.21.15.6:0/43357981 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f487c15a490 0x7f487c0ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.396+0000 7f4881200640 1 -- 172.21.15.6:0/43357981 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f487c15a490 msgr2=0x7f487c0ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.396+0000 7f4881200640 1 --2- 172.21.15.6:0/43357981 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f487c15a490 0x7f487c0ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.396+0000 7f4881200640 1 -- 172.21.15.6:0/43357981 >> v1:172.21.15.136:6789/0 conn(0x7f487c158c60 legacy=0x7f487c159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.396+0000 7f4881200640 1 -- 172.21.15.6:0/43357981 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c15aac0 con 0x7f487c0b1920 2024-08-17T02:29:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.397+0000 7f4881200640 1 --2- 172.21.15.6:0/43357981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c0b1920 0x7f487c0b1d60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4874009f20 tx=0x7f4874009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c324b5463176918 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.397+0000 7f487b400640 1 -- 172.21.15.6:0/43357981 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4874031400 con 0x7f487c0b1920 2024-08-17T02:29:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.397+0000 7f487b400640 1 -- 172.21.15.6:0/43357981 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487402d050 con 0x7f487c0b1920 2024-08-17T02:29:39.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.397+0000 7f487b400640 1 -- 172.21.15.6:0/43357981 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48740317d0 con 0x7f487c0b1920 2024-08-17T02:29:39.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.397+0000 7f4881c00640 1 -- 172.21.15.6:0/43357981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c0b1920 msgr2=0x7f487c0b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.397+0000 7f4881c00640 1 --2- 172.21.15.6:0/43357981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c0b1920 0x7f487c0b1d60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4874009f20 tx=0x7f4874009840 comp rx=0 tx=0).stop 2024-08-17T02:29:39.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.398+0000 7f4881c00640 1 -- 172.21.15.6:0/43357981 shutdown_connections 2024-08-17T02:29:39.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.398+0000 7f4881c00640 1 --2- 172.21.15.6:0/43357981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c0b1920 0x7f487c0b1d60 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.398+0000 7f4881c00640 1 --2- 172.21.15.6:0/43357981 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f487c15a490 0x7f487c0ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.398+0000 7f4881c00640 1 -- 172.21.15.6:0/43357981 >> 172.21.15.6:0/43357981 conn(0x7f487c06e590 msgr2=0x7f487c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:39.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.398+0000 7f4881c00640 1 -- 172.21.15.6:0/43357981 shutdown_connections 2024-08-17T02:29:39.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.398+0000 7f4881c00640 1 -- 172.21.15.6:0/43357981 wait complete. 2024-08-17T02:29:39.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.399+0000 7f4881c00640 1 Processor -- start 2024-08-17T02:29:39.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.399+0000 7f4881c00640 1 -- start start 2024-08-17T02:29:39.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.400+0000 7f4881c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f487c0b1920 0x7f487c0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.400+0000 7f4881c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c158c60 0x7f487c0ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.400+0000 7f4881c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f487c15a490 0x7f487c0c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.400+0000 7f4881c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0c3610 con 0x7f487c158c60 2024-08-17T02:29:39.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.400+0000 7f4881c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0cedd0 con 0x7f487c0b1920 2024-08-17T02:29:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.400+0000 7f4881c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c169120 con 0x7f487c15a490 2024-08-17T02:29:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.400+0000 7f4873e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c158c60 0x7f487c0ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.400+0000 7f4873e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c158c60 0x7f487c0ce890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44486/0 (socket says 172.21.15.6:44486) 2024-08-17T02:29:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.400+0000 7f4873e00640 1 -- 172.21.15.6:0/3489138279 learned_addr learned my addr 172.21.15.6:0/3489138279 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.400+0000 7f4881200640 1 --2- 172.21.15.6:0/3489138279 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f487c15a490 0x7f487c0c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.400+0000 7f487be00640 1 --2- 172.21.15.6:0/3489138279 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f487c0b1920 0x7f487c0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.401+0000 7f4873e00640 1 -- 172.21.15.6:0/3489138279 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f487c15a490 msgr2=0x7f487c0c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.401+0000 7f4873e00640 1 --2- 172.21.15.6:0/3489138279 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f487c15a490 0x7f487c0c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.401+0000 7f4873e00640 1 -- 172.21.15.6:0/3489138279 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f487c0b1920 msgr2=0x7f487c0cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.401+0000 7f4873e00640 1 --2- 172.21.15.6:0/3489138279 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f487c0b1920 0x7f487c0cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.401+0000 7f4873e00640 1 -- 172.21.15.6:0/3489138279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4874009ae0 con 0x7f487c158c60 2024-08-17T02:29:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.401+0000 7f4873e00640 1 --2- 172.21.15.6:0/3489138279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c158c60 0x7f487c0ce890 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f486400d890 tx=0x7f4864008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.401+0000 7f4873400640 1 -- 172.21.15.6:0/3489138279 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486400de20 con 0x7f487c158c60 2024-08-17T02:29:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.401+0000 7f4873400640 1 -- 172.21.15.6:0/3489138279 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48640098b0 con 0x7f487c158c60 2024-08-17T02:29:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.401+0000 7f4873400640 1 -- 172.21.15.6:0/3489138279 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4864009c50 con 0x7f487c158c60 2024-08-17T02:29:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.401+0000 7f4881c00640 1 -- 172.21.15.6:0/3489138279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487c169400 con 0x7f487c158c60 2024-08-17T02:29:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.401+0000 7f4881c00640 1 -- 172.21.15.6:0/3489138279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c1699c0 con 0x7f487c158c60 2024-08-17T02:29:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.402+0000 7f4881c00640 1 -- 172.21.15.6:0/3489138279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c070720 con 0x7f487c158c60 2024-08-17T02:29:39.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.403+0000 7f4873400640 1 -- 172.21.15.6:0/3489138279 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4864014620 con 0x7f487c158c60 2024-08-17T02:29:39.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.404+0000 7f4873400640 1 --2- 172.21.15.6:0/3489138279 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4858065150 0x7f4858067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.404+0000 7f4873400640 1 -- 172.21.15.6:0/3489138279 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f4864083070 con 0x7f487c158c60 2024-08-17T02:29:39.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.405+0000 7f487be00640 1 --2- 172.21.15.6:0/3489138279 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4858065150 0x7f4858067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.405+0000 7f487be00640 1 --2- 172.21.15.6:0/3489138279 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4858065150 0x7f4858067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f487c0b1050 tx=0x7f486c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.408+0000 7f4873400640 1 -- 172.21.15.6:0/3489138279 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f48640b4e40 con 0x7f487c158c60 2024-08-17T02:29:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.636+0000 7f4881c00640 1 -- 172.21.15.6:0/3489138279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f487c0cd030 con 0x7f487c158c60 2024-08-17T02:29:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.637+0000 7f4873400640 1 -- 172.21.15.6:0/3489138279 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5681 (secure 0 0 0) 0x7f4864050dc0 con 0x7f487c158c60 2024-08-17T02:29:39.638 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:39.638 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/4280185456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":4280185456},{"type":"v1","addr":"172.21.15.136:6836","nonce":4280185456}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2517061869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":2517061869},{"type":"v1","addr":"172.21.15.136:6837","nonce":2517061869}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:21.208240+0000","modified":"2024-08-17T02:27:24.818513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/285178879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":285178879},{"type":"v1","addr":"172.21.15.6:6835","nonce":285178879}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:33.919463+0000","modified":"2024-08-17T02:27:35.926590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4935":{"gid":4935,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.6:6834/2620799775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2620799775},{"type":"v1","addr":"172.21.15.6:6834","nonce":2620799775}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000329200","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:39.638 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 19 2024-08-17T02:29:39.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.639+0000 7f4881c00640 1 -- 172.21.15.6:0/3489138279 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4858065150 msgr2=0x7f4858067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.639+0000 7f4881c00640 1 --2- 172.21.15.6:0/3489138279 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4858065150 0x7f4858067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f487c0b1050 tx=0x7f486c009040 comp rx=0 tx=0).stop 2024-08-17T02:29:39.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.639+0000 7f4881c00640 1 -- 172.21.15.6:0/3489138279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c158c60 msgr2=0x7f487c0ce890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.639+0000 7f4881c00640 1 --2- 172.21.15.6:0/3489138279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c158c60 0x7f487c0ce890 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f486400d890 tx=0x7f4864008040 comp rx=0 tx=0).stop 2024-08-17T02:29:39.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.639+0000 7f4881c00640 1 -- 172.21.15.6:0/3489138279 shutdown_connections 2024-08-17T02:29:39.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.639+0000 7f4881c00640 1 --2- 172.21.15.6:0/3489138279 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4858065150 0x7f4858067600 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.639+0000 7f4881c00640 1 --2- 172.21.15.6:0/3489138279 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f487c15a490 0x7f487c0c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.639+0000 7f4881c00640 1 --2- 172.21.15.6:0/3489138279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c158c60 0x7f487c0ce890 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.639+0000 7f4881c00640 1 --2- 172.21.15.6:0/3489138279 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f487c0b1920 0x7f487c0cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.639+0000 7f4881c00640 1 -- 172.21.15.6:0/3489138279 >> 172.21.15.6:0/3489138279 conn(0x7f487c06e590 msgr2=0x7f487c0b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:39.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.639+0000 7f4881c00640 1 -- 172.21.15.6:0/3489138279 shutdown_connections 2024-08-17T02:29:39.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.639+0000 7f4881c00640 1 -- 172.21.15.6:0/3489138279 wait complete. 2024-08-17T02:29:39.655 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:39.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.806+0000 7f0c00200640 1 Processor -- start 2024-08-17T02:29:39.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.806+0000 7f0c00200640 1 -- start start 2024-08-17T02:29:39.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.807+0000 7f0c00200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0bf80ad960 0x7f0bf815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.807+0000 7f0c00200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0bf80ca050 0x7f0bf8156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.807+0000 7f0c00200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf815b5e0 con 0x7f0bf80add30 2024-08-17T02:29:39.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.807+0000 7f0c00200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf80cb160 con 0x7f0bf80ad960 2024-08-17T02:29:39.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.807+0000 7f0c00200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf80b0d10 con 0x7f0bf80ca050 2024-08-17T02:29:39.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.807+0000 7f0bfe200640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0bf80add30 0x7f0bf8156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37230/0 (socket says 172.21.15.6:37230) 2024-08-17T02:29:39.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.807+0000 7f0bfe200640 1 -- 172.21.15.6:0/1003522449 learned_addr learned my addr 172.21.15.6:0/1003522449 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:39.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.807+0000 7f0bfd800640 1 --2- 172.21.15.6:0/1003522449 >> v2:172.21.15.6:3300/0 conn(0x7f0bf80ad960 0x7f0bf815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.808+0000 7f0bfce00640 1 --2- 172.21.15.6:0/1003522449 >> v2:172.21.15.136:3300/0 conn(0x7f0bf80ca050 0x7f0bf8156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.808+0000 7f0bfd800640 1 -- 172.21.15.6:0/1003522449 >> v2:172.21.15.136:3300/0 conn(0x7f0bf80ca050 msgr2=0x7f0bf8156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:39.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.808+0000 7f0bfd800640 1 --2- 172.21.15.6:0/1003522449 >> v2:172.21.15.136:3300/0 conn(0x7f0bf80ca050 0x7f0bf8156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.808+0000 7f0bfd800640 1 -- 172.21.15.6:0/1003522449 >> v1:172.21.15.6:6789/0 conn(0x7f0bf80add30 legacy=0x7f0bf8156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.808+0000 7f0bfd800640 1 -- 172.21.15.6:0/1003522449 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf80ca550 con 0x7f0bf80ad960 2024-08-17T02:29:39.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.808+0000 7f0bf7e00640 1 -- 172.21.15.6:0/1003522449 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195344685 0 0) 0x7f0bf0001490 con 0x7f0bf80add30 2024-08-17T02:29:39.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.808+0000 7f0bfce00640 1 --2- 172.21.15.6:0/1003522449 >> v2:172.21.15.136:3300/0 conn(0x7f0bf80ca050 0x7f0bf8156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:39.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.809+0000 7f0bfd800640 1 --2- 172.21.15.6:0/1003522449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf80ad960 0x7f0bf815b0a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8063600 tx=0x7f0bec0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3539367fa9988c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.809+0000 7f0bf7e00640 1 -- 172.21.15.6:0/1003522449 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec02ae40 con 0x7f0bf80ad960 2024-08-17T02:29:39.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.809+0000 7f0bf7e00640 1 -- 172.21.15.6:0/1003522449 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bec032440 con 0x7f0bf80ad960 2024-08-17T02:29:39.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.809+0000 7f0bf7e00640 1 -- 172.21.15.6:0/1003522449 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec0327e0 con 0x7f0bf80ad960 2024-08-17T02:29:39.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.810+0000 7f0c00200640 1 -- 172.21.15.6:0/1003522449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf80ad960 msgr2=0x7f0bf815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.810+0000 7f0c00200640 1 --2- 172.21.15.6:0/1003522449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf80ad960 0x7f0bf815b0a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8063600 tx=0x7f0bec0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.810+0000 7f0c00200640 1 -- 172.21.15.6:0/1003522449 shutdown_connections 2024-08-17T02:29:39.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.810+0000 7f0c00200640 1 --2- 172.21.15.6:0/1003522449 >> v2:172.21.15.136:3300/0 conn(0x7f0bf80ca050 0x7f0bf8156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.810+0000 7f0c00200640 1 --2- 172.21.15.6:0/1003522449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf80ad960 0x7f0bf815b0a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.810+0000 7f0c00200640 1 -- 172.21.15.6:0/1003522449 >> 172.21.15.6:0/1003522449 conn(0x7f0bf8066e60 msgr2=0x7f0bf8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:39.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.810+0000 7f0c00200640 1 -- 172.21.15.6:0/1003522449 shutdown_connections 2024-08-17T02:29:39.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.810+0000 7f0c00200640 1 -- 172.21.15.6:0/1003522449 wait complete. 2024-08-17T02:29:39.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.811+0000 7f0c00200640 1 Processor -- start 2024-08-17T02:29:39.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.812+0000 7f0c00200640 1 -- start start 2024-08-17T02:29:39.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.812+0000 7f0c00200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bf80ad960 0x7f0bf8157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.812+0000 7f0c00200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf80add30 0x7f0bf80acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.812+0000 7f0c00200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bf80ca050 0x7f0bf8159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.812+0000 7f0c00200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80abce0 con 0x7f0bf80add30 2024-08-17T02:29:39.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.812+0000 7f0c00200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80abfc0 con 0x7f0bf80ca050 2024-08-17T02:29:39.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.812+0000 7f0c00200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80ac2a0 con 0x7f0bf80ad960 2024-08-17T02:29:39.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.813+0000 7f0bfce00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf80add30 0x7f0bf80acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.813+0000 7f0bfce00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf80add30 0x7f0bf80acd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44504/0 (socket says 172.21.15.6:44504) 2024-08-17T02:29:39.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.813+0000 7f0bfce00640 1 -- 172.21.15.6:0/1089100865 learned_addr learned my addr 172.21.15.6:0/1089100865 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:39.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.813+0000 7f0bfe200640 1 --2- 172.21.15.6:0/1089100865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bf80ca050 0x7f0bf8159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.813+0000 7f0bfd800640 1 --2- 172.21.15.6:0/1089100865 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bf80ad960 0x7f0bf8157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.813+0000 7f0bfce00640 1 -- 172.21.15.6:0/1089100865 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bf80ad960 msgr2=0x7f0bf8157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.813+0000 7f0bfce00640 1 --2- 172.21.15.6:0/1089100865 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bf80ad960 0x7f0bf8157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.813+0000 7f0bfce00640 1 -- 172.21.15.6:0/1089100865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bf80ca050 msgr2=0x7f0bf8159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.813+0000 7f0bfce00640 1 --2- 172.21.15.6:0/1089100865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bf80ca050 0x7f0bf8159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.813+0000 7f0bfce00640 1 -- 172.21.15.6:0/1089100865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec009390 con 0x7f0bf80add30 2024-08-17T02:29:39.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.813+0000 7f0bfce00640 1 --2- 172.21.15.6:0/1089100865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf80add30 0x7f0bf80acd80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0be400c880 tx=0x7f0be4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.814+0000 7f0bf4c00640 1 -- 172.21.15.6:0/1089100865 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be400ce10 con 0x7f0bf80add30 2024-08-17T02:29:39.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.814+0000 7f0bf4c00640 1 -- 172.21.15.6:0/1089100865 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be4007890 con 0x7f0bf80add30 2024-08-17T02:29:39.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.814+0000 7f0bf4c00640 1 -- 172.21.15.6:0/1089100865 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4007c10 con 0x7f0bf80add30 2024-08-17T02:29:39.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.814+0000 7f0c00200640 1 -- 172.21.15.6:0/1089100865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf80ac580 con 0x7f0bf80add30 2024-08-17T02:29:39.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.814+0000 7f0c00200640 1 -- 172.21.15.6:0/1089100865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf80ab900 con 0x7f0bf80add30 2024-08-17T02:29:39.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.815+0000 7f0c00200640 1 -- 172.21.15.6:0/1089100865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf80aca80 con 0x7f0bf80add30 2024-08-17T02:29:39.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.816+0000 7f0bf4c00640 1 -- 172.21.15.6:0/1089100865 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0be40113f0 con 0x7f0bf80add30 2024-08-17T02:29:39.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.816+0000 7f0bf4c00640 1 --2- 172.21.15.6:0/1089100865 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0bd8065150 0x7f0bd8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.816+0000 7f0bf4c00640 1 -- 172.21.15.6:0/1089100865 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f0be4082780 con 0x7f0bf80add30 2024-08-17T02:29:39.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.817+0000 7f0bfd800640 1 --2- 172.21.15.6:0/1089100865 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0bd8065150 0x7f0bd8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.818+0000 7f0bfd800640 1 --2- 172.21.15.6:0/1089100865 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0bd8065150 0x7f0bd8067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0bec034000 tx=0x7f0bec032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:39.820+0000 7f0bf4c00640 1 -- 172.21.15.6:0/1089100865 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0be4053f60 con 0x7f0bf80add30 2024-08-17T02:29:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.002+0000 7f0c00200640 1 -- 172.21.15.6:0/1089100865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bf8063fb0 con 0x7f0bf80add30 2024-08-17T02:29:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.003+0000 7f0bf4c00640 1 -- 172.21.15.6:0/1089100865 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18551 (secure 0 0 0) 0x7f0be4053af0 con 0x7f0bf80add30 2024-08-17T02:29:40.004 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:40.004 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":37,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:27:35.934220+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:19.345254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:20.195251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000329200.meta","create_time":"2024-08-17T02:27:32.084585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000329200"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000329200.data","create_time":"2024-08-17T02:27:32.953304+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000329200"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.005+0000 7f0c00200640 1 -- 172.21.15.6:0/1089100865 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0bd8065150 msgr2=0x7f0bd8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.005+0000 7f0c00200640 1 --2- 172.21.15.6:0/1089100865 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0bd8065150 0x7f0bd8067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0bec034000 tx=0x7f0bec032000 comp rx=0 tx=0).stop 2024-08-17T02:29:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.005+0000 7f0c00200640 1 -- 172.21.15.6:0/1089100865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf80add30 msgr2=0x7f0bf80acd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.005+0000 7f0c00200640 1 --2- 172.21.15.6:0/1089100865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf80add30 0x7f0bf80acd80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0be400c880 tx=0x7f0be4008040 comp rx=0 tx=0).stop 2024-08-17T02:29:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.005+0000 7f0c00200640 1 -- 172.21.15.6:0/1089100865 shutdown_connections 2024-08-17T02:29:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.005+0000 7f0c00200640 1 --2- 172.21.15.6:0/1089100865 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0bd8065150 0x7f0bd8067600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.005+0000 7f0c00200640 1 --2- 172.21.15.6:0/1089100865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bf80ca050 0x7f0bf8159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.005+0000 7f0c00200640 1 --2- 172.21.15.6:0/1089100865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf80add30 0x7f0bf80acd80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.005+0000 7f0c00200640 1 --2- 172.21.15.6:0/1089100865 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bf80ad960 0x7f0bf8157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.005+0000 7f0c00200640 1 -- 172.21.15.6:0/1089100865 >> 172.21.15.6:0/1089100865 conn(0x7f0bf8066e60 msgr2=0x7f0bf8154150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.005+0000 7f0c00200640 1 -- 172.21.15.6:0/1089100865 shutdown_connections 2024-08-17T02:29:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.005+0000 7f0c00200640 1 -- 172.21.15.6:0/1089100865 wait complete. 2024-08-17T02:29:40.021 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:29:40.021 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:40.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.171+0000 7f6683400640 1 Processor -- start 2024-08-17T02:29:40.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.171+0000 7f6683400640 1 -- start start 2024-08-17T02:29:40.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.172+0000 7f6683400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f667c155040 0x7f667c158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.172+0000 7f6683400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f667c1591c0 0x7f667c06e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.172+0000 7f6683400640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c0aeeb0 con 0x7f667c06e5a0 2024-08-17T02:29:40.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.172+0000 7f6683400640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c159610 con 0x7f667c1591c0 2024-08-17T02:29:40.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.172+0000 7f6683400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c0aadd0 con 0x7f667c155040 2024-08-17T02:29:40.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.172+0000 7f667be00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f667c1591c0 0x7f667c06e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.173+0000 7f667be00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f667c1591c0 0x7f667c06e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44508/0 (socket says 172.21.15.6:44508) 2024-08-17T02:29:40.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.173+0000 7f667be00640 1 -- 172.21.15.6:0/4287226175 learned_addr learned my addr 172.21.15.6:0/4287226175 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:40.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.173+0000 7f6680a00640 1 --2- 172.21.15.6:0/4287226175 >> v2:172.21.15.136:3300/0 conn(0x7f667c155040 0x7f667c158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.173+0000 7f667be00640 1 -- 172.21.15.6:0/4287226175 >> v2:172.21.15.136:3300/0 conn(0x7f667c155040 msgr2=0x7f667c158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:40.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.173+0000 7f667be00640 1 --2- 172.21.15.6:0/4287226175 >> v2:172.21.15.136:3300/0 conn(0x7f667c155040 0x7f667c158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.173+0000 7f667be00640 1 -- 172.21.15.6:0/4287226175 >> v1:172.21.15.136:6789/0 conn(0x7f667c06e5a0 legacy=0x7f667c0ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.173+0000 7f667be00640 1 -- 172.21.15.6:0/4287226175 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c06e9c0 con 0x7f667c1591c0 2024-08-17T02:29:40.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.174+0000 7f667be00640 1 --2- 172.21.15.6:0/4287226175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f667c1591c0 0x7f667c06e060 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f667c06c660 tx=0x7f66680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fdf5cdf63188fa2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.174+0000 7f667b400640 1 -- 172.21.15.6:0/4287226175 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666802ad40 con 0x7f667c1591c0 2024-08-17T02:29:40.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.174+0000 7f667b400640 1 -- 172.21.15.6:0/4287226175 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6668032440 con 0x7f667c1591c0 2024-08-17T02:29:40.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.174+0000 7f667b400640 1 -- 172.21.15.6:0/4287226175 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666802aea0 con 0x7f667c1591c0 2024-08-17T02:29:40.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.175+0000 7f6683400640 1 -- 172.21.15.6:0/4287226175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f667c1591c0 msgr2=0x7f667c06e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.175+0000 7f6683400640 1 --2- 172.21.15.6:0/4287226175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f667c1591c0 0x7f667c06e060 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f667c06c660 tx=0x7f66680091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.175+0000 7f6683400640 1 -- 172.21.15.6:0/4287226175 shutdown_connections 2024-08-17T02:29:40.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.175+0000 7f6683400640 1 --2- 172.21.15.6:0/4287226175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f667c1591c0 0x7f667c06e060 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.175+0000 7f6683400640 1 --2- 172.21.15.6:0/4287226175 >> v2:172.21.15.136:3300/0 conn(0x7f667c155040 0x7f667c158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.175+0000 7f6683400640 1 -- 172.21.15.6:0/4287226175 >> 172.21.15.6:0/4287226175 conn(0x7f667c066e60 msgr2=0x7f667c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:40.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.175+0000 7f6683400640 1 -- 172.21.15.6:0/4287226175 shutdown_connections 2024-08-17T02:29:40.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.175+0000 7f6683400640 1 -- 172.21.15.6:0/4287226175 wait complete. 2024-08-17T02:29:40.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.177+0000 7f6683400640 1 Processor -- start 2024-08-17T02:29:40.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.177+0000 7f6683400640 1 -- start start 2024-08-17T02:29:40.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.177+0000 7f6683400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f667c06e5a0 0x7f667c156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.177+0000 7f6683400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f667c155040 0x7f667c14f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.178+0000 7f6683400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f667c1591c0 0x7f667c14f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.178+0000 7f6683400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c14ff30 con 0x7f667c1591c0 2024-08-17T02:29:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.178+0000 7f6683400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c156750 con 0x7f667c06e5a0 2024-08-17T02:29:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.178+0000 7f6683400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c157660 con 0x7f667c155040 2024-08-17T02:29:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.178+0000 7f6681400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f667c1591c0 0x7f667c14f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.178+0000 7f6681400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f667c1591c0 0x7f667c14f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44512/0 (socket says 172.21.15.6:44512) 2024-08-17T02:29:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.178+0000 7f6681400640 1 -- 172.21.15.6:0/561424420 learned_addr learned my addr 172.21.15.6:0/561424420 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.178+0000 7f6680a00640 1 --2- 172.21.15.6:0/561424420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f667c06e5a0 0x7f667c156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.178+0000 7f667be00640 1 --2- 172.21.15.6:0/561424420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f667c155040 0x7f667c14f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.178+0000 7f6681400640 1 -- 172.21.15.6:0/561424420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f667c155040 msgr2=0x7f667c14f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.178+0000 7f6681400640 1 --2- 172.21.15.6:0/561424420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f667c155040 0x7f667c14f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.178+0000 7f6681400640 1 -- 172.21.15.6:0/561424420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f667c06e5a0 msgr2=0x7f667c156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.178+0000 7f6681400640 1 --2- 172.21.15.6:0/561424420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f667c06e5a0 0x7f667c156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.178+0000 7f6681400640 1 -- 172.21.15.6:0/561424420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6668009450 con 0x7f667c1591c0 2024-08-17T02:29:40.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.179+0000 7f6681400640 1 --2- 172.21.15.6:0/561424420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f667c1591c0 0x7f667c14f9f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f667400c860 tx=0x7f6674001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.179+0000 7f666fe00640 1 -- 172.21.15.6:0/561424420 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667400ce50 con 0x7f667c1591c0 2024-08-17T02:29:40.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.179+0000 7f666fe00640 1 -- 172.21.15.6:0/561424420 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667400a850 con 0x7f667c1591c0 2024-08-17T02:29:40.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.179+0000 7f6683400640 1 -- 172.21.15.6:0/561424420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667c155e20 con 0x7f667c1591c0 2024-08-17T02:29:40.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.179+0000 7f666fe00640 1 -- 172.21.15.6:0/561424420 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667400ac10 con 0x7f667c1591c0 2024-08-17T02:29:40.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.179+0000 7f6683400640 1 -- 172.21.15.6:0/561424420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c1563e0 con 0x7f667c1591c0 2024-08-17T02:29:40.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.180+0000 7f6683400640 1 -- 172.21.15.6:0/561424420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667c1568e0 con 0x7f667c1591c0 2024-08-17T02:29:40.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.181+0000 7f666fe00640 1 -- 172.21.15.6:0/561424420 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6674012630 con 0x7f667c1591c0 2024-08-17T02:29:40.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.182+0000 7f666fe00640 1 --2- 172.21.15.6:0/561424420 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f665c065150 0x7f665c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.182+0000 7f666fe00640 1 -- 172.21.15.6:0/561424420 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6674082960 con 0x7f667c1591c0 2024-08-17T02:29:40.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.182+0000 7f6680a00640 1 --2- 172.21.15.6:0/561424420 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f665c065150 0x7f665c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.183+0000 7f6680a00640 1 --2- 172.21.15.6:0/561424420 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f665c065150 0x7f665c067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f667c153610 tx=0x7f66700090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.186+0000 7f666fe00640 1 -- 172.21.15.6:0/561424420 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f66740506b0 con 0x7f667c1591c0 2024-08-17T02:29:40.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.412+0000 7f6683400640 1 -- 172.21.15.6:0/561424420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f667c063fb0 con 0x7f667c1591c0 2024-08-17T02:29:40.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.412+0000 7f666fe00640 1 -- 172.21.15.6:0/561424420 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5681 (secure 0 0 0) 0x7f6674053cd0 con 0x7f667c1591c0 2024-08-17T02:29:40.413 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:40.413 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/4280185456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":4280185456},{"type":"v1","addr":"172.21.15.136:6836","nonce":4280185456}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2517061869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":2517061869},{"type":"v1","addr":"172.21.15.136:6837","nonce":2517061869}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:21.208240+0000","modified":"2024-08-17T02:27:24.818513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/285178879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":285178879},{"type":"v1","addr":"172.21.15.6:6835","nonce":285178879}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:33.919463+0000","modified":"2024-08-17T02:27:35.926590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4935":{"gid":4935,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.6:6834/2620799775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2620799775},{"type":"v1","addr":"172.21.15.6:6834","nonce":2620799775}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000329200","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:40.413 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 19 2024-08-17T02:29:40.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.414+0000 7f6683400640 1 -- 172.21.15.6:0/561424420 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f665c065150 msgr2=0x7f665c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.414+0000 7f6683400640 1 --2- 172.21.15.6:0/561424420 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f665c065150 0x7f665c067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f667c153610 tx=0x7f66700090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.415+0000 7f6683400640 1 -- 172.21.15.6:0/561424420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f667c1591c0 msgr2=0x7f667c14f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.415+0000 7f6683400640 1 --2- 172.21.15.6:0/561424420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f667c1591c0 0x7f667c14f9f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f667400c860 tx=0x7f6674001690 comp rx=0 tx=0).stop 2024-08-17T02:29:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.415+0000 7f6683400640 1 -- 172.21.15.6:0/561424420 shutdown_connections 2024-08-17T02:29:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.415+0000 7f6683400640 1 --2- 172.21.15.6:0/561424420 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f665c065150 0x7f665c067600 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.415+0000 7f6683400640 1 --2- 172.21.15.6:0/561424420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f667c1591c0 0x7f667c14f9f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.415+0000 7f6683400640 1 --2- 172.21.15.6:0/561424420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f667c155040 0x7f667c14f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.415+0000 7f6683400640 1 --2- 172.21.15.6:0/561424420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f667c06e5a0 0x7f667c156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.415+0000 7f6683400640 1 -- 172.21.15.6:0/561424420 >> 172.21.15.6:0/561424420 conn(0x7f667c066e60 msgr2=0x7f667c158650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.415+0000 7f6683400640 1 -- 172.21.15.6:0/561424420 shutdown_connections 2024-08-17T02:29:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.415+0000 7f6683400640 1 -- 172.21.15.6:0/561424420 wait complete. 2024-08-17T02:29:40.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:40.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.581+0000 7fadf0600640 1 Processor -- start 2024-08-17T02:29:40.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.581+0000 7fadf0600640 1 -- start start 2024-08-17T02:29:40.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.582+0000 7fadf0600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fade8159120 0x7fade80ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.582+0000 7fadf0600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fade80abe30 0x7fade80aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.582+0000 7fadf0600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade80a96c0 con 0x7fade8158d50 2024-08-17T02:29:40.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.582+0000 7fadf0600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade80acf00 con 0x7fade80abe30 2024-08-17T02:29:40.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.582+0000 7fadf0600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade80ac230 con 0x7fade8159120 2024-08-17T02:29:40.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.582+0000 7fadee600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fade80abe30 0x7fade80aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.582+0000 7fadee600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fade80abe30 0x7fade80aa3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44522/0 (socket says 172.21.15.6:44522) 2024-08-17T02:29:40.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.583+0000 7fadee600640 1 -- 172.21.15.6:0/2260983013 learned_addr learned my addr 172.21.15.6:0/2260983013 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:40.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.583+0000 7faded200640 1 --2- 172.21.15.6:0/2260983013 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fade8159120 0x7fade80ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.583+0000 7fadee600640 1 -- 172.21.15.6:0/2260983013 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fade8159120 msgr2=0x7fade80ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:40.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.583+0000 7fadee600640 1 --2- 172.21.15.6:0/2260983013 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fade8159120 0x7fade80ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.583+0000 7fadee600640 1 -- 172.21.15.6:0/2260983013 >> v1:172.21.15.136:6789/0 conn(0x7fade8158d50 legacy=0x7fade80ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.583+0000 7fadee600640 1 -- 172.21.15.6:0/2260983013 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade80af7d0 con 0x7fade80abe30 2024-08-17T02:29:40.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.584+0000 7fadee600640 1 --2- 172.21.15.6:0/2260983013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade80abe30 0x7fade80aa3d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fade0009f20 tx=0x7fade0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde385b69134bffe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.584+0000 7fade7e00640 1 -- 172.21.15.6:0/2260983013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0031400 con 0x7fade80abe30 2024-08-17T02:29:40.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.584+0000 7fade7e00640 1 -- 172.21.15.6:0/2260983013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade002d050 con 0x7fade80abe30 2024-08-17T02:29:40.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.584+0000 7fade7e00640 1 -- 172.21.15.6:0/2260983013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade00317d0 con 0x7fade80abe30 2024-08-17T02:29:40.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.585+0000 7fadf0600640 1 -- 172.21.15.6:0/2260983013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade80abe30 msgr2=0x7fade80aa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.585+0000 7fadf0600640 1 --2- 172.21.15.6:0/2260983013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade80abe30 0x7fade80aa3d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fade0009f20 tx=0x7fade0009840 comp rx=0 tx=0).stop 2024-08-17T02:29:40.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.585+0000 7fadf0600640 1 -- 172.21.15.6:0/2260983013 shutdown_connections 2024-08-17T02:29:40.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.585+0000 7fadf0600640 1 --2- 172.21.15.6:0/2260983013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade80abe30 0x7fade80aa3d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.585+0000 7fadf0600640 1 --2- 172.21.15.6:0/2260983013 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fade8159120 0x7fade80ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.585+0000 7fadf0600640 1 -- 172.21.15.6:0/2260983013 >> 172.21.15.6:0/2260983013 conn(0x7fade8095a70 msgr2=0x7fade8095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:40.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.585+0000 7fadf0600640 1 -- 172.21.15.6:0/2260983013 shutdown_connections 2024-08-17T02:29:40.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.585+0000 7fadf0600640 1 -- 172.21.15.6:0/2260983013 wait complete. 2024-08-17T02:29:40.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.586+0000 7fadf0600640 1 Processor -- start 2024-08-17T02:29:40.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.586+0000 7fadf0600640 1 -- start start 2024-08-17T02:29:40.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.587+0000 7fadf0600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade80abe30 0x7fade8151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.587+0000 7fadf0600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fade8158d50 0x7fade8154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.587+0000 7fadf0600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fade8159120 0x7fade8066e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.587+0000 7fadf0600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade815b8e0 con 0x7fade80abe30 2024-08-17T02:29:40.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.587+0000 7fadf0600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade816cc10 con 0x7fade8158d50 2024-08-17T02:29:40.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.587+0000 7fadf0600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade816cef0 con 0x7fade8159120 2024-08-17T02:29:40.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.587+0000 7fadedc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade80abe30 0x7fade8151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.588+0000 7fadedc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade80abe30 0x7fade8151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44538/0 (socket says 172.21.15.6:44538) 2024-08-17T02:29:40.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.588+0000 7fadedc00640 1 -- 172.21.15.6:0/1463042323 learned_addr learned my addr 172.21.15.6:0/1463042323 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:40.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.588+0000 7faded200640 1 --2- 172.21.15.6:0/1463042323 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fade8158d50 0x7fade8154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.588+0000 7fadee600640 1 --2- 172.21.15.6:0/1463042323 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fade8159120 0x7fade8066e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.588+0000 7fadedc00640 1 -- 172.21.15.6:0/1463042323 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fade8159120 msgr2=0x7fade8066e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.588+0000 7fadedc00640 1 --2- 172.21.15.6:0/1463042323 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fade8159120 0x7fade8066e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.588+0000 7fadedc00640 1 -- 172.21.15.6:0/1463042323 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fade8158d50 msgr2=0x7fade8154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.588+0000 7fadedc00640 1 --2- 172.21.15.6:0/1463042323 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fade8158d50 0x7fade8154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.588+0000 7fadedc00640 1 -- 172.21.15.6:0/1463042323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade0009ae0 con 0x7fade80abe30 2024-08-17T02:29:40.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.588+0000 7fadedc00640 1 --2- 172.21.15.6:0/1463042323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade80abe30 0x7fade8151ca0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7faddc00c560 tx=0x7faddc007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.588+0000 7fade4c00640 1 -- 172.21.15.6:0/1463042323 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc011590 con 0x7fade80abe30 2024-08-17T02:29:40.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.588+0000 7fadf0600640 1 -- 172.21.15.6:0/1463042323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade816d1d0 con 0x7fade80abe30 2024-08-17T02:29:40.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.588+0000 7fade4c00640 1 -- 172.21.15.6:0/1463042323 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faddc011710 con 0x7fade80abe30 2024-08-17T02:29:40.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.589+0000 7fade4c00640 1 -- 172.21.15.6:0/1463042323 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc011ad0 con 0x7fade80abe30 2024-08-17T02:29:40.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.589+0000 7fadf0600640 1 -- 172.21.15.6:0/1463042323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade81521e0 con 0x7fade80abe30 2024-08-17T02:29:40.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.590+0000 7fadf0600640 1 -- 172.21.15.6:0/1463042323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade8063fb0 con 0x7fade80abe30 2024-08-17T02:29:40.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.591+0000 7fade4c00640 1 -- 172.21.15.6:0/1463042323 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faddc01b3b0 con 0x7fade80abe30 2024-08-17T02:29:40.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.592+0000 7fade4c00640 1 --2- 172.21.15.6:0/1463042323 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fadc8065180 0x7fadc8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.592+0000 7fade4c00640 1 -- 172.21.15.6:0/1463042323 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7faddc081ce0 con 0x7fade80abe30 2024-08-17T02:29:40.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.592+0000 7faded200640 1 --2- 172.21.15.6:0/1463042323 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fadc8065180 0x7fadc8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.593+0000 7faded200640 1 --2- 172.21.15.6:0/1463042323 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fadc8065180 0x7fadc8067630 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fade80aa060 tx=0x7fadd40090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.596+0000 7fade4c00640 1 -- 172.21.15.6:0/1463042323 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faddc04fad0 con 0x7fade80abe30 2024-08-17T02:29:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.820+0000 7fadf0600640 1 -- 172.21.15.6:0/1463042323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fade80b28f0 con 0x7fade80abe30 2024-08-17T02:29:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.821+0000 7fade4c00640 1 -- 172.21.15.6:0/1463042323 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5681 (secure 0 0 0) 0x7faddc017070 con 0x7fade80abe30 2024-08-17T02:29:40.822 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:40.822 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/4280185456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":4280185456},{"type":"v1","addr":"172.21.15.136:6836","nonce":4280185456}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2517061869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":2517061869},{"type":"v1","addr":"172.21.15.136:6837","nonce":2517061869}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:21.208240+0000","modified":"2024-08-17T02:27:24.818513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/285178879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":285178879},{"type":"v1","addr":"172.21.15.6:6835","nonce":285178879}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:33.919463+0000","modified":"2024-08-17T02:27:35.926590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4935":{"gid":4935,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.6:6834/2620799775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2620799775},{"type":"v1","addr":"172.21.15.6:6834","nonce":2620799775}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000329200","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:40.822 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 19 2024-08-17T02:29:40.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.823+0000 7fadf0600640 1 -- 172.21.15.6:0/1463042323 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fadc8065180 msgr2=0x7fadc8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.823+0000 7fadf0600640 1 --2- 172.21.15.6:0/1463042323 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fadc8065180 0x7fadc8067630 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fade80aa060 tx=0x7fadd40090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.823+0000 7fadf0600640 1 -- 172.21.15.6:0/1463042323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade80abe30 msgr2=0x7fade8151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.823+0000 7fadf0600640 1 --2- 172.21.15.6:0/1463042323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade80abe30 0x7fade8151ca0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7faddc00c560 tx=0x7faddc007ef0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.823+0000 7fadf0600640 1 -- 172.21.15.6:0/1463042323 shutdown_connections 2024-08-17T02:29:40.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.823+0000 7fadf0600640 1 --2- 172.21.15.6:0/1463042323 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fadc8065180 0x7fadc8067630 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.823+0000 7fadf0600640 1 --2- 172.21.15.6:0/1463042323 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fade8159120 0x7fade8066e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.823+0000 7fadf0600640 1 --2- 172.21.15.6:0/1463042323 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fade8158d50 0x7fade8154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.823+0000 7fadf0600640 1 --2- 172.21.15.6:0/1463042323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade80abe30 0x7fade8151ca0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.823+0000 7fadf0600640 1 -- 172.21.15.6:0/1463042323 >> 172.21.15.6:0/1463042323 conn(0x7fade8095a70 msgr2=0x7fade80aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.823+0000 7fadf0600640 1 -- 172.21.15.6:0/1463042323 shutdown_connections 2024-08-17T02:29:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.823+0000 7fadf0600640 1 -- 172.21.15.6:0/1463042323 wait complete. 2024-08-17T02:29:40.839 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:40.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.990+0000 7f26e5200640 1 Processor -- start 2024-08-17T02:29:40.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.990+0000 7f26e5200640 1 -- start start 2024-08-17T02:29:40.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.991+0000 7f26e5200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f26e01590b0 0x7f26e00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.991+0000 7f26e5200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e00c92b0 con 0x7f26e00afca0 2024-08-17T02:29:40.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.991+0000 7f26e5200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e00ad480 con 0x7f26e00acf10 2024-08-17T02:29:40.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.991+0000 7f26e5200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00b0980 con 0x7f26e01590b0 2024-08-17T02:29:40.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.992+0000 7f26dde00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f26e00afca0 0x7f26e01589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37238/0 (socket says 172.21.15.6:37238) 2024-08-17T02:29:40.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.992+0000 7f26dde00640 1 -- 172.21.15.6:0/701066805 learned_addr learned my addr 172.21.15.6:0/701066805 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:40.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.992+0000 7f26dd400640 1 --2- 172.21.15.6:0/701066805 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f26e01590b0 0x7f26e00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.992+0000 7f26dca00640 1 -- 172.21.15.6:0/701066805 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090267831 0 0) 0x7f26e00c92b0 con 0x7f26e00afca0 2024-08-17T02:29:40.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.992+0000 7f26dca00640 1 -- 172.21.15.6:0/701066805 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26c40034e0 con 0x7f26e00afca0 2024-08-17T02:29:40.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.992+0000 7f26dca00640 1 -- 172.21.15.6:0/701066805 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1884184375 0 0) 0x7f26c40034e0 con 0x7f26e00afca0 2024-08-17T02:29:40.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.992+0000 7f26dca00640 1 -- 172.21.15.6:0/701066805 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f26e01590b0 msgr2=0x7f26e00b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:40.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.992+0000 7f26dca00640 1 --2- 172.21.15.6:0/701066805 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f26e01590b0 0x7f26e00b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.992+0000 7f26dca00640 1 -- 172.21.15.6:0/701066805 >> v1:172.21.15.136:6789/0 conn(0x7f26e00acf10 legacy=0x7f26e00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.992+0000 7f26dca00640 1 -- 172.21.15.6:0/701066805 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e00ad760 con 0x7f26e00afca0 2024-08-17T02:29:40.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.992+0000 7f26dca00640 1 -- 172.21.15.6:0/701066805 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f26d0001470 con 0x7f26e00afca0 2024-08-17T02:29:40.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.992+0000 7f26dca00640 1 -- 172.21.15.6:0/701066805 >> v1:172.21.15.6:6789/0 conn(0x7f26e00afca0 legacy=0x7f26e01589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.993+0000 7f26dca00640 1 --2- 172.21.15.6:0/701066805 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f26e01590b0 0x7f26c4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.993+0000 7f26dca00640 1 --2- 172.21.15.6:0/701066805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c4003f80 0x7f26c4004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.993+0000 7f26dca00640 1 --2- 172.21.15.6:0/701066805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26c4004cc0 0x7f26c4005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.993+0000 7f26dca00640 1 -- 172.21.15.6:0/701066805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c400bb60 con 0x7f26c4003f80 2024-08-17T02:29:40.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.993+0000 7f26dca00640 1 -- 172.21.15.6:0/701066805 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c400bca0 con 0x7f26c4004cc0 2024-08-17T02:29:40.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.993+0000 7f26dca00640 1 -- 172.21.15.6:0/701066805 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c400e070 con 0x7f26e01590b0 2024-08-17T02:29:40.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.993+0000 7f26dd400640 1 --2- 172.21.15.6:0/701066805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c4003f80 0x7f26c4004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.993+0000 7f26dde00640 1 --2- 172.21.15.6:0/701066805 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f26e01590b0 0x7f26c4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.993+0000 7f26de800640 1 --2- 172.21.15.6:0/701066805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26c4004cc0 0x7f26c4005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.993+0000 7f26dd400640 1 -- 172.21.15.6:0/701066805 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f26e01590b0 msgr2=0x7f26c4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:40.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.993+0000 7f26dd400640 1 --2- 172.21.15.6:0/701066805 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f26e01590b0 0x7f26c4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.993+0000 7f26dd400640 1 -- 172.21.15.6:0/701066805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26c4004cc0 msgr2=0x7f26c4005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:40.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.993+0000 7f26dd400640 1 --2- 172.21.15.6:0/701066805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26c4004cc0 0x7f26c4005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.993+0000 7f26dd400640 1 -- 172.21.15.6:0/701066805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c40034e0 con 0x7f26c4003f80 2024-08-17T02:29:40.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.994+0000 7f26dd400640 1 --2- 172.21.15.6:0/701066805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c4003f80 0x7f26c4004780 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f26cc006e70 tx=0x7f26cc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24bc83ad95e081a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.995+0000 7f26dca00640 1 -- 172.21.15.6:0/701066805 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc031400 con 0x7f26c4003f80 2024-08-17T02:29:40.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.995+0000 7f26dca00640 1 -- 172.21.15.6:0/701066805 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc02d050 con 0x7f26c4003f80 2024-08-17T02:29:40.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.995+0000 7f26dca00640 1 -- 172.21.15.6:0/701066805 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc031790 con 0x7f26c4003f80 2024-08-17T02:29:40.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.995+0000 7f26e5200640 1 -- 172.21.15.6:0/701066805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c4003f80 msgr2=0x7f26c4004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.995+0000 7f26e5200640 1 --2- 172.21.15.6:0/701066805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c4003f80 0x7f26c4004780 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f26cc006e70 tx=0x7f26cc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.995+0000 7f26de800640 1 -- 172.21.15.6:0/701066805 reap_dead start 2024-08-17T02:29:41.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.995+0000 7f26e5200640 1 -- 172.21.15.6:0/701066805 shutdown_connections 2024-08-17T02:29:41.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.995+0000 7f26e5200640 1 -- 172.21.15.6:0/701066805 >> 172.21.15.6:0/701066805 conn(0x7f26e0066e60 msgr2=0x7f26e0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.995+0000 7f26e5200640 1 -- 172.21.15.6:0/701066805 shutdown_connections 2024-08-17T02:29:41.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.995+0000 7f26e5200640 1 -- 172.21.15.6:0/701066805 wait complete. 2024-08-17T02:29:41.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.997+0000 7f26e5200640 1 Processor -- start 2024-08-17T02:29:41.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.997+0000 7f26e5200640 1 -- start start 2024-08-17T02:29:41.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26e5200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f26c4003f80 0x7f26e0164a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26e5200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e014cd80 0x7f26e01484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26e5200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26e014dbb0 0x7f26e014f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26e5200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e0149c60 con 0x7f26e014cd80 2024-08-17T02:29:41.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26e5200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e014a500 con 0x7f26e014dbb0 2024-08-17T02:29:41.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26e5200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e0164fc0 con 0x7f26c4003f80 2024-08-17T02:29:41.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26dd400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e014cd80 0x7f26e01484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26dd400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e014cd80 0x7f26e01484b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44552/0 (socket says 172.21.15.6:44552) 2024-08-17T02:29:41.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26dd400640 1 -- 172.21.15.6:0/583728227 learned_addr learned my addr 172.21.15.6:0/583728227 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:41.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26dde00640 1 --2- 172.21.15.6:0/583728227 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f26c4003f80 0x7f26e0164a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26dd400640 1 -- 172.21.15.6:0/583728227 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f26c4003f80 msgr2=0x7f26e0164a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26de800640 1 --2- 172.21.15.6:0/583728227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26e014dbb0 0x7f26e014f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26dd400640 1 --2- 172.21.15.6:0/583728227 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f26c4003f80 0x7f26e0164a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26dd400640 1 -- 172.21.15.6:0/583728227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26e014dbb0 msgr2=0x7f26e014f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26dd400640 1 --2- 172.21.15.6:0/583728227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26e014dbb0 0x7f26e014f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26dd400640 1 -- 172.21.15.6:0/583728227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e01489f0 con 0x7f26e014cd80 2024-08-17T02:29:41.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26dde00640 1 --2- 172.21.15.6:0/583728227 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f26c4003f80 0x7f26e0164a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:41.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.998+0000 7f26de800640 1 --2- 172.21.15.6:0/583728227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26e014dbb0 0x7f26e014f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:41.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.999+0000 7f26dd400640 1 --2- 172.21.15.6:0/583728227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e014cd80 0x7f26e01484b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f26cc02ab70 tx=0x7f26cc035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.999+0000 7f26d5600640 1 -- 172.21.15.6:0/583728227 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc030850 con 0x7f26e014cd80 2024-08-17T02:29:41.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.999+0000 7f26d5600640 1 -- 172.21.15.6:0/583728227 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc0309b0 con 0x7f26e014cd80 2024-08-17T02:29:41.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.999+0000 7f26d5600640 1 -- 172.21.15.6:0/583728227 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc030d50 con 0x7f26e014cd80 2024-08-17T02:29:41.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.999+0000 7f26e5200640 1 -- 172.21.15.6:0/583728227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e014e570 con 0x7f26e014cd80 2024-08-17T02:29:41.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:40.999+0000 7f26e5200640 1 -- 172.21.15.6:0/583728227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e014a190 con 0x7f26e014cd80 2024-08-17T02:29:41.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.000+0000 7f26e5200640 1 -- 172.21.15.6:0/583728227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e0063fb0 con 0x7f26e014cd80 2024-08-17T02:29:41.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.001+0000 7f26d5600640 1 -- 172.21.15.6:0/583728227 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f26cc03c630 con 0x7f26e014cd80 2024-08-17T02:29:41.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.002+0000 7f26d5600640 1 --2- 172.21.15.6:0/583728227 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f26c0065180 0x7f26c0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.002+0000 7f26d5600640 1 -- 172.21.15.6:0/583728227 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f26cc0a3cb0 con 0x7f26e014cd80 2024-08-17T02:29:41.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.002+0000 7f26dde00640 1 --2- 172.21.15.6:0/583728227 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f26c0065180 0x7f26c0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.003+0000 7f26dde00640 1 --2- 172.21.15.6:0/583728227 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f26c0065180 0x7f26c0067630 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f26d00015a0 tx=0x7f26d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.006+0000 7f26d5600640 1 -- 172.21.15.6:0/583728227 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f26cc071950 con 0x7f26e014cd80 2024-08-17T02:29:41.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.188+0000 7f26e5200640 1 -- 172.21.15.6:0/583728227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26e014a640 con 0x7f26e014cd80 2024-08-17T02:29:41.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.189+0000 7f26d5600640 1 -- 172.21.15.6:0/583728227 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18551 (secure 0 0 0) 0x7f26cc074f70 con 0x7f26e014cd80 2024-08-17T02:29:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:41.190 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":37,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:27:35.934220+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:19.345254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:20.195251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000329200.meta","create_time":"2024-08-17T02:27:32.084585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000329200"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000329200.data","create_time":"2024-08-17T02:27:32.953304+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000329200"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.191+0000 7f26e5200640 1 -- 172.21.15.6:0/583728227 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f26c0065180 msgr2=0x7f26c0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.191+0000 7f26e5200640 1 --2- 172.21.15.6:0/583728227 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f26c0065180 0x7f26c0067630 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f26d00015a0 tx=0x7f26d0009040 comp rx=0 tx=0).stop 2024-08-17T02:29:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.191+0000 7f26e5200640 1 -- 172.21.15.6:0/583728227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e014cd80 msgr2=0x7f26e01484b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.191+0000 7f26e5200640 1 --2- 172.21.15.6:0/583728227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e014cd80 0x7f26e01484b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f26cc02ab70 tx=0x7f26cc035000 comp rx=0 tx=0).stop 2024-08-17T02:29:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.191+0000 7f26e5200640 1 -- 172.21.15.6:0/583728227 shutdown_connections 2024-08-17T02:29:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.191+0000 7f26e5200640 1 --2- 172.21.15.6:0/583728227 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f26c0065180 0x7f26c0067630 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.191+0000 7f26e5200640 1 --2- 172.21.15.6:0/583728227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26e014dbb0 0x7f26e014f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.191+0000 7f26e5200640 1 --2- 172.21.15.6:0/583728227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e014cd80 0x7f26e01484b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.191+0000 7f26e5200640 1 --2- 172.21.15.6:0/583728227 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f26c4003f80 0x7f26e0164a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.191+0000 7f26e5200640 1 -- 172.21.15.6:0/583728227 >> 172.21.15.6:0/583728227 conn(0x7f26e0066e60 msgr2=0x7f26e006aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.191+0000 7f26e5200640 1 -- 172.21.15.6:0/583728227 shutdown_connections 2024-08-17T02:29:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.191+0000 7f26e5200640 1 -- 172.21.15.6:0/583728227 wait complete. 2024-08-17T02:29:41.207 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:29:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.359+0000 7f40ba800640 1 Processor -- start 2024-08-17T02:29:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.359+0000 7f40ba800640 1 -- start start 2024-08-17T02:29:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.360+0000 7f40ba800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f40b40ae540 0x7f40b4068950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.360+0000 7f40ba800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40b4068e90 0x7f40b40ae910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.360+0000 7f40ba800640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40b40aee50 0x7f40b40aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.360+0000 7f40ba800640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b40aab10 con 0x7f40b40aee50 2024-08-17T02:29:41.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.360+0000 7f40ba800640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b40ac250 con 0x7f40b40ae540 2024-08-17T02:29:41.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.360+0000 7f40ba800640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40693e0 con 0x7f40b4068e90 2024-08-17T02:29:41.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.360+0000 7f40b9e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40b40aee50 0x7f40b40aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.360+0000 7f40b9e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40b40aee50 0x7f40b40aafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44566/0 (socket says 172.21.15.6:44566) 2024-08-17T02:29:41.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.360+0000 7f40b9e00640 1 -- 172.21.15.6:0/2011855962 learned_addr learned my addr 172.21.15.6:0/2011855962 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:41.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.361+0000 7f40b9400640 1 --2- 172.21.15.6:0/2011855962 >> v2:172.21.15.136:3300/0 conn(0x7f40b40ae540 0x7f40b4068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.361+0000 7f40b8a00640 1 --2- 172.21.15.6:0/2011855962 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40b4068e90 0x7f40b40ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.361+0000 7f40b9e00640 1 -- 172.21.15.6:0/2011855962 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40b4068e90 msgr2=0x7f40b40ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.361+0000 7f40b9e00640 1 --2- 172.21.15.6:0/2011855962 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40b4068e90 0x7f40b40ae910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.361+0000 7f40b9e00640 1 -- 172.21.15.6:0/2011855962 >> v2:172.21.15.136:3300/0 conn(0x7f40b40ae540 msgr2=0x7f40b4068950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.361+0000 7f40b9e00640 1 --2- 172.21.15.6:0/2011855962 >> v2:172.21.15.136:3300/0 conn(0x7f40b40ae540 0x7f40b4068950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.361+0000 7f40b9e00640 1 -- 172.21.15.6:0/2011855962 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b40696c0 con 0x7f40b40aee50 2024-08-17T02:29:41.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.362+0000 7f40b9e00640 1 --2- 172.21.15.6:0/2011855962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b40aee50 0x7f40b40aafa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f40b406f0c0 tx=0x7f40ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff96d1208ea02ed9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.362+0000 7f40b3e00640 1 -- 172.21.15.6:0/2011855962 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac031400 con 0x7f40b40aee50 2024-08-17T02:29:41.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.362+0000 7f40b3e00640 1 -- 172.21.15.6:0/2011855962 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac02d050 con 0x7f40b40aee50 2024-08-17T02:29:41.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.362+0000 7f40b3e00640 1 -- 172.21.15.6:0/2011855962 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac0317d0 con 0x7f40b40aee50 2024-08-17T02:29:41.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.363+0000 7f40ba800640 1 -- 172.21.15.6:0/2011855962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b40aee50 msgr2=0x7f40b40aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.363+0000 7f40ba800640 1 --2- 172.21.15.6:0/2011855962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b40aee50 0x7f40b40aafa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f40b406f0c0 tx=0x7f40ac009840 comp rx=0 tx=0).stop 2024-08-17T02:29:41.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.363+0000 7f40ba800640 1 -- 172.21.15.6:0/2011855962 shutdown_connections 2024-08-17T02:29:41.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.363+0000 7f40ba800640 1 --2- 172.21.15.6:0/2011855962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b40aee50 0x7f40b40aafa0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.363+0000 7f40ba800640 1 --2- 172.21.15.6:0/2011855962 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40b4068e90 0x7f40b40ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.363+0000 7f40ba800640 1 --2- 172.21.15.6:0/2011855962 >> v2:172.21.15.136:3300/0 conn(0x7f40b40ae540 0x7f40b4068950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.363+0000 7f40ba800640 1 -- 172.21.15.6:0/2011855962 >> 172.21.15.6:0/2011855962 conn(0x7f40b40ce400 msgr2=0x7f40b4095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.363+0000 7f40ba800640 1 -- 172.21.15.6:0/2011855962 shutdown_connections 2024-08-17T02:29:41.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.363+0000 7f40ba800640 1 -- 172.21.15.6:0/2011855962 wait complete. 2024-08-17T02:29:41.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.364+0000 7f40ba800640 1 Processor -- start 2024-08-17T02:29:41.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.364+0000 7f40ba800640 1 -- start start 2024-08-17T02:29:41.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.365+0000 7f40ba800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40b4068e90 0x7f40b414d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.365+0000 7f40ba800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40b40ae540 0x7f40b40c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.365+0000 7f40ba800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b40aee50 0x7f40b40c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.365+0000 7f40ba800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b416e5b0 con 0x7f40b40aee50 2024-08-17T02:29:41.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.365+0000 7f40ba800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40999e0 con 0x7f40b4068e90 2024-08-17T02:29:41.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.365+0000 7f40ba800640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b4099cc0 con 0x7f40b40ae540 2024-08-17T02:29:41.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.365+0000 7f40b9e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b40aee50 0x7f40b40c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.365+0000 7f40b9e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b40aee50 0x7f40b40c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44570/0 (socket says 172.21.15.6:44570) 2024-08-17T02:29:41.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.365+0000 7f40b9e00640 1 -- 172.21.15.6:0/188487376 learned_addr learned my addr 172.21.15.6:0/188487376 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:41.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.366+0000 7f40b9400640 1 --2- 172.21.15.6:0/188487376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40b4068e90 0x7f40b414d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.366+0000 7f40b8a00640 1 --2- 172.21.15.6:0/188487376 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40b40ae540 0x7f40b40c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.366+0000 7f40b9e00640 1 -- 172.21.15.6:0/188487376 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40b40ae540 msgr2=0x7f40b40c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.366+0000 7f40b9e00640 1 --2- 172.21.15.6:0/188487376 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40b40ae540 0x7f40b40c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.366+0000 7f40b9e00640 1 -- 172.21.15.6:0/188487376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40b4068e90 msgr2=0x7f40b414d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.366+0000 7f40b9e00640 1 --2- 172.21.15.6:0/188487376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40b4068e90 0x7f40b414d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.366+0000 7f40b9e00640 1 -- 172.21.15.6:0/188487376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac009ae0 con 0x7f40b40aee50 2024-08-17T02:29:41.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.366+0000 7f40b9e00640 1 --2- 172.21.15.6:0/188487376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b40aee50 0x7f40b40c55d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f40ac02ac30 tx=0x7f40ac036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.366+0000 7f40b0c00640 1 -- 172.21.15.6:0/188487376 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac007170 con 0x7f40b40aee50 2024-08-17T02:29:41.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.366+0000 7f40b0c00640 1 -- 172.21.15.6:0/188487376 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac008e50 con 0x7f40b40aee50 2024-08-17T02:29:41.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.366+0000 7f40b0c00640 1 -- 172.21.15.6:0/188487376 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac03b640 con 0x7f40b40aee50 2024-08-17T02:29:41.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.366+0000 7f40ba800640 1 -- 172.21.15.6:0/188487376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b4099fa0 con 0x7f40b40aee50 2024-08-17T02:29:41.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.367+0000 7f40ba800640 1 -- 172.21.15.6:0/188487376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b414dae0 con 0x7f40b40aee50 2024-08-17T02:29:41.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.367+0000 7f40ba800640 1 -- 172.21.15.6:0/188487376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b416e770 con 0x7f40b40aee50 2024-08-17T02:29:41.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.368+0000 7f40b0c00640 1 -- 172.21.15.6:0/188487376 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f40ac038050 con 0x7f40b40aee50 2024-08-17T02:29:41.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.369+0000 7f40b0c00640 1 --2- 172.21.15.6:0/188487376 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4094065180 0x7f4094067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.369+0000 7f40b0c00640 1 -- 172.21.15.6:0/188487376 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f40ac0a2cb0 con 0x7f40b40aee50 2024-08-17T02:29:41.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.370+0000 7f40b9400640 1 --2- 172.21.15.6:0/188487376 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4094065180 0x7f4094067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.370+0000 7f40b9400640 1 --2- 172.21.15.6:0/188487376 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4094065180 0x7f4094067630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f40b40cd850 tx=0x7f40a80090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.373+0000 7f40b0c00640 1 -- 172.21.15.6:0/188487376 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f40b416e770 con 0x7f40b40aee50 2024-08-17T02:29:41.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.591+0000 7f40ba800640 1 -- 172.21.15.6:0/188487376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f40b416e770 con 0x7f40b40aee50 2024-08-17T02:29:41.592 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-08-17T02:29:41.591+0000 7f074d600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:29:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.598+0000 7f40b0c00640 1 -- 172.21.15.6:0/188487376 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f40b416e770 con 0x7f40b40aee50 2024-08-17T02:29:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:29:41.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.601+0000 7f40ba800640 1 -- 172.21.15.6:0/188487376 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4094065180 msgr2=0x7f4094067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.601+0000 7f40ba800640 1 --2- 172.21.15.6:0/188487376 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4094065180 0x7f4094067630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f40b40cd850 tx=0x7f40a80090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.601+0000 7f40ba800640 1 -- 172.21.15.6:0/188487376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b40aee50 msgr2=0x7f40b40c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.601+0000 7f40ba800640 1 --2- 172.21.15.6:0/188487376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b40aee50 0x7f40b40c55d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f40ac02ac30 tx=0x7f40ac036000 comp rx=0 tx=0).stop 2024-08-17T02:29:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.601+0000 7f40ba800640 1 -- 172.21.15.6:0/188487376 shutdown_connections 2024-08-17T02:29:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.601+0000 7f40ba800640 1 --2- 172.21.15.6:0/188487376 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4094065180 0x7f4094067630 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.601+0000 7f40ba800640 1 --2- 172.21.15.6:0/188487376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b40aee50 0x7f40b40c55d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.601+0000 7f40ba800640 1 --2- 172.21.15.6:0/188487376 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40b40ae540 0x7f40b40c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.601+0000 7f40ba800640 1 --2- 172.21.15.6:0/188487376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40b4068e90 0x7f40b414d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.601+0000 7f40ba800640 1 -- 172.21.15.6:0/188487376 >> 172.21.15.6:0/188487376 conn(0x7f40b40ce400 msgr2=0x7f40b40b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.601+0000 7f40ba800640 1 -- 172.21.15.6:0/188487376 shutdown_connections 2024-08-17T02:29:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.601+0000 7f40ba800640 1 -- 172.21.15.6:0/188487376 wait complete. 2024-08-17T02:29:41.607 INFO:tasks.ceph.mds.a.smithi006.stderr: -7194> 2024-08-17T02:27:25.767+0000 7fd462400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:29:41.616 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:29:41.652 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-08-17T02:29:41.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.774+0000 7f8b3d200640 1 Processor -- start 2024-08-17T02:29:41.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.775+0000 7f8b3d200640 1 -- start start 2024-08-17T02:29:41.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.776+0000 7f8b3d200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b38158a40 0x7f8b380abe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.776+0000 7f8b3d200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8b380af9b0 0x7f8b38068b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.776+0000 7f8b3d200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b380686f0 con 0x7f8b380ac380 2024-08-17T02:29:41.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.776+0000 7f8b3d200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b380ac7d0 con 0x7f8b380af9b0 2024-08-17T02:29:41.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.776+0000 7f8b3d200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b380b0270 con 0x7f8b38158a40 2024-08-17T02:29:41.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.776+0000 7f8b2fe00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8b380ac380 0x7f8b380af2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37254/0 (socket says 172.21.15.6:37254) 2024-08-17T02:29:41.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.776+0000 7f8b2fe00640 1 -- 172.21.15.6:0/1201963190 learned_addr learned my addr 172.21.15.6:0/1201963190 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:41.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b36a00640 1 -- 172.21.15.6:0/1201963190 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472516111 0 0) 0x7f8b380686f0 con 0x7f8b380ac380 2024-08-17T02:29:41.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b36a00640 1 -- 172.21.15.6:0/1201963190 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b1c0034e0 con 0x7f8b380ac380 2024-08-17T02:29:41.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b37400640 1 --2- 172.21.15.6:0/1201963190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b38158a40 0x7f8b380abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b37e00640 1 --2- 172.21.15.6:0/1201963190 >> v2:172.21.15.136:3300/0 conn(0x7f8b380af9b0 0x7f8b38068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b36a00640 1 -- 172.21.15.6:0/1201963190 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4004295315 0 0) 0x7f8b1c0034e0 con 0x7f8b380ac380 2024-08-17T02:29:41.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b36a00640 1 -- 172.21.15.6:0/1201963190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b38158a40 msgr2=0x7f8b380abe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b36a00640 1 --2- 172.21.15.6:0/1201963190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b38158a40 0x7f8b380abe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b36a00640 1 -- 172.21.15.6:0/1201963190 >> v2:172.21.15.136:3300/0 conn(0x7f8b380af9b0 msgr2=0x7f8b38068b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b36a00640 1 --2- 172.21.15.6:0/1201963190 >> v2:172.21.15.136:3300/0 conn(0x7f8b380af9b0 0x7f8b38068b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b36a00640 1 -- 172.21.15.6:0/1201963190 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b380aff90 con 0x7f8b380ac380 2024-08-17T02:29:41.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b36a00640 1 -- 172.21.15.6:0/1201963190 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f8b20001470 con 0x7f8b380ac380 2024-08-17T02:29:41.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b36a00640 1 -- 172.21.15.6:0/1201963190 >> v1:172.21.15.6:6789/0 conn(0x7f8b380ac380 legacy=0x7f8b380af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b36a00640 1 --2- 172.21.15.6:0/1201963190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0039d0 0x7f8b1c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b36a00640 1 --2- 172.21.15.6:0/1201963190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b38158a40 0x7f8b1c004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b36a00640 1 --2- 172.21.15.6:0/1201963190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b1c004cc0 0x7f8b1c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b36a00640 1 -- 172.21.15.6:0/1201963190 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b380ac7d0 con 0x7f8b1c0039d0 2024-08-17T02:29:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b36a00640 1 -- 172.21.15.6:0/1201963190 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b380b0270 con 0x7f8b1c004cc0 2024-08-17T02:29:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b36a00640 1 -- 172.21.15.6:0/1201963190 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c00bb00 con 0x7f8b38158a40 2024-08-17T02:29:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b37400640 1 --2- 172.21.15.6:0/1201963190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0039d0 0x7f8b1c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b37e00640 1 --2- 172.21.15.6:0/1201963190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b1c004cc0 0x7f8b1c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.777+0000 7f8b2fe00640 1 --2- 172.21.15.6:0/1201963190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b38158a40 0x7f8b1c004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.778+0000 7f8b37400640 1 -- 172.21.15.6:0/1201963190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b38158a40 msgr2=0x7f8b1c004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.778+0000 7f8b37400640 1 --2- 172.21.15.6:0/1201963190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b38158a40 0x7f8b1c004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.778+0000 7f8b37400640 1 -- 172.21.15.6:0/1201963190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b1c004cc0 msgr2=0x7f8b1c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.778+0000 7f8b37400640 1 --2- 172.21.15.6:0/1201963190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b1c004cc0 0x7f8b1c005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.778+0000 7f8b37400640 1 -- 172.21.15.6:0/1201963190 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c0034e0 con 0x7f8b1c0039d0 2024-08-17T02:29:41.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.779+0000 7f8b37400640 1 --2- 172.21.15.6:0/1201963190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0039d0 0x7f8b1c003de0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8b2800bb00 tx=0x7f8b28008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb6c78214f041fd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.779+0000 7f8b36a00640 1 -- 172.21.15.6:0/1201963190 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2802ac20 con 0x7f8b1c0039d0 2024-08-17T02:29:41.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.779+0000 7f8b36a00640 1 -- 172.21.15.6:0/1201963190 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2802e070 con 0x7f8b1c0039d0 2024-08-17T02:29:41.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.779+0000 7f8b36a00640 1 -- 172.21.15.6:0/1201963190 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b28034400 con 0x7f8b1c0039d0 2024-08-17T02:29:41.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.780+0000 7f8b3d200640 1 -- 172.21.15.6:0/1201963190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0039d0 msgr2=0x7f8b1c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.780+0000 7f8b3d200640 1 --2- 172.21.15.6:0/1201963190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0039d0 0x7f8b1c003de0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8b2800bb00 tx=0x7f8b28008040 comp rx=0 tx=0).stop 2024-08-17T02:29:41.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.780+0000 7f8b37e00640 1 -- 172.21.15.6:0/1201963190 reap_dead start 2024-08-17T02:29:41.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.780+0000 7f8b3d200640 1 -- 172.21.15.6:0/1201963190 shutdown_connections 2024-08-17T02:29:41.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.780+0000 7f8b3d200640 1 -- 172.21.15.6:0/1201963190 >> 172.21.15.6:0/1201963190 conn(0x7f8b380ce400 msgr2=0x7f8b38095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.780+0000 7f8b3d200640 1 -- 172.21.15.6:0/1201963190 shutdown_connections 2024-08-17T02:29:41.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.780+0000 7f8b3d200640 1 -- 172.21.15.6:0/1201963190 wait complete. 2024-08-17T02:29:41.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.781+0000 7f8b3d200640 1 Processor -- start 2024-08-17T02:29:41.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.781+0000 7f8b3d200640 1 -- start start 2024-08-17T02:29:41.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.782+0000 7f8b3d200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b1c0039d0 0x7f8b381667b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.782+0000 7f8b3d200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b38168570 0x7f8b38169590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.782+0000 7f8b3d200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b3809a940 0x7f8b3809adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.782+0000 7f8b3d200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3816acc0 con 0x7f8b38168570 2024-08-17T02:29:41.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.782+0000 7f8b3d200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3809b2f0 con 0x7f8b1c0039d0 2024-08-17T02:29:41.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.782+0000 7f8b3d200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b381689e0 con 0x7f8b3809a940 2024-08-17T02:29:41.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.783+0000 7f8b2fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b38168570 0x7f8b38169590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.783+0000 7f8b2fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b38168570 0x7f8b38169590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44604/0 (socket says 172.21.15.6:44604) 2024-08-17T02:29:41.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.783+0000 7f8b2fe00640 1 -- 172.21.15.6:0/385911350 learned_addr learned my addr 172.21.15.6:0/385911350 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:41.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.783+0000 7f8b37400640 1 --2- 172.21.15.6:0/385911350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b1c0039d0 0x7f8b381667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.783+0000 7f8b37e00640 1 --2- 172.21.15.6:0/385911350 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b3809a940 0x7f8b3809adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.783+0000 7f8b2fe00640 1 -- 172.21.15.6:0/385911350 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b3809a940 msgr2=0x7f8b3809adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.783+0000 7f8b2fe00640 1 --2- 172.21.15.6:0/385911350 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b3809a940 0x7f8b3809adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.783+0000 7f8b2fe00640 1 -- 172.21.15.6:0/385911350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b1c0039d0 msgr2=0x7f8b381667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.783+0000 7f8b2fe00640 1 --2- 172.21.15.6:0/385911350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b1c0039d0 0x7f8b381667b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.783+0000 7f8b2fe00640 1 -- 172.21.15.6:0/385911350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b38169ad0 con 0x7f8b38168570 2024-08-17T02:29:41.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.783+0000 7f8b2fe00640 1 --2- 172.21.15.6:0/385911350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b38168570 0x7f8b38169590 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8b200073c0 tx=0x7f8b380ac910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.784+0000 7f8b2ea00640 1 -- 172.21.15.6:0/385911350 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20018030 con 0x7f8b38168570 2024-08-17T02:29:41.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.784+0000 7f8b2ea00640 1 -- 172.21.15.6:0/385911350 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2000f990 con 0x7f8b38168570 2024-08-17T02:29:41.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.784+0000 7f8b2ea00640 1 -- 172.21.15.6:0/385911350 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2000fd70 con 0x7f8b38168570 2024-08-17T02:29:41.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.784+0000 7f8b3d200640 1 -- 172.21.15.6:0/385911350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3816a0b0 con 0x7f8b38168570 2024-08-17T02:29:41.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.784+0000 7f8b3d200640 1 -- 172.21.15.6:0/385911350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3816a670 con 0x7f8b38168570 2024-08-17T02:29:41.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.785+0000 7f8b3d200640 1 -- 172.21.15.6:0/385911350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3816ae30 con 0x7f8b38168570 2024-08-17T02:29:41.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.785+0000 7f8b2ea00640 1 -- 172.21.15.6:0/385911350 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8b2001b070 con 0x7f8b38168570 2024-08-17T02:29:41.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.786+0000 7f8b2ea00640 1 --2- 172.21.15.6:0/385911350 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8b14065180 0x7f8b14067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.786+0000 7f8b2ea00640 1 -- 172.21.15.6:0/385911350 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f8b20019070 con 0x7f8b38168570 2024-08-17T02:29:41.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.787+0000 7f8b37400640 1 --2- 172.21.15.6:0/385911350 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8b14065180 0x7f8b14067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.787+0000 7f8b37400640 1 --2- 172.21.15.6:0/385911350 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8b14065180 0x7f8b14067630 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8b2800b530 tx=0x7f8b28036000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:41.791+0000 7f8b2ea00640 1 -- 172.21.15.6:0/385911350 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8b20050420 con 0x7f8b38168570 2024-08-17T02:29:42.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.014+0000 7f8b3d200640 1 -- 172.21.15.6:0/385911350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8b38070720 con 0x7f8b38168570 2024-08-17T02:29:42.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.598+0000 7f8b2ea00640 1 -- 172.21.15.6:0/385911350 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8b20053a40 con 0x7f8b38168570 2024-08-17T02:29:42.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.600+0000 7f8b3d200640 1 -- 172.21.15.6:0/385911350 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8b14065180 msgr2=0x7f8b14067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.600+0000 7f8b3d200640 1 --2- 172.21.15.6:0/385911350 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8b14065180 0x7f8b14067630 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8b2800b530 tx=0x7f8b28036000 comp rx=0 tx=0).stop 2024-08-17T02:29:42.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.600+0000 7f8b3d200640 1 -- 172.21.15.6:0/385911350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b38168570 msgr2=0x7f8b38169590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.600+0000 7f8b3d200640 1 --2- 172.21.15.6:0/385911350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b38168570 0x7f8b38169590 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8b200073c0 tx=0x7f8b380ac910 comp rx=0 tx=0).stop 2024-08-17T02:29:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.601+0000 7f8b3d200640 1 -- 172.21.15.6:0/385911350 shutdown_connections 2024-08-17T02:29:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.601+0000 7f8b3d200640 1 --2- 172.21.15.6:0/385911350 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f8b14065180 0x7f8b14067630 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.601+0000 7f8b3d200640 1 --2- 172.21.15.6:0/385911350 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b3809a940 0x7f8b3809adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.601+0000 7f8b3d200640 1 --2- 172.21.15.6:0/385911350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b38168570 0x7f8b38169590 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.601+0000 7f8b3d200640 1 --2- 172.21.15.6:0/385911350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b1c0039d0 0x7f8b381667b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.601+0000 7f8b3d200640 1 -- 172.21.15.6:0/385911350 >> 172.21.15.6:0/385911350 conn(0x7f8b380ce400 msgr2=0x7f8b38155ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.601+0000 7f8b3d200640 1 -- 172.21.15.6:0/385911350 shutdown_connections 2024-08-17T02:29:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.601+0000 7f8b3d200640 1 -- 172.21.15.6:0/385911350 wait complete. 2024-08-17T02:29:42.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:29:42.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.818+0000 7f4983200640 1 Processor -- start 2024-08-17T02:29:42.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.819+0000 7f4983200640 1 -- start start 2024-08-17T02:29:42.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.820+0000 7f4983200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49841556c0 0x7f4984159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.820+0000 7f4983200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49840c8f20 con 0x7f49840ad430 2024-08-17T02:29:42.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.820+0000 7f4983200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49841599b0 con 0x7f4984155a90 2024-08-17T02:29:42.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.820+0000 7f4983200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4984159c50 con 0x7f49841556c0 2024-08-17T02:29:42.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.820+0000 7f4981e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49841556c0 0x7f4984159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.820+0000 7f4982800640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f49840ad430 0x7f49840c93b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37262/0 (socket says 172.21.15.6:37262) 2024-08-17T02:29:42.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.820+0000 7f4982800640 1 -- 172.21.15.6:0/4189499433 learned_addr learned my addr 172.21.15.6:0/4189499433 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:42.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.820+0000 7f4981e00640 1 -- 172.21.15.6:0/4189499433 >> v1:172.21.15.136:6789/0 conn(0x7f4984155a90 legacy=0x7f49840acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:42.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.820+0000 7f4981e00640 1 -- 172.21.15.6:0/4189499433 >> v1:172.21.15.6:6789/0 conn(0x7f49840ad430 legacy=0x7f49840c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.820+0000 7f4980a00640 1 -- 172.21.15.6:0/4189499433 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324090592 0 0) 0x7f49840c8f20 con 0x7f49840ad430 2024-08-17T02:29:42.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.821+0000 7f4981e00640 1 -- 172.21.15.6:0/4189499433 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4984159f30 con 0x7f49841556c0 2024-08-17T02:29:42.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.822+0000 7f4981e00640 1 --2- 172.21.15.6:0/4189499433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49841556c0 0x7f4984159470 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4974009880 tx=0x7f49740090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90fbf20cd5e91ae server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:42.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.822+0000 7f4980a00640 1 -- 172.21.15.6:0/4189499433 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497402ad40 con 0x7f49841556c0 2024-08-17T02:29:42.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.822+0000 7f4980a00640 1 -- 172.21.15.6:0/4189499433 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4974032440 con 0x7f49841556c0 2024-08-17T02:29:42.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.822+0000 7f4980a00640 1 -- 172.21.15.6:0/4189499433 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497402aea0 con 0x7f49841556c0 2024-08-17T02:29:42.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.822+0000 7f4983200640 1 -- 172.21.15.6:0/4189499433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49841556c0 msgr2=0x7f4984159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.822+0000 7f4983200640 1 --2- 172.21.15.6:0/4189499433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49841556c0 0x7f4984159470 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4974009880 tx=0x7f49740090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.822+0000 7f4983200640 1 -- 172.21.15.6:0/4189499433 shutdown_connections 2024-08-17T02:29:42.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.822+0000 7f4983200640 1 --2- 172.21.15.6:0/4189499433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49841556c0 0x7f4984159470 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.822+0000 7f4983200640 1 -- 172.21.15.6:0/4189499433 >> 172.21.15.6:0/4189499433 conn(0x7f4984066e60 msgr2=0x7f4984067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:42.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.823+0000 7f4983200640 1 -- 172.21.15.6:0/4189499433 shutdown_connections 2024-08-17T02:29:42.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.823+0000 7f4983200640 1 -- 172.21.15.6:0/4189499433 wait complete. 2024-08-17T02:29:42.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.824+0000 7f4983200640 1 Processor -- start 2024-08-17T02:29:42.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.824+0000 7f4983200640 1 -- start start 2024-08-17T02:29:42.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.825+0000 7f4983200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49840ad430 0x7f49840af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.825+0000 7f4983200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49841556c0 0x7f49840c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.825+0000 7f4983200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4984155a90 0x7f4984169320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.825+0000 7f4983200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49840c4a70 con 0x7f49841556c0 2024-08-17T02:29:42.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.825+0000 7f4983200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49840c55f0 con 0x7f4984155a90 2024-08-17T02:29:42.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.825+0000 7f4983200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49840c4cc0 con 0x7f49840ad430 2024-08-17T02:29:42.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.825+0000 7f4981400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49841556c0 0x7f49840c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.825+0000 7f4981400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49841556c0 0x7f49840c5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44614/0 (socket says 172.21.15.6:44614) 2024-08-17T02:29:42.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.825+0000 7f4981400640 1 -- 172.21.15.6:0/3524145346 learned_addr learned my addr 172.21.15.6:0/3524145346 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:42.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.825+0000 7f4982800640 1 --2- 172.21.15.6:0/3524145346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4984155a90 0x7f4984169320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.825+0000 7f4981e00640 1 --2- 172.21.15.6:0/3524145346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49840ad430 0x7f49840af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.825+0000 7f4981400640 1 -- 172.21.15.6:0/3524145346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49840ad430 msgr2=0x7f49840af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.825+0000 7f4981400640 1 --2- 172.21.15.6:0/3524145346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49840ad430 0x7f49840af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.825+0000 7f4981400640 1 -- 172.21.15.6:0/3524145346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4984155a90 msgr2=0x7f4984169320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.825+0000 7f4981400640 1 --2- 172.21.15.6:0/3524145346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4984155a90 0x7f4984169320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.825+0000 7f4981400640 1 -- 172.21.15.6:0/3524145346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4974009390 con 0x7f49841556c0 2024-08-17T02:29:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.826+0000 7f4981400640 1 --2- 172.21.15.6:0/3524145346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49841556c0 0x7f49840c5a80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f497000b520 tx=0x7f49700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.826+0000 7f4979600640 1 -- 172.21.15.6:0/3524145346 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497000f510 con 0x7f49841556c0 2024-08-17T02:29:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.826+0000 7f4979600640 1 -- 172.21.15.6:0/3524145346 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497000f670 con 0x7f49841556c0 2024-08-17T02:29:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.826+0000 7f4983200640 1 -- 172.21.15.6:0/3524145346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49840c4fa0 con 0x7f49841556c0 2024-08-17T02:29:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.826+0000 7f4979600640 1 -- 172.21.15.6:0/3524145346 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497000fa30 con 0x7f49841556c0 2024-08-17T02:29:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.826+0000 7f4983200640 1 -- 172.21.15.6:0/3524145346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49840aff20 con 0x7f49841556c0 2024-08-17T02:29:42.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.827+0000 7f4983200640 1 -- 172.21.15.6:0/3524145346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4984154f90 con 0x7f49841556c0 2024-08-17T02:29:42.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.828+0000 7f4979600640 1 -- 172.21.15.6:0/3524145346 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f497001a400 con 0x7f49841556c0 2024-08-17T02:29:42.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.829+0000 7f4979600640 1 --2- 172.21.15.6:0/3524145346 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4964065150 0x7f4964067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.829+0000 7f4979600640 1 -- 172.21.15.6:0/3524145346 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f49700823b0 con 0x7f49841556c0 2024-08-17T02:29:42.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.830+0000 7f4981e00640 1 --2- 172.21.15.6:0/3524145346 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4964065150 0x7f4964067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.830+0000 7f4981e00640 1 --2- 172.21.15.6:0/3524145346 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4964065150 0x7f4964067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4974034000 tx=0x7f4974032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:42.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:42.834+0000 7f4979600640 1 -- 172.21.15.6:0/3524145346 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4984154f90 con 0x7f49841556c0 2024-08-17T02:29:43.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.017+0000 7f4983200640 1 -- 172.21.15.6:0/3524145346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4984154f90 con 0x7f49841556c0 2024-08-17T02:29:43.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.712+0000 7f4979600640 1 -- 172.21.15.6:0/3524145346 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4984154f90 con 0x7f49841556c0 2024-08-17T02:29:43.713 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.715+0000 7f4983200640 1 -- 172.21.15.6:0/3524145346 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4964065150 msgr2=0x7f4964067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.715+0000 7f4983200640 1 --2- 172.21.15.6:0/3524145346 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4964065150 0x7f4964067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4974034000 tx=0x7f4974032000 comp rx=0 tx=0).stop 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.715+0000 7f4983200640 1 -- 172.21.15.6:0/3524145346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49841556c0 msgr2=0x7f49840c5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.715+0000 7f4983200640 1 --2- 172.21.15.6:0/3524145346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49841556c0 0x7f49840c5a80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f497000b520 tx=0x7f49700090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.715+0000 7f4983200640 1 -- 172.21.15.6:0/3524145346 shutdown_connections 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.715+0000 7f4983200640 1 --2- 172.21.15.6:0/3524145346 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4964065150 0x7f4964067600 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.715+0000 7f4983200640 1 --2- 172.21.15.6:0/3524145346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4984155a90 0x7f4984169320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.715+0000 7f4983200640 1 --2- 172.21.15.6:0/3524145346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49841556c0 0x7f49840c5a80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.715+0000 7f4983200640 1 --2- 172.21.15.6:0/3524145346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49840ad430 0x7f49840af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.715+0000 7f4983200640 1 -- 172.21.15.6:0/3524145346 >> 172.21.15.6:0/3524145346 conn(0x7f4984066e60 msgr2=0x7f498406fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:43.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.715+0000 7f4983200640 1 -- 172.21.15.6:0/3524145346 shutdown_connections 2024-08-17T02:29:43.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.715+0000 7f4983200640 1 -- 172.21.15.6:0/3524145346 wait complete. 2024-08-17T02:29:43.733 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:29:43.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.890+0000 7f92ddc00640 1 Processor -- start 2024-08-17T02:29:43.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.890+0000 7f92ddc00640 1 -- start start 2024-08-17T02:29:43.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.892+0000 7f92ddc00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f92d81589f0 0x7f92d80ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.892+0000 7f92ddc00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d80b3ac0 con 0x7f92d80cf520 2024-08-17T02:29:43.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.892+0000 7f92ddc00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d80b3190 con 0x7f92d8158dc0 2024-08-17T02:29:43.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.892+0000 7f92ddc00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d80b3470 con 0x7f92d81589f0 2024-08-17T02:29:43.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.892+0000 7f92dd200640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f92d80cf520 0x7f92d80cf910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37278/0 (socket says 172.21.15.6:37278) 2024-08-17T02:29:43.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.892+0000 7f92dd200640 1 -- 172.21.15.6:0/2160025891 learned_addr learned my addr 172.21.15.6:0/2160025891 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.892+0000 7f92d7e00640 1 --2- 172.21.15.6:0/2160025891 >> v2:172.21.15.136:3300/0 conn(0x7f92d81589f0 0x7f92d80ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.892+0000 7f92d7400640 1 -- 172.21.15.6:0/2160025891 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543454152 0 0) 0x7f92d80b3ac0 con 0x7f92d80cf520 2024-08-17T02:29:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.892+0000 7f92d7400640 1 -- 172.21.15.6:0/2160025891 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92bc0034e0 con 0x7f92d80cf520 2024-08-17T02:29:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92d7400640 1 -- 172.21.15.6:0/2160025891 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742206615 0 0) 0x7f92d80b3190 con 0x7f92d8158dc0 2024-08-17T02:29:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92d7400640 1 -- 172.21.15.6:0/2160025891 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92d80b3ac0 con 0x7f92d8158dc0 2024-08-17T02:29:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92d7400640 1 -- 172.21.15.6:0/2160025891 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 811272140 0 0) 0x7f92bc0034e0 con 0x7f92d80cf520 2024-08-17T02:29:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92d7400640 1 -- 172.21.15.6:0/2160025891 >> v2:172.21.15.136:3300/0 conn(0x7f92d81589f0 msgr2=0x7f92d80ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92d7400640 1 --2- 172.21.15.6:0/2160025891 >> v2:172.21.15.136:3300/0 conn(0x7f92d81589f0 0x7f92d80ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92d7400640 1 -- 172.21.15.6:0/2160025891 >> v1:172.21.15.136:6789/0 conn(0x7f92d8158dc0 legacy=0x7f92d80ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92d7400640 1 -- 172.21.15.6:0/2160025891 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d80b3750 con 0x7f92d80cf520 2024-08-17T02:29:43.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92d7400640 1 -- 172.21.15.6:0/2160025891 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f92d00017f0 con 0x7f92d80cf520 2024-08-17T02:29:43.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92d7400640 1 -- 172.21.15.6:0/2160025891 >> v1:172.21.15.6:6789/0 conn(0x7f92d80cf520 legacy=0x7f92d80cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92d7400640 1 --2- 172.21.15.6:0/2160025891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc003bb0 0x7f92bc003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92d7400640 1 --2- 172.21.15.6:0/2160025891 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92bc004780 0x7f92bc004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92d7400640 1 --2- 172.21.15.6:0/2160025891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92bc005180 0x7f92bc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92d7400640 1 -- 172.21.15.6:0/2160025891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80b3470 con 0x7f92bc005180 2024-08-17T02:29:43.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92d7400640 1 -- 172.21.15.6:0/2160025891 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc00c0a0 con 0x7f92bc003bb0 2024-08-17T02:29:43.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92d7400640 1 -- 172.21.15.6:0/2160025891 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc00c230 con 0x7f92bc004780 2024-08-17T02:29:43.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92dd200640 1 --2- 172.21.15.6:0/2160025891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92bc005180 0x7f92bc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92d7e00640 1 --2- 172.21.15.6:0/2160025891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc003bb0 0x7f92bc003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.893+0000 7f92cfe00640 1 --2- 172.21.15.6:0/2160025891 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92bc004780 0x7f92bc004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.894+0000 7f92dd200640 1 -- 172.21.15.6:0/2160025891 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92bc004780 msgr2=0x7f92bc004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:43.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.894+0000 7f92dd200640 1 --2- 172.21.15.6:0/2160025891 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92bc004780 0x7f92bc004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.894+0000 7f92dd200640 1 -- 172.21.15.6:0/2160025891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc003bb0 msgr2=0x7f92bc003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:43.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.894+0000 7f92dd200640 1 --2- 172.21.15.6:0/2160025891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc003bb0 0x7f92bc003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.894+0000 7f92dd200640 1 -- 172.21.15.6:0/2160025891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc0034e0 con 0x7f92bc005180 2024-08-17T02:29:43.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.894+0000 7f92dd200640 1 -- 172.21.15.6:0/2160025891 reap_dead start 2024-08-17T02:29:43.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.895+0000 7f92dd200640 1 --2- 172.21.15.6:0/2160025891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92bc005180 0x7f92bc00b9d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f92d000a830 tx=0x7f92d00020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a8356d89fa39e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:43.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.895+0000 7f92d7400640 1 -- 172.21.15.6:0/2160025891 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d00071c0 con 0x7f92bc005180 2024-08-17T02:29:43.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.895+0000 7f92d7400640 1 -- 172.21.15.6:0/2160025891 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d0007340 con 0x7f92bc005180 2024-08-17T02:29:43.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.895+0000 7f92d7400640 1 -- 172.21.15.6:0/2160025891 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0007700 con 0x7f92bc005180 2024-08-17T02:29:43.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.895+0000 7f92ddc00640 1 -- 172.21.15.6:0/2160025891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92bc005180 msgr2=0x7f92bc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.895+0000 7f92ddc00640 1 --2- 172.21.15.6:0/2160025891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92bc005180 0x7f92bc00b9d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f92d000a830 tx=0x7f92d00020c0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.895+0000 7f92ddc00640 1 -- 172.21.15.6:0/2160025891 shutdown_connections 2024-08-17T02:29:43.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.895+0000 7f92ddc00640 1 --2- 172.21.15.6:0/2160025891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92bc005180 0x7f92bc00b9d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.895+0000 7f92ddc00640 1 -- 172.21.15.6:0/2160025891 >> 172.21.15.6:0/2160025891 conn(0x7f92d8087a80 msgr2=0x7f92d806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:43.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.895+0000 7f92ddc00640 1 -- 172.21.15.6:0/2160025891 shutdown_connections 2024-08-17T02:29:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.895+0000 7f92ddc00640 1 -- 172.21.15.6:0/2160025891 wait complete. 2024-08-17T02:29:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.897+0000 7f92ddc00640 1 Processor -- start 2024-08-17T02:29:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.897+0000 7f92ddc00640 1 -- start start 2024-08-17T02:29:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.898+0000 7f92ddc00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92bc005180 0x7f92d815a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.898+0000 7f92ddc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d815af20 0x7f92d80af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.898+0000 7f92ddc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92d80afa50 0x7f92d814a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.898+0000 7f92ddc00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80b0860 con 0x7f92d815af20 2024-08-17T02:29:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.898+0000 7f92ddc00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d814ee70 con 0x7f92d80afa50 2024-08-17T02:29:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.898+0000 7f92ddc00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80b01c0 con 0x7f92bc005180 2024-08-17T02:29:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.898+0000 7f92cfe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d815af20 0x7f92d80af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.898+0000 7f92cfe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d815af20 0x7f92d80af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44632/0 (socket says 172.21.15.6:44632) 2024-08-17T02:29:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.898+0000 7f92cfe00640 1 -- 172.21.15.6:0/2337595327 learned_addr learned my addr 172.21.15.6:0/2337595327 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.898+0000 7f92dd200640 1 --2- 172.21.15.6:0/2337595327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92d80afa50 0x7f92d814a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.898+0000 7f92d7e00640 1 --2- 172.21.15.6:0/2337595327 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92bc005180 0x7f92d815a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.899+0000 7f92cfe00640 1 -- 172.21.15.6:0/2337595327 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92bc005180 msgr2=0x7f92d815a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.899+0000 7f92cfe00640 1 --2- 172.21.15.6:0/2337595327 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92bc005180 0x7f92d815a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.899+0000 7f92cfe00640 1 -- 172.21.15.6:0/2337595327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92d80afa50 msgr2=0x7f92d814a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.899+0000 7f92cfe00640 1 --2- 172.21.15.6:0/2337595327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92d80afa50 0x7f92d814a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.899+0000 7f92cfe00640 1 -- 172.21.15.6:0/2337595327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d80b04a0 con 0x7f92d815af20 2024-08-17T02:29:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.899+0000 7f92dd200640 1 --2- 172.21.15.6:0/2337595327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92d80afa50 0x7f92d814a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.899+0000 7f92d7e00640 1 --2- 172.21.15.6:0/2337595327 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92bc005180 0x7f92d815a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.899+0000 7f92cfe00640 1 --2- 172.21.15.6:0/2337595327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d815af20 0x7f92d80af510 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f92c0002ba0 tx=0x7f92c0007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.899+0000 7f92cf400640 1 -- 172.21.15.6:0/2337595327 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c000fb50 con 0x7f92d815af20 2024-08-17T02:29:43.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.899+0000 7f92cf400640 1 -- 172.21.15.6:0/2337595327 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c000fcd0 con 0x7f92d815af20 2024-08-17T02:29:43.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.899+0000 7f92ddc00640 1 -- 172.21.15.6:0/2337595327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d80b0ab0 con 0x7f92d815af20 2024-08-17T02:29:43.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.899+0000 7f92cf400640 1 -- 172.21.15.6:0/2337595327 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c0007280 con 0x7f92d815af20 2024-08-17T02:29:43.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.899+0000 7f92ddc00640 1 -- 172.21.15.6:0/2337595327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d80afed0 con 0x7f92d815af20 2024-08-17T02:29:43.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.900+0000 7f92ddc00640 1 -- 172.21.15.6:0/2337595327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d80b0fb0 con 0x7f92d815af20 2024-08-17T02:29:43.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.901+0000 7f92cf400640 1 -- 172.21.15.6:0/2337595327 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f92c0006790 con 0x7f92d815af20 2024-08-17T02:29:43.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.902+0000 7f92cf400640 1 --2- 172.21.15.6:0/2337595327 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f92b4065150 0x7f92b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.902+0000 7f92cf400640 1 -- 172.21.15.6:0/2337595327 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6251+0+0 (secure 0 0 0) 0x7f92c0082b50 con 0x7f92d815af20 2024-08-17T02:29:43.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.902+0000 7f92d7e00640 1 --2- 172.21.15.6:0/2337595327 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f92b4065150 0x7f92b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.903+0000 7f92d7e00640 1 --2- 172.21.15.6:0/2337595327 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f92b4065150 0x7f92b4067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f92c8006e70 tx=0x7f92c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:43.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:43.906+0000 7f92cf400640 1 -- 172.21.15.6:0/2337595327 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f92c0050950 con 0x7f92d815af20 2024-08-17T02:29:44.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.098+0000 7f92ddc00640 1 -- 172.21.15.6:0/2337595327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f92d8063f10 con 0x7f92d815af20 2024-08-17T02:29:44.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.713+0000 7f92cf400640 1 -- 172.21.15.6:0/2337595327 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7f92c0053f70 con 0x7f92d815af20 2024-08-17T02:29:44.718 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-08-17T02:29:44.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.720+0000 7f92ddc00640 1 -- 172.21.15.6:0/2337595327 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f92b4065150 msgr2=0x7f92b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.720+0000 7f92ddc00640 1 --2- 172.21.15.6:0/2337595327 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f92b4065150 0x7f92b4067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f92c8006e70 tx=0x7f92c8008040 comp rx=0 tx=0).stop 2024-08-17T02:29:44.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.720+0000 7f92ddc00640 1 -- 172.21.15.6:0/2337595327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d815af20 msgr2=0x7f92d80af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.720+0000 7f92ddc00640 1 --2- 172.21.15.6:0/2337595327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d815af20 0x7f92d80af510 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f92c0002ba0 tx=0x7f92c0007ca0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.720+0000 7f92ddc00640 1 -- 172.21.15.6:0/2337595327 shutdown_connections 2024-08-17T02:29:44.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.720+0000 7f92ddc00640 1 --2- 172.21.15.6:0/2337595327 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f92b4065150 0x7f92b4067600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.720+0000 7f92ddc00640 1 --2- 172.21.15.6:0/2337595327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92d80afa50 0x7f92d814a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.721+0000 7f92ddc00640 1 --2- 172.21.15.6:0/2337595327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d815af20 0x7f92d80af510 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.721+0000 7f92ddc00640 1 --2- 172.21.15.6:0/2337595327 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92bc005180 0x7f92d815a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.721+0000 7f92ddc00640 1 -- 172.21.15.6:0/2337595327 >> 172.21.15.6:0/2337595327 conn(0x7f92d8087a80 msgr2=0x7f92d81571d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:44.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.721+0000 7f92ddc00640 1 -- 172.21.15.6:0/2337595327 shutdown_connections 2024-08-17T02:29:44.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.722+0000 7f92ddc00640 1 -- 172.21.15.6:0/2337595327 wait complete. 2024-08-17T02:29:44.740 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.891+0000 7f4f51600640 1 Processor -- start 2024-08-17T02:29:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.892+0000 7f4f51600640 1 -- start start 2024-08-17T02:29:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.893+0000 7f4f51600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4f4c0ad790 0x7f4f4c0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.893+0000 7f4f51600640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4c0cb180 con 0x7f4f4c0c9d20 2024-08-17T02:29:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.893+0000 7f4f51600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4c0af530 con 0x7f4f4c1559e0 2024-08-17T02:29:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.893+0000 7f4f51600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4c0ca8e0 con 0x7f4f4c0ad790 2024-08-17T02:29:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.893+0000 7f4f43e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4f4c0c9d20 0x7f4f4c1552d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39716/0 (socket says 172.21.15.6:39716) 2024-08-17T02:29:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.893+0000 7f4f43e00640 1 -- 172.21.15.6:0/2886218434 learned_addr learned my addr 172.21.15.6:0/2886218434 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.893+0000 7f4f4be00640 1 --2- 172.21.15.6:0/2886218434 >> v2:172.21.15.136:3300/0 conn(0x7f4f4c0ad790 0x7f4f4c0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.894+0000 7f4f4b400640 1 -- 172.21.15.6:0/2886218434 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065009400 0 0) 0x7f4f4c0cb180 con 0x7f4f4c0c9d20 2024-08-17T02:29:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.894+0000 7f4f4b400640 1 -- 172.21.15.6:0/2886218434 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f300034e0 con 0x7f4f4c0c9d20 2024-08-17T02:29:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.894+0000 7f4f4b400640 1 -- 172.21.15.6:0/2886218434 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199067270 0 0) 0x7f4f4c0af530 con 0x7f4f4c1559e0 2024-08-17T02:29:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.894+0000 7f4f4b400640 1 -- 172.21.15.6:0/2886218434 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f4c0cb180 con 0x7f4f4c1559e0 2024-08-17T02:29:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.894+0000 7f4f4b400640 1 -- 172.21.15.6:0/2886218434 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 603069411 0 0) 0x7f4f300034e0 con 0x7f4f4c0c9d20 2024-08-17T02:29:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.894+0000 7f4f4be00640 1 -- 172.21.15.6:0/2886218434 >> v1:172.21.15.136:6789/0 conn(0x7f4f4c1559e0 legacy=0x7f4f4c0af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.894+0000 7f4f4be00640 1 -- 172.21.15.6:0/2886218434 >> v1:172.21.15.6:6789/0 conn(0x7f4f4c0c9d20 legacy=0x7f4f4c1552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.894+0000 7f4f4be00640 1 -- 172.21.15.6:0/2886218434 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c0cabc0 con 0x7f4f4c0ad790 2024-08-17T02:29:44.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.895+0000 7f4f4be00640 1 --2- 172.21.15.6:0/2886218434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f4c0ad790 0x7f4f4c0adb60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009850 tx=0x7f4f3c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce0a10f1b597de24 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:44.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.895+0000 7f4f4b400640 1 -- 172.21.15.6:0/2886218434 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34001470 con 0x7f4f4c0ad790 2024-08-17T02:29:44.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.895+0000 7f4f4b400640 1 -- 172.21.15.6:0/2886218434 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c02aa50 con 0x7f4f4c0ad790 2024-08-17T02:29:44.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.895+0000 7f4f4b400640 1 -- 172.21.15.6:0/2886218434 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c02adf0 con 0x7f4f4c0ad790 2024-08-17T02:29:44.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.896+0000 7f4f51600640 1 -- 172.21.15.6:0/2886218434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f4c0ad790 msgr2=0x7f4f4c0adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.896+0000 7f4f51600640 1 --2- 172.21.15.6:0/2886218434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f4c0ad790 0x7f4f4c0adb60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009850 tx=0x7f4f3c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.896+0000 7f4f51600640 1 -- 172.21.15.6:0/2886218434 shutdown_connections 2024-08-17T02:29:44.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.896+0000 7f4f51600640 1 --2- 172.21.15.6:0/2886218434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f4c0ad790 0x7f4f4c0adb60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.896+0000 7f4f51600640 1 -- 172.21.15.6:0/2886218434 >> 172.21.15.6:0/2886218434 conn(0x7f4f4c062af0 msgr2=0x7f4f4c062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:44.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.896+0000 7f4f51600640 1 -- 172.21.15.6:0/2886218434 shutdown_connections 2024-08-17T02:29:44.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.896+0000 7f4f51600640 1 -- 172.21.15.6:0/2886218434 wait complete. 2024-08-17T02:29:44.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.897+0000 7f4f51600640 1 Processor -- start 2024-08-17T02:29:44.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.898+0000 7f4f51600640 1 -- start start 2024-08-17T02:29:44.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.898+0000 7f4f51600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4c0ad790 0x7f4f4c152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.898+0000 7f4f51600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f4c0c9d20 0x7f4f4c14b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.899+0000 7f4f51600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f4c1559e0 0x7f4f4c069780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.899+0000 7f4f51600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c169a00 con 0x7f4f4c0ad790 2024-08-17T02:29:44.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.899+0000 7f4f51600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c1526b0 con 0x7f4f4c1559e0 2024-08-17T02:29:44.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.899+0000 7f4f51600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c150540 con 0x7f4f4c0c9d20 2024-08-17T02:29:44.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.899+0000 7f4f4be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4c0ad790 0x7f4f4c152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.899+0000 7f4f4be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4c0ad790 0x7f4f4c152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40602/0 (socket says 172.21.15.6:40602) 2024-08-17T02:29:44.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.899+0000 7f4f4be00640 1 -- 172.21.15.6:0/888487887 learned_addr learned my addr 172.21.15.6:0/888487887 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:44.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.899+0000 7f4f43e00640 1 --2- 172.21.15.6:0/888487887 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f4c0c9d20 0x7f4f4c14b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.899+0000 7f4f50c00640 1 --2- 172.21.15.6:0/888487887 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f4c1559e0 0x7f4f4c069780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.899+0000 7f4f4be00640 1 -- 172.21.15.6:0/888487887 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f4c0c9d20 msgr2=0x7f4f4c14b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.899+0000 7f4f4be00640 1 --2- 172.21.15.6:0/888487887 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f4c0c9d20 0x7f4f4c14b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.899+0000 7f4f4be00640 1 -- 172.21.15.6:0/888487887 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f4c1559e0 msgr2=0x7f4f4c069780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.899+0000 7f4f4be00640 1 --2- 172.21.15.6:0/888487887 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f4c1559e0 0x7f4f4c069780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.899+0000 7f4f4be00640 1 -- 172.21.15.6:0/888487887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c009390 con 0x7f4f4c0ad790 2024-08-17T02:29:44.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.899+0000 7f4f43e00640 1 --2- 172.21.15.6:0/888487887 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f4c0c9d20 0x7f4f4c14b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:44.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.900+0000 7f4f4be00640 1 --2- 172.21.15.6:0/888487887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4c0ad790 0x7f4f4c152170 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009850 tx=0x7f4f3c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:44.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.900+0000 7f4f43400640 1 -- 172.21.15.6:0/888487887 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c03d420 con 0x7f4f4c0ad790 2024-08-17T02:29:44.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.900+0000 7f4f43400640 1 -- 172.21.15.6:0/888487887 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c03d5a0 con 0x7f4f4c0ad790 2024-08-17T02:29:44.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.900+0000 7f4f51600640 1 -- 172.21.15.6:0/888487887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4c150820 con 0x7f4f4c0ad790 2024-08-17T02:29:44.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.900+0000 7f4f43400640 1 -- 172.21.15.6:0/888487887 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c03d960 con 0x7f4f4c0ad790 2024-08-17T02:29:44.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.900+0000 7f4f51600640 1 -- 172.21.15.6:0/888487887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4c14dae0 con 0x7f4f4c0ad790 2024-08-17T02:29:44.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.901+0000 7f4f51600640 1 -- 172.21.15.6:0/888487887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4c0aa410 con 0x7f4f4c0ad790 2024-08-17T02:29:44.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.902+0000 7f4f43400640 1 -- 172.21.15.6:0/888487887 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4f3c039040 con 0x7f4f4c0ad790 2024-08-17T02:29:44.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.903+0000 7f4f43400640 1 --2- 172.21.15.6:0/888487887 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4f28065150 0x7f4f28067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.903+0000 7f4f43400640 1 -- 172.21.15.6:0/888487887 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f4f3c0a2120 con 0x7f4f4c0ad790 2024-08-17T02:29:44.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.903+0000 7f4f43e00640 1 --2- 172.21.15.6:0/888487887 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4f28065150 0x7f4f28067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.904+0000 7f4f43e00640 1 --2- 172.21.15.6:0/888487887 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4f28065150 0x7f4f28067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4f340011e0 tx=0x7f4f34001a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:44.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:44.906+0000 7f4f43400640 1 -- 172.21.15.6:0/888487887 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4f4c0aa410 con 0x7f4f4c0ad790 2024-08-17T02:29:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.100+0000 7f4f51600640 1 -- 172.21.15.6:0/888487887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f4c0aa410 con 0x7f4f4c0ad790 2024-08-17T02:29:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.101+0000 7f4f43400640 1 -- 172.21.15.6:0/888487887 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15460 (secure 0 0 0) 0x7f4f4c0aa410 con 0x7f4f4c0ad790 2024-08-17T02:29:45.102 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:45.102 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:29:44.709515+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000329200.meta","create_time":"2024-08-17T02:27:32.084585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000329200"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000329200.data","create_time":"2024-08-17T02:27:32.953304+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000329200"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/285178879":"2024-08-18T02:29:41.592570+0000","172.21.15.6:6833/285178879":"2024-08-18T02:29:41.592570+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.104+0000 7f4f51600640 1 -- 172.21.15.6:0/888487887 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4f28065150 msgr2=0x7f4f28067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.104+0000 7f4f51600640 1 --2- 172.21.15.6:0/888487887 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4f28065150 0x7f4f28067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4f340011e0 tx=0x7f4f34001a50 comp rx=0 tx=0).stop 2024-08-17T02:29:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.104+0000 7f4f51600640 1 -- 172.21.15.6:0/888487887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4c0ad790 msgr2=0x7f4f4c152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.104+0000 7f4f51600640 1 --2- 172.21.15.6:0/888487887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4c0ad790 0x7f4f4c152170 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009850 tx=0x7f4f3c032000 comp rx=0 tx=0).stop 2024-08-17T02:29:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.104+0000 7f4f51600640 1 -- 172.21.15.6:0/888487887 shutdown_connections 2024-08-17T02:29:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.104+0000 7f4f51600640 1 --2- 172.21.15.6:0/888487887 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4f28065150 0x7f4f28067600 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.104+0000 7f4f51600640 1 --2- 172.21.15.6:0/888487887 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f4c1559e0 0x7f4f4c069780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.104+0000 7f4f51600640 1 --2- 172.21.15.6:0/888487887 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f4c0c9d20 0x7f4f4c14b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.104+0000 7f4f51600640 1 --2- 172.21.15.6:0/888487887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4c0ad790 0x7f4f4c152170 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.104+0000 7f4f51600640 1 -- 172.21.15.6:0/888487887 >> 172.21.15.6:0/888487887 conn(0x7f4f4c062af0 msgr2=0x7f4f4c0a9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.104+0000 7f4f51600640 1 -- 172.21.15.6:0/888487887 shutdown_connections 2024-08-17T02:29:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.104+0000 7f4f51600640 1 -- 172.21.15.6:0/888487887 wait complete. 2024-08-17T02:29:45.120 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:25.463503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000329200.meta', 'create_time': '2024-08-17T02:27:32.084585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000329200'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000329200.data', 'create_time': '2024-08-17T02:27:32.953304+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000329200'}}}] 2024-08-17T02:29:45.120 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.275+0000 7f89cfa00640 1 Processor -- start 2024-08-17T02:29:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.275+0000 7f89cfa00640 1 -- start start 2024-08-17T02:29:45.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.276+0000 7f89cfa00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89c80b1280 0x7f89c80c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.276+0000 7f89cfa00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f89c80adf90 0x7f89c80ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.276+0000 7f89cfa00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c80ac040 con 0x7f89c8156bd0 2024-08-17T02:29:45.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.276+0000 7f89cfa00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c8067810 con 0x7f89c80b1280 2024-08-17T02:29:45.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.276+0000 7f89cfa00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c80ab150 con 0x7f89c80adf90 2024-08-17T02:29:45.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.276+0000 7f89c7e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89c80b1280 0x7f89c80c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.276+0000 7f89c7e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89c80b1280 0x7f89c80c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40616/0 (socket says 172.21.15.6:40616) 2024-08-17T02:29:45.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.276+0000 7f89c7e00640 1 -- 172.21.15.6:0/179368948 learned_addr learned my addr 172.21.15.6:0/179368948 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:45.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.277+0000 7f89cda00640 1 --2- 172.21.15.6:0/179368948 >> v2:172.21.15.136:3300/0 conn(0x7f89c80adf90 0x7f89c80ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.277+0000 7f89c7e00640 1 -- 172.21.15.6:0/179368948 >> v2:172.21.15.136:3300/0 conn(0x7f89c80adf90 msgr2=0x7f89c80ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:45.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.277+0000 7f89c7e00640 1 --2- 172.21.15.6:0/179368948 >> v2:172.21.15.136:3300/0 conn(0x7f89c80adf90 0x7f89c80ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.277+0000 7f89c7e00640 1 -- 172.21.15.6:0/179368948 >> v1:172.21.15.136:6789/0 conn(0x7f89c8156bd0 legacy=0x7f89c80b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:45.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.277+0000 7f89c7e00640 1 -- 172.21.15.6:0/179368948 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c80ab430 con 0x7f89c80b1280 2024-08-17T02:29:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.278+0000 7f89c7e00640 1 --2- 172.21.15.6:0/179368948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c80b1280 0x7f89c80c9ee0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f89c806b9c0 tx=0x7f89b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a851495242299d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.278+0000 7f89c7400640 1 -- 172.21.15.6:0/179368948 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b402add0 con 0x7f89c80b1280 2024-08-17T02:29:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.278+0000 7f89c7400640 1 -- 172.21.15.6:0/179368948 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b4032440 con 0x7f89c80b1280 2024-08-17T02:29:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.278+0000 7f89c7400640 1 -- 172.21.15.6:0/179368948 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4032820 con 0x7f89c80b1280 2024-08-17T02:29:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.279+0000 7f89cfa00640 1 -- 172.21.15.6:0/179368948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c80b1280 msgr2=0x7f89c80c9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.279+0000 7f89cfa00640 1 --2- 172.21.15.6:0/179368948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c80b1280 0x7f89c80c9ee0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f89c806b9c0 tx=0x7f89b40091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.279+0000 7f89cfa00640 1 -- 172.21.15.6:0/179368948 shutdown_connections 2024-08-17T02:29:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.279+0000 7f89cfa00640 1 --2- 172.21.15.6:0/179368948 >> v2:172.21.15.136:3300/0 conn(0x7f89c80adf90 0x7f89c80ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.279+0000 7f89cfa00640 1 --2- 172.21.15.6:0/179368948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c80b1280 0x7f89c80c9ee0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.279+0000 7f89cfa00640 1 -- 172.21.15.6:0/179368948 >> 172.21.15.6:0/179368948 conn(0x7f89c80cc390 msgr2=0x7f89c8066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.279+0000 7f89cfa00640 1 -- 172.21.15.6:0/179368948 shutdown_connections 2024-08-17T02:29:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.279+0000 7f89cfa00640 1 -- 172.21.15.6:0/179368948 wait complete. 2024-08-17T02:29:45.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.280+0000 7f89cfa00640 1 Processor -- start 2024-08-17T02:29:45.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.280+0000 7f89cfa00640 1 -- start start 2024-08-17T02:29:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.281+0000 7f89cfa00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f89c80adf90 0x7f89c815c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.281+0000 7f89cfa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c80b1280 0x7f89c813faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.281+0000 7f89cfa00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f89c8156bd0 0x7f89c816c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.281+0000 7f89cfa00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c816a070 con 0x7f89c80b1280 2024-08-17T02:29:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.281+0000 7f89cfa00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c80af6a0 con 0x7f89c80adf90 2024-08-17T02:29:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.281+0000 7f89cfa00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c80af980 con 0x7f89c8156bd0 2024-08-17T02:29:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.282+0000 7f89c7e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c80b1280 0x7f89c813faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.282+0000 7f89c7e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c80b1280 0x7f89c813faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40624/0 (socket says 172.21.15.6:40624) 2024-08-17T02:29:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.282+0000 7f89c7e00640 1 -- 172.21.15.6:0/1980956970 learned_addr learned my addr 172.21.15.6:0/1980956970 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.282+0000 7f89c7e00640 1 -- 172.21.15.6:0/1980956970 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f89c8156bd0 msgr2=0x7f89c816c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.282+0000 7f89cda00640 1 --2- 172.21.15.6:0/1980956970 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f89c8156bd0 0x7f89c816c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.282+0000 7f89cd000640 1 --2- 172.21.15.6:0/1980956970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f89c80adf90 0x7f89c815c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.282+0000 7f89c7e00640 1 --2- 172.21.15.6:0/1980956970 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f89c8156bd0 0x7f89c816c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.282+0000 7f89c7e00640 1 -- 172.21.15.6:0/1980956970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f89c80adf90 msgr2=0x7f89c815c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.282+0000 7f89c7e00640 1 --2- 172.21.15.6:0/1980956970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f89c80adf90 0x7f89c815c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.282+0000 7f89c7e00640 1 -- 172.21.15.6:0/1980956970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b4009450 con 0x7f89c80b1280 2024-08-17T02:29:45.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.282+0000 7f89cd000640 1 --2- 172.21.15.6:0/1980956970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f89c80adf90 0x7f89c815c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:45.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.283+0000 7f89c7e00640 1 --2- 172.21.15.6:0/1980956970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c80b1280 0x7f89c813faa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f89b4035040 tx=0x7f89b4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.283+0000 7f89bbe00640 1 -- 172.21.15.6:0/1980956970 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4031de0 con 0x7f89c80b1280 2024-08-17T02:29:45.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.283+0000 7f89bbe00640 1 -- 172.21.15.6:0/1980956970 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b4000c40 con 0x7f89c80b1280 2024-08-17T02:29:45.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.283+0000 7f89bbe00640 1 -- 172.21.15.6:0/1980956970 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b403d670 con 0x7f89c80b1280 2024-08-17T02:29:45.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.283+0000 7f89cfa00640 1 -- 172.21.15.6:0/1980956970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c80afc60 con 0x7f89c80b1280 2024-08-17T02:29:45.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.283+0000 7f89cfa00640 1 -- 172.21.15.6:0/1980956970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c80b0220 con 0x7f89c80b1280 2024-08-17T02:29:45.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.284+0000 7f89cfa00640 1 -- 172.21.15.6:0/1980956970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c816a370 con 0x7f89c80b1280 2024-08-17T02:29:45.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.285+0000 7f89bbe00640 1 -- 172.21.15.6:0/1980956970 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f89b4039040 con 0x7f89c80b1280 2024-08-17T02:29:45.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.286+0000 7f89bbe00640 1 --2- 172.21.15.6:0/1980956970 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f89a8065150 0x7f89a8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.286+0000 7f89bbe00640 1 -- 172.21.15.6:0/1980956970 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f89b40a24c0 con 0x7f89c80b1280 2024-08-17T02:29:45.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.286+0000 7f89cd000640 1 --2- 172.21.15.6:0/1980956970 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f89a8065150 0x7f89a8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.287+0000 7f89cd000640 1 --2- 172.21.15.6:0/1980956970 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f89a8065150 0x7f89a8067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f89c8146c10 tx=0x7f89bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.289+0000 7f89bbe00640 1 -- 172.21.15.6:0/1980956970 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f89c816a370 con 0x7f89c80b1280 2024-08-17T02:29:45.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.473+0000 7f89cfa00640 1 -- 172.21.15.6:0/1980956970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89c816a370 con 0x7f89c80b1280 2024-08-17T02:29:45.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.474+0000 7f89bbe00640 1 -- 172.21.15.6:0/1980956970 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89b4037020 con 0x7f89c80b1280 2024-08-17T02:29:45.475 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-08-17T02:29:45.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.476+0000 7f89cfa00640 1 -- 172.21.15.6:0/1980956970 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f89a8065150 msgr2=0x7f89a8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.476+0000 7f89cfa00640 1 --2- 172.21.15.6:0/1980956970 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f89a8065150 0x7f89a8067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f89c8146c10 tx=0x7f89bc008040 comp rx=0 tx=0).stop 2024-08-17T02:29:45.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.476+0000 7f89cfa00640 1 -- 172.21.15.6:0/1980956970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c80b1280 msgr2=0x7f89c813faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.476+0000 7f89cfa00640 1 --2- 172.21.15.6:0/1980956970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c80b1280 0x7f89c813faa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f89b4035040 tx=0x7f89b4032000 comp rx=0 tx=0).stop 2024-08-17T02:29:45.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.476+0000 7f89cfa00640 1 -- 172.21.15.6:0/1980956970 shutdown_connections 2024-08-17T02:29:45.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.476+0000 7f89cfa00640 1 --2- 172.21.15.6:0/1980956970 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f89a8065150 0x7f89a8067600 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.476+0000 7f89cfa00640 1 --2- 172.21.15.6:0/1980956970 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f89c8156bd0 0x7f89c816c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.476+0000 7f89cfa00640 1 --2- 172.21.15.6:0/1980956970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c80b1280 0x7f89c813faa0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.476+0000 7f89cfa00640 1 --2- 172.21.15.6:0/1980956970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f89c80adf90 0x7f89c815c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.476+0000 7f89cfa00640 1 -- 172.21.15.6:0/1980956970 >> 172.21.15.6:0/1980956970 conn(0x7f89c80cc390 msgr2=0x7f89c80ace70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:45.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.476+0000 7f89cfa00640 1 -- 172.21.15.6:0/1980956970 shutdown_connections 2024-08-17T02:29:45.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.476+0000 7f89cfa00640 1 -- 172.21.15.6:0/1980956970 wait complete. 2024-08-17T02:29:45.491 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000329200.meta pg_num 2024-08-17T02:29:45.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.646+0000 7fa06a200640 1 Processor -- start 2024-08-17T02:29:45.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.646+0000 7fa06a200640 1 -- start start 2024-08-17T02:29:45.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.647+0000 7fa06a200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa064158a40 0x7fa0640abe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.647+0000 7fa06a200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0640ac380 0x7fa0640af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.647+0000 7fa06a200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa0640af7e0 0x7fa0640aa620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.647+0000 7fa06a200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0640ac800 con 0x7fa0640ac380 2024-08-17T02:29:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.647+0000 7fa06a200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0640686f0 con 0x7fa064158a40 2024-08-17T02:29:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.647+0000 7fa06a200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640b0270 con 0x7fa0640af7e0 2024-08-17T02:29:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.647+0000 7fa063e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0640ac380 0x7fa0640af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.647+0000 7fa063e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0640ac380 0x7fa0640af2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40638/0 (socket says 172.21.15.6:40638) 2024-08-17T02:29:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.647+0000 7fa063e00640 1 -- 172.21.15.6:0/3141946483 learned_addr learned my addr 172.21.15.6:0/3141946483 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.647+0000 7fa069800640 1 --2- 172.21.15.6:0/3141946483 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa0640af7e0 0x7fa0640aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.647+0000 7fa068e00640 1 --2- 172.21.15.6:0/3141946483 >> v2:172.21.15.136:3300/0 conn(0x7fa064158a40 0x7fa0640abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.648+0000 7fa063e00640 1 -- 172.21.15.6:0/3141946483 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa0640af7e0 msgr2=0x7fa0640aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.648+0000 7fa063e00640 1 --2- 172.21.15.6:0/3141946483 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa0640af7e0 0x7fa0640aa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.648+0000 7fa063e00640 1 -- 172.21.15.6:0/3141946483 >> v2:172.21.15.136:3300/0 conn(0x7fa064158a40 msgr2=0x7fa0640abe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.648+0000 7fa063e00640 1 --2- 172.21.15.6:0/3141946483 >> v2:172.21.15.136:3300/0 conn(0x7fa064158a40 0x7fa0640abe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.648+0000 7fa063e00640 1 -- 172.21.15.6:0/3141946483 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0640aff90 con 0x7fa0640ac380 2024-08-17T02:29:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.649+0000 7fa063e00640 1 --2- 172.21.15.6:0/3141946483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0640ac380 0x7fa0640af2a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa0640710f0 tx=0x7fa0500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee27780f09dc27c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.649+0000 7fa063400640 1 -- 172.21.15.6:0/3141946483 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05002ad40 con 0x7fa0640ac380 2024-08-17T02:29:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.649+0000 7fa063400640 1 -- 172.21.15.6:0/3141946483 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa050032440 con 0x7fa0640ac380 2024-08-17T02:29:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.649+0000 7fa063400640 1 -- 172.21.15.6:0/3141946483 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05002aea0 con 0x7fa0640ac380 2024-08-17T02:29:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.650+0000 7fa06a200640 1 -- 172.21.15.6:0/3141946483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0640ac380 msgr2=0x7fa0640af2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.650+0000 7fa06a200640 1 --2- 172.21.15.6:0/3141946483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0640ac380 0x7fa0640af2a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa0640710f0 tx=0x7fa0500091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.650+0000 7fa06a200640 1 -- 172.21.15.6:0/3141946483 shutdown_connections 2024-08-17T02:29:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.650+0000 7fa06a200640 1 --2- 172.21.15.6:0/3141946483 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa0640af7e0 0x7fa0640aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.650+0000 7fa06a200640 1 --2- 172.21.15.6:0/3141946483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0640ac380 0x7fa0640af2a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.650+0000 7fa06a200640 1 --2- 172.21.15.6:0/3141946483 >> v2:172.21.15.136:3300/0 conn(0x7fa064158a40 0x7fa0640abe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.650+0000 7fa06a200640 1 -- 172.21.15.6:0/3141946483 >> 172.21.15.6:0/3141946483 conn(0x7fa0640ce400 msgr2=0x7fa064095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.650+0000 7fa06a200640 1 -- 172.21.15.6:0/3141946483 shutdown_connections 2024-08-17T02:29:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.650+0000 7fa06a200640 1 -- 172.21.15.6:0/3141946483 wait complete. 2024-08-17T02:29:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.651+0000 7fa06a200640 1 Processor -- start 2024-08-17T02:29:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.651+0000 7fa06a200640 1 -- start start 2024-08-17T02:29:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.652+0000 7fa06a200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0640ac380 0x7fa0640b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.652+0000 7fa06a200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa0640af7e0 0x7fa0641685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.652+0000 7fa06a200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa064158a40 0x7fa064168b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.652+0000 7fa06a200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06415b440 con 0x7fa064158a40 2024-08-17T02:29:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.652+0000 7fa06a200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640b2090 con 0x7fa0640ac380 2024-08-17T02:29:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.652+0000 7fa06a200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640b1ad0 con 0x7fa0640af7e0 2024-08-17T02:29:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.653+0000 7fa069800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa064158a40 0x7fa064168b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.653+0000 7fa068e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0640ac380 0x7fa0640b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.653+0000 7fa069800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa064158a40 0x7fa064168b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40642/0 (socket says 172.21.15.6:40642) 2024-08-17T02:29:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.653+0000 7fa069800640 1 -- 172.21.15.6:0/1254871770 learned_addr learned my addr 172.21.15.6:0/1254871770 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.653+0000 7fa063e00640 1 --2- 172.21.15.6:0/1254871770 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa0640af7e0 0x7fa0641685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.653+0000 7fa068e00640 1 -- 172.21.15.6:0/1254871770 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa0640af7e0 msgr2=0x7fa0641685e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.653+0000 7fa068e00640 1 --2- 172.21.15.6:0/1254871770 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa0640af7e0 0x7fa0641685e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.653+0000 7fa068e00640 1 -- 172.21.15.6:0/1254871770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa064158a40 msgr2=0x7fa064168b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.653+0000 7fa068e00640 1 --2- 172.21.15.6:0/1254871770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa064158a40 0x7fa064168b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.653+0000 7fa068e00640 1 -- 172.21.15.6:0/1254871770 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa050009450 con 0x7fa0640ac380 2024-08-17T02:29:45.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.653+0000 7fa069800640 1 --2- 172.21.15.6:0/1254871770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa064158a40 0x7fa064168b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:45.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.653+0000 7fa068e00640 1 --2- 172.21.15.6:0/1254871770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0640ac380 0x7fa0640b1160 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa05800e960 tx=0x7fa0580090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.654+0000 7fa057e00640 1 -- 172.21.15.6:0/1254871770 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05800c940 con 0x7fa0640ac380 2024-08-17T02:29:45.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.654+0000 7fa057e00640 1 -- 172.21.15.6:0/1254871770 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05800caa0 con 0x7fa0640ac380 2024-08-17T02:29:45.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.654+0000 7fa057e00640 1 -- 172.21.15.6:0/1254871770 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05800ce20 con 0x7fa0640ac380 2024-08-17T02:29:45.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.654+0000 7fa06a200640 1 -- 172.21.15.6:0/1254871770 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0640b1db0 con 0x7fa0640ac380 2024-08-17T02:29:45.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.654+0000 7fa06a200640 1 -- 172.21.15.6:0/1254871770 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa064154d30 con 0x7fa0640ac380 2024-08-17T02:29:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.655+0000 7fa06a200640 1 -- 172.21.15.6:0/1254871770 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa064169de0 con 0x7fa0640ac380 2024-08-17T02:29:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.656+0000 7fa057e00640 1 -- 172.21.15.6:0/1254871770 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa058013680 con 0x7fa0640ac380 2024-08-17T02:29:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.657+0000 7fa057e00640 1 --2- 172.21.15.6:0/1254871770 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa044065150 0x7fa044067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.657+0000 7fa057e00640 1 -- 172.21.15.6:0/1254871770 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fa058082700 con 0x7fa0640ac380 2024-08-17T02:29:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.657+0000 7fa063e00640 1 --2- 172.21.15.6:0/1254871770 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa044065150 0x7fa044067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.658+0000 7fa063e00640 1 --2- 172.21.15.6:0/1254871770 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa044065150 0x7fa044067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa050034000 tx=0x7fa050032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.663+0000 7fa057e00640 1 -- 172.21.15.6:0/1254871770 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa058050750 con 0x7fa0640ac380 2024-08-17T02:29:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.845+0000 7fa06a200640 1 -- 172.21.15.6:0/1254871770 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000329200.meta", "var": "pg_num"} v 0) v1 -- 0x7fa064070720 con 0x7fa0640ac380 2024-08-17T02:29:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.846+0000 7fa057e00640 1 -- 172.21.15.6:0/1254871770 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000329200.meta", "var": "pg_num"}]=0 v40) v1 ==== 124+0+11 (secure 0 0 0) 0x7fa058053d70 con 0x7fa0640ac380 2024-08-17T02:29:45.846 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-08-17T02:29:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.848+0000 7fa06a200640 1 -- 172.21.15.6:0/1254871770 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa044065150 msgr2=0x7fa044067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.848+0000 7fa06a200640 1 --2- 172.21.15.6:0/1254871770 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa044065150 0x7fa044067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa050034000 tx=0x7fa050032000 comp rx=0 tx=0).stop 2024-08-17T02:29:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.848+0000 7fa06a200640 1 -- 172.21.15.6:0/1254871770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0640ac380 msgr2=0x7fa0640b1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.848+0000 7fa06a200640 1 --2- 172.21.15.6:0/1254871770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0640ac380 0x7fa0640b1160 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa05800e960 tx=0x7fa0580090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.848+0000 7fa06a200640 1 -- 172.21.15.6:0/1254871770 shutdown_connections 2024-08-17T02:29:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.848+0000 7fa06a200640 1 --2- 172.21.15.6:0/1254871770 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fa044065150 0x7fa044067600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.848+0000 7fa06a200640 1 --2- 172.21.15.6:0/1254871770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa064158a40 0x7fa064168b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.848+0000 7fa06a200640 1 --2- 172.21.15.6:0/1254871770 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa0640af7e0 0x7fa0641685e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.848+0000 7fa06a200640 1 --2- 172.21.15.6:0/1254871770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0640ac380 0x7fa0640b1160 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.848+0000 7fa06a200640 1 -- 172.21.15.6:0/1254871770 >> 172.21.15.6:0/1254871770 conn(0x7fa0640ce400 msgr2=0x7fa064095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.848+0000 7fa06a200640 1 -- 172.21.15.6:0/1254871770 shutdown_connections 2024-08-17T02:29:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:45.848+0000 7fa06a200640 1 -- 172.21.15.6:0/1254871770 wait complete. 2024-08-17T02:29:45.863 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000329200.data pg_num 2024-08-17T02:29:46.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.017+0000 7fac29800640 1 Processor -- start 2024-08-17T02:29:46.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.017+0000 7fac29800640 1 -- start start 2024-08-17T02:29:46.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.019+0000 7fac29800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fac240afca0 0x7fac240b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.019+0000 7fac29800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac240acf10 0x7fac24159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.019+0000 7fac29800640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2415a4e0 con 0x7fac241589a0 2024-08-17T02:29:46.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.019+0000 7fac29800640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac240b0980 con 0x7fac240afca0 2024-08-17T02:29:46.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.019+0000 7fac29800640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac240c92b0 con 0x7fac240acf10 2024-08-17T02:29:46.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.019+0000 7fac23400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fac241589a0 0x7fac2406d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39718/0 (socket says 172.21.15.6:39718) 2024-08-17T02:29:46.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.019+0000 7fac23400640 1 -- 172.21.15.6:0/3536135952 learned_addr learned my addr 172.21.15.6:0/3536135952 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.019+0000 7fac1a000640 1 --2- 172.21.15.6:0/3536135952 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac240acf10 0x7fac24159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.019+0000 7fac22a00640 1 --2- 172.21.15.6:0/3536135952 >> v2:172.21.15.136:3300/0 conn(0x7fac240afca0 0x7fac240b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac22000640 1 -- 172.21.15.6:0/3536135952 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138344700 0 0) 0x7fac1c001490 con 0x7fac241589a0 2024-08-17T02:29:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac22000640 1 -- 172.21.15.6:0/3536135952 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac080034e0 con 0x7fac241589a0 2024-08-17T02:29:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac22000640 1 -- 172.21.15.6:0/3536135952 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1913124099 0 0) 0x7fac080034e0 con 0x7fac241589a0 2024-08-17T02:29:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac22000640 1 -- 172.21.15.6:0/3536135952 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac240acf10 msgr2=0x7fac24159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac22000640 1 --2- 172.21.15.6:0/3536135952 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac240acf10 0x7fac24159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac22000640 1 -- 172.21.15.6:0/3536135952 >> v2:172.21.15.136:3300/0 conn(0x7fac240afca0 msgr2=0x7fac240b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac22000640 1 --2- 172.21.15.6:0/3536135952 >> v2:172.21.15.136:3300/0 conn(0x7fac240afca0 0x7fac240b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac22000640 1 -- 172.21.15.6:0/3536135952 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240ad480 con 0x7fac241589a0 2024-08-17T02:29:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac22000640 1 -- 172.21.15.6:0/3536135952 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7fac1c001980 con 0x7fac241589a0 2024-08-17T02:29:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac22a00640 1 --2- 172.21.15.6:0/3536135952 >> v2:172.21.15.136:3300/0 conn(0x7fac240afca0 0x7fac240b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac22000640 1 -- 172.21.15.6:0/3536135952 >> v1:172.21.15.6:6789/0 conn(0x7fac241589a0 legacy=0x7fac2406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac22000640 1 --2- 172.21.15.6:0/3536135952 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac08003a50 0x7fac08003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac22000640 1 --2- 172.21.15.6:0/3536135952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac08004780 0x7fac08004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac22000640 1 --2- 172.21.15.6:0/3536135952 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac08005130 0x7fac0800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac22000640 1 -- 172.21.15.6:0/3536135952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac240c92b0 con 0x7fac08004780 2024-08-17T02:29:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac22000640 1 -- 172.21.15.6:0/3536135952 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0800bf10 con 0x7fac08003a50 2024-08-17T02:29:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac22000640 1 -- 172.21.15.6:0/3536135952 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0800c0a0 con 0x7fac08005130 2024-08-17T02:29:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.020+0000 7fac1a000640 1 --2- 172.21.15.6:0/3536135952 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac240acf10 0x7fac24159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.021+0000 7fac22a00640 1 --2- 172.21.15.6:0/3536135952 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac08003a50 0x7fac08003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.021+0000 7fac1a000640 1 --2- 172.21.15.6:0/3536135952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac08004780 0x7fac08004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.021+0000 7fac23400640 1 --2- 172.21.15.6:0/3536135952 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac08005130 0x7fac0800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.021+0000 7fac22a00640 1 -- 172.21.15.6:0/3536135952 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac08005130 msgr2=0x7fac0800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:46.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.021+0000 7fac22a00640 1 --2- 172.21.15.6:0/3536135952 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac08005130 0x7fac0800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.021+0000 7fac22a00640 1 -- 172.21.15.6:0/3536135952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac08004780 msgr2=0x7fac08004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:46.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.021+0000 7fac22a00640 1 --2- 172.21.15.6:0/3536135952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac08004780 0x7fac08004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.021+0000 7fac22a00640 1 -- 172.21.15.6:0/3536135952 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac080034e0 con 0x7fac08003a50 2024-08-17T02:29:46.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.021+0000 7fac1a000640 1 --2- 172.21.15.6:0/3536135952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac08004780 0x7fac08004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:46.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.022+0000 7fac22a00640 1 --2- 172.21.15.6:0/3536135952 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac08003a50 0x7fac08003e60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fac14009d60 tx=0x7fac140090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=611cbbc4c6658028 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:46.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.022+0000 7fac22000640 1 -- 172.21.15.6:0/3536135952 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14031400 con 0x7fac08003a50 2024-08-17T02:29:46.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.022+0000 7fac22000640 1 -- 172.21.15.6:0/3536135952 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1402d050 con 0x7fac08003a50 2024-08-17T02:29:46.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.022+0000 7fac22000640 1 -- 172.21.15.6:0/3536135952 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14031770 con 0x7fac08003a50 2024-08-17T02:29:46.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.023+0000 7fac29800640 1 -- 172.21.15.6:0/3536135952 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac08003a50 msgr2=0x7fac08003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.023+0000 7fac29800640 1 --2- 172.21.15.6:0/3536135952 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac08003a50 0x7fac08003e60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fac14009d60 tx=0x7fac140090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.023+0000 7fac23400640 1 -- 172.21.15.6:0/3536135952 reap_dead start 2024-08-17T02:29:46.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.023+0000 7fac29800640 1 -- 172.21.15.6:0/3536135952 shutdown_connections 2024-08-17T02:29:46.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.023+0000 7fac29800640 1 -- 172.21.15.6:0/3536135952 >> 172.21.15.6:0/3536135952 conn(0x7fac24066e60 msgr2=0x7fac24067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:46.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.023+0000 7fac29800640 1 -- 172.21.15.6:0/3536135952 shutdown_connections 2024-08-17T02:29:46.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.023+0000 7fac29800640 1 -- 172.21.15.6:0/3536135952 wait complete. 2024-08-17T02:29:46.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.025+0000 7fac29800640 1 Processor -- start 2024-08-17T02:29:46.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.025+0000 7fac29800640 1 -- start start 2024-08-17T02:29:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.026+0000 7fac29800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac240c6a10 0x7fac24144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.026+0000 7fac29800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac240c4cd0 0x7fac24159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.026+0000 7fac29800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac240c6de0 0x7fac24159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.026+0000 7fac29800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac24148e90 con 0x7fac240c6a10 2024-08-17T02:29:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.026+0000 7fac29800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac24146910 con 0x7fac240c6de0 2024-08-17T02:29:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.026+0000 7fac29800640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac24146e70 con 0x7fac240c4cd0 2024-08-17T02:29:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.026+0000 7fac22a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac240c6a10 0x7fac24144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.026+0000 7fac22a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac240c6a10 0x7fac24144f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40662/0 (socket says 172.21.15.6:40662) 2024-08-17T02:29:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.026+0000 7fac22a00640 1 -- 172.21.15.6:0/2152467365 learned_addr learned my addr 172.21.15.6:0/2152467365 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.026+0000 7fac1a000640 1 --2- 172.21.15.6:0/2152467365 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac240c4cd0 0x7fac24159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.026+0000 7fac23400640 1 --2- 172.21.15.6:0/2152467365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac240c6de0 0x7fac24159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.026+0000 7fac22a00640 1 -- 172.21.15.6:0/2152467365 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac240c4cd0 msgr2=0x7fac24159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.026+0000 7fac22a00640 1 --2- 172.21.15.6:0/2152467365 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac240c4cd0 0x7fac24159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.026+0000 7fac22a00640 1 -- 172.21.15.6:0/2152467365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac240c6de0 msgr2=0x7fac24159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.026+0000 7fac22a00640 1 --2- 172.21.15.6:0/2152467365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac240c6de0 0x7fac24159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.026+0000 7fac22a00640 1 -- 172.21.15.6:0/2152467365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac24149600 con 0x7fac240c6a10 2024-08-17T02:29:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.026+0000 7fac23400640 1 --2- 172.21.15.6:0/2152467365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac240c6de0 0x7fac24159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.027+0000 7fac22a00640 1 --2- 172.21.15.6:0/2152467365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac240c6a10 0x7fac24144f40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fac14009d60 tx=0x7fac14035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.027+0000 7fac1aa00640 1 -- 172.21.15.6:0/2152467365 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1403b4f0 con 0x7fac240c6a10 2024-08-17T02:29:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.027+0000 7fac1aa00640 1 -- 172.21.15.6:0/2152467365 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac14040070 con 0x7fac240c6a10 2024-08-17T02:29:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.027+0000 7fac29800640 1 -- 172.21.15.6:0/2152467365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac24149080 con 0x7fac240c6a10 2024-08-17T02:29:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.027+0000 7fac1aa00640 1 -- 172.21.15.6:0/2152467365 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1403b8c0 con 0x7fac240c6a10 2024-08-17T02:29:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.027+0000 7fac29800640 1 -- 172.21.15.6:0/2152467365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac24145480 con 0x7fac240c6a10 2024-08-17T02:29:46.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.028+0000 7fac29800640 1 -- 172.21.15.6:0/2152467365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac24063fb0 con 0x7fac240c6a10 2024-08-17T02:29:46.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.029+0000 7fac1aa00640 1 -- 172.21.15.6:0/2152467365 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fac14042030 con 0x7fac240c6a10 2024-08-17T02:29:46.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.030+0000 7fac1aa00640 1 --2- 172.21.15.6:0/2152467365 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fac00065150 0x7fac00067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.030+0000 7fac1aa00640 1 -- 172.21.15.6:0/2152467365 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fac140a34f0 con 0x7fac240c6a10 2024-08-17T02:29:46.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.030+0000 7fac1a000640 1 --2- 172.21.15.6:0/2152467365 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fac00065150 0x7fac00067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.031+0000 7fac1a000640 1 --2- 172.21.15.6:0/2152467365 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fac00065150 0x7fac00067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac2416c930 tx=0x7fac0c0090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:46.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.034+0000 7fac1aa00640 1 -- 172.21.15.6:0/2152467365 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fac14071490 con 0x7fac240c6a10 2024-08-17T02:29:46.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.213+0000 7fac29800640 1 -- 172.21.15.6:0/2152467365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000329200.data", "var": "pg_num"} v 0) v1 -- 0x7fac24067b70 con 0x7fac240c6a10 2024-08-17T02:29:46.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.213+0000 7fac1aa00640 1 -- 172.21.15.6:0/2152467365 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000329200.data", "var": "pg_num"}]=0 v40) v1 ==== 124+0+11 (secure 0 0 0) 0x7fac14074ab0 con 0x7fac240c6a10 2024-08-17T02:29:46.214 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-08-17T02:29:46.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.215+0000 7fac29800640 1 -- 172.21.15.6:0/2152467365 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fac00065150 msgr2=0x7fac00067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.215+0000 7fac29800640 1 --2- 172.21.15.6:0/2152467365 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fac00065150 0x7fac00067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac2416c930 tx=0x7fac0c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.215+0000 7fac29800640 1 -- 172.21.15.6:0/2152467365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac240c6a10 msgr2=0x7fac24144f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.215+0000 7fac29800640 1 --2- 172.21.15.6:0/2152467365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac240c6a10 0x7fac24144f40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fac14009d60 tx=0x7fac14035000 comp rx=0 tx=0).stop 2024-08-17T02:29:46.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.215+0000 7fac29800640 1 -- 172.21.15.6:0/2152467365 shutdown_connections 2024-08-17T02:29:46.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.215+0000 7fac29800640 1 --2- 172.21.15.6:0/2152467365 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fac00065150 0x7fac00067600 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.215+0000 7fac29800640 1 --2- 172.21.15.6:0/2152467365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac240c6de0 0x7fac24159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.215+0000 7fac29800640 1 --2- 172.21.15.6:0/2152467365 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac240c4cd0 0x7fac24159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.215+0000 7fac29800640 1 --2- 172.21.15.6:0/2152467365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac240c6a10 0x7fac24144f40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.215+0000 7fac29800640 1 -- 172.21.15.6:0/2152467365 >> 172.21.15.6:0/2152467365 conn(0x7fac24066e60 msgr2=0x7fac240cac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:46.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.216+0000 7fac29800640 1 -- 172.21.15.6:0/2152467365 shutdown_connections 2024-08-17T02:29:46.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.216+0000 7fac29800640 1 -- 172.21.15.6:0/2152467365 wait complete. 2024-08-17T02:29:46.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:46.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.381+0000 7f927a400640 1 Processor -- start 2024-08-17T02:29:46.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.381+0000 7f927a400640 1 -- start start 2024-08-17T02:29:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.382+0000 7f927a400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f92740afca0 0x7f92740b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.382+0000 7f927a400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92740acf10 0x7f9274159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.382+0000 7f927a400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92741589a0 0x7f9274158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.382+0000 7f927a400640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92740b0980 con 0x7f92741589a0 2024-08-17T02:29:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.383+0000 7f927a400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927415a4e0 con 0x7f92740afca0 2024-08-17T02:29:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.383+0000 7f927a400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92740c92b0 con 0x7f92740acf10 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.383+0000 7f9273e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92741589a0 0x7f9274158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.383+0000 7f9273e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92741589a0 0x7f9274158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40676/0 (socket says 172.21.15.6:40676) 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.383+0000 7f9273e00640 1 -- 172.21.15.6:0/795971929 learned_addr learned my addr 172.21.15.6:0/795971929 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.383+0000 7f926be00640 1 --2- 172.21.15.6:0/795971929 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92740acf10 0x7f9274159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.383+0000 7f9273400640 1 --2- 172.21.15.6:0/795971929 >> v2:172.21.15.136:3300/0 conn(0x7f92740afca0 0x7f92740b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.383+0000 7f9273e00640 1 -- 172.21.15.6:0/795971929 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92740acf10 msgr2=0x7f9274159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.383+0000 7f9273e00640 1 --2- 172.21.15.6:0/795971929 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92740acf10 0x7f9274159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.383+0000 7f9273e00640 1 -- 172.21.15.6:0/795971929 >> v2:172.21.15.136:3300/0 conn(0x7f92740afca0 msgr2=0x7f92740b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.383+0000 7f9273e00640 1 --2- 172.21.15.6:0/795971929 >> v2:172.21.15.136:3300/0 conn(0x7f92740afca0 0x7f92740b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.383+0000 7f9273e00640 1 -- 172.21.15.6:0/795971929 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9274159360 con 0x7f92741589a0 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.383+0000 7f926be00640 1 --2- 172.21.15.6:0/795971929 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92740acf10 0x7f9274159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.383+0000 7f9273400640 1 --2- 172.21.15.6:0/795971929 >> v2:172.21.15.136:3300/0 conn(0x7f92740afca0 0x7f92740b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.384+0000 7f9273e00640 1 --2- 172.21.15.6:0/795971929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92741589a0 0x7f9274158e20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f926c009f20 tx=0x7f926c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7313850c40bc1cc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.385+0000 7f9272a00640 1 -- 172.21.15.6:0/795971929 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c031400 con 0x7f92741589a0 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.385+0000 7f9272a00640 1 -- 172.21.15.6:0/795971929 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926c02d050 con 0x7f92741589a0 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.385+0000 7f9272a00640 1 -- 172.21.15.6:0/795971929 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c0317d0 con 0x7f92741589a0 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.385+0000 7f927a400640 1 -- 172.21.15.6:0/795971929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92741589a0 msgr2=0x7f9274158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.385+0000 7f927a400640 1 --2- 172.21.15.6:0/795971929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92741589a0 0x7f9274158e20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f926c009f20 tx=0x7f926c009840 comp rx=0 tx=0).stop 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.385+0000 7f927a400640 1 -- 172.21.15.6:0/795971929 shutdown_connections 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.385+0000 7f927a400640 1 --2- 172.21.15.6:0/795971929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92741589a0 0x7f9274158e20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.385+0000 7f927a400640 1 --2- 172.21.15.6:0/795971929 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92740acf10 0x7f9274159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.385+0000 7f927a400640 1 --2- 172.21.15.6:0/795971929 >> v2:172.21.15.136:3300/0 conn(0x7f92740afca0 0x7f92740b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.385+0000 7f927a400640 1 -- 172.21.15.6:0/795971929 >> 172.21.15.6:0/795971929 conn(0x7f9274066e60 msgr2=0x7f9274067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.385+0000 7f927a400640 1 -- 172.21.15.6:0/795971929 shutdown_connections 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.385+0000 7f927a400640 1 -- 172.21.15.6:0/795971929 wait complete. 2024-08-17T02:29:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.387+0000 7f927a400640 1 Processor -- start 2024-08-17T02:29:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.387+0000 7f927a400640 1 -- start start 2024-08-17T02:29:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.388+0000 7f927a400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92740acf10 0x7f9274155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.388+0000 7f927a400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92740afca0 0x7f927414a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.388+0000 7f927a400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92741589a0 0x7f927406dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.388+0000 7f927a400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9274155a80 con 0x7f92740afca0 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.388+0000 7f927a400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9274168d10 con 0x7f92741589a0 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.388+0000 7f927a400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92740a5340 con 0x7f92740acf10 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.388+0000 7f926be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92740afca0 0x7f927414a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.388+0000 7f926be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92740afca0 0x7f927414a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40690/0 (socket says 172.21.15.6:40690) 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.388+0000 7f926be00640 1 -- 172.21.15.6:0/2297376317 learned_addr learned my addr 172.21.15.6:0/2297376317 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.388+0000 7f9273e00640 1 --2- 172.21.15.6:0/2297376317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92741589a0 0x7f927406dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.388+0000 7f9273400640 1 --2- 172.21.15.6:0/2297376317 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92740acf10 0x7f9274155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.389+0000 7f926be00640 1 -- 172.21.15.6:0/2297376317 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92740acf10 msgr2=0x7f9274155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.389+0000 7f926be00640 1 --2- 172.21.15.6:0/2297376317 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92740acf10 0x7f9274155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.389+0000 7f926be00640 1 -- 172.21.15.6:0/2297376317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92741589a0 msgr2=0x7f927406dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.389+0000 7f926be00640 1 --2- 172.21.15.6:0/2297376317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92741589a0 0x7f927406dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.389+0000 7f926be00640 1 -- 172.21.15.6:0/2297376317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c009ae0 con 0x7f92740afca0 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.389+0000 7f9273e00640 1 --2- 172.21.15.6:0/2297376317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92741589a0 0x7f927406dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:46.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.389+0000 7f926be00640 1 --2- 172.21.15.6:0/2297376317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92740afca0 0x7f927414a360 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f925c00d810 tx=0x7f925c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:46.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.389+0000 7f926aa00640 1 -- 172.21.15.6:0/2297376317 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c00de00 con 0x7f92740afca0 2024-08-17T02:29:46.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.389+0000 7f926aa00640 1 -- 172.21.15.6:0/2297376317 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c0098b0 con 0x7f92740afca0 2024-08-17T02:29:46.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.389+0000 7f927a400640 1 -- 172.21.15.6:0/2297376317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9274155c90 con 0x7f92740afca0 2024-08-17T02:29:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.389+0000 7f926aa00640 1 -- 172.21.15.6:0/2297376317 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c009c70 con 0x7f92740afca0 2024-08-17T02:29:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.389+0000 7f927a400640 1 -- 172.21.15.6:0/2297376317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9274156250 con 0x7f92740afca0 2024-08-17T02:29:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.391+0000 7f927a400640 1 -- 172.21.15.6:0/2297376317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9274168ea0 con 0x7f92740afca0 2024-08-17T02:29:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.391+0000 7f926aa00640 1 -- 172.21.15.6:0/2297376317 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f925c014640 con 0x7f92740afca0 2024-08-17T02:29:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.392+0000 7f926aa00640 1 --2- 172.21.15.6:0/2297376317 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9250065150 0x7f9250067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.393+0000 7f926aa00640 1 -- 172.21.15.6:0/2297376317 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f925c082900 con 0x7f92740afca0 2024-08-17T02:29:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.393+0000 7f9273400640 1 --2- 172.21.15.6:0/2297376317 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9250065150 0x7f9250067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.394+0000 7f9273400640 1 --2- 172.21.15.6:0/2297376317 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9250065150 0x7f9250067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f926400bac0 tx=0x7f9264008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:46.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.396+0000 7f926aa00640 1 -- 172.21.15.6:0/2297376317 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f925c054490 con 0x7f92740afca0 2024-08-17T02:29:46.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.614+0000 7f927a400640 1 -- 172.21.15.6:0/2297376317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9274168b40 con 0x7f92740afca0 2024-08-17T02:29:46.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.615+0000 7f926aa00640 1 -- 172.21.15.6:0/2297376317 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4615 (secure 0 0 0) 0x7f925c054020 con 0x7f92740afca0 2024-08-17T02:29:46.616 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:46.616 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/4280185456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":4280185456},{"type":"v1","addr":"172.21.15.136:6836","nonce":4280185456}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2517061869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":2517061869},{"type":"v1","addr":"172.21.15.136:6837","nonce":2517061869}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2625056728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2625056728},{"type":"v1","addr":"172.21.15.6:6835","nonce":2625056728}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:33.919463+0000","modified":"2024-08-17T02:27:35.926590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4935":{"gid":4935,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.6:6834/2620799775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2620799775},{"type":"v1","addr":"172.21.15.6:6834","nonce":2620799775}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000329200","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:46.617 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-08-17T02:29:46.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.617+0000 7f927a400640 1 -- 172.21.15.6:0/2297376317 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9250065150 msgr2=0x7f9250067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.617+0000 7f927a400640 1 --2- 172.21.15.6:0/2297376317 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9250065150 0x7f9250067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f926400bac0 tx=0x7f9264008040 comp rx=0 tx=0).stop 2024-08-17T02:29:46.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.617+0000 7f927a400640 1 -- 172.21.15.6:0/2297376317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92740afca0 msgr2=0x7f927414a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.617+0000 7f927a400640 1 --2- 172.21.15.6:0/2297376317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92740afca0 0x7f927414a360 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f925c00d810 tx=0x7f925c008040 comp rx=0 tx=0).stop 2024-08-17T02:29:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.617+0000 7f927a400640 1 -- 172.21.15.6:0/2297376317 shutdown_connections 2024-08-17T02:29:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.617+0000 7f927a400640 1 --2- 172.21.15.6:0/2297376317 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9250065150 0x7f9250067600 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.617+0000 7f927a400640 1 --2- 172.21.15.6:0/2297376317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92741589a0 0x7f927406dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.617+0000 7f927a400640 1 --2- 172.21.15.6:0/2297376317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92740afca0 0x7f927414a360 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.617+0000 7f927a400640 1 --2- 172.21.15.6:0/2297376317 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92740acf10 0x7f9274155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.617+0000 7f927a400640 1 -- 172.21.15.6:0/2297376317 >> 172.21.15.6:0/2297376317 conn(0x7f9274066e60 msgr2=0x7f9274154270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.617+0000 7f927a400640 1 -- 172.21.15.6:0/2297376317 shutdown_connections 2024-08-17T02:29:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.617+0000 7f927a400640 1 -- 172.21.15.6:0/2297376317 wait complete. 2024-08-17T02:29:46.633 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:46.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.785+0000 7ff09a000640 1 Processor -- start 2024-08-17T02:29:46.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.785+0000 7ff09a000640 1 -- start start 2024-08-17T02:29:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.786+0000 7ff09a000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff0940af1f0 0x7ff0940ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.786+0000 7ff09a000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff094069d40 0x7ff0940cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.786+0000 7ff09a000640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0940b14e0 con 0x7ff094159100 2024-08-17T02:29:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.786+0000 7ff09a000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff094069210 con 0x7ff0940af1f0 2024-08-17T02:29:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.786+0000 7ff09a000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940694f0 con 0x7ff094069d40 2024-08-17T02:29:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.786+0000 7ff093400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff094159100 0x7ff0940aeae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39722/0 (socket says 172.21.15.6:39722) 2024-08-17T02:29:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.786+0000 7ff093400640 1 -- 172.21.15.6:0/3244854300 learned_addr learned my addr 172.21.15.6:0/3244854300 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:46.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.787+0000 7ff092a00640 1 --2- 172.21.15.6:0/3244854300 >> v2:172.21.15.136:3300/0 conn(0x7ff0940af1f0 0x7ff0940ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.787+0000 7ff093e00640 1 --2- 172.21.15.6:0/3244854300 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff094069d40 0x7ff0940cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.787+0000 7ff092000640 1 -- 172.21.15.6:0/3244854300 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853874368 0 0) 0x7ff0940b14e0 con 0x7ff094159100 2024-08-17T02:29:46.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.787+0000 7ff092000640 1 -- 172.21.15.6:0/3244854300 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0780034e0 con 0x7ff094159100 2024-08-17T02:29:46.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.787+0000 7ff092000640 1 -- 172.21.15.6:0/3244854300 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2388238713 0 0) 0x7ff0780034e0 con 0x7ff094159100 2024-08-17T02:29:46.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.787+0000 7ff092000640 1 -- 172.21.15.6:0/3244854300 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff094069d40 msgr2=0x7ff0940cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:46.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.787+0000 7ff092000640 1 --2- 172.21.15.6:0/3244854300 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff094069d40 0x7ff0940cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.787+0000 7ff092000640 1 -- 172.21.15.6:0/3244854300 >> v2:172.21.15.136:3300/0 conn(0x7ff0940af1f0 msgr2=0x7ff0940ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:46.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.787+0000 7ff092000640 1 --2- 172.21.15.6:0/3244854300 >> v2:172.21.15.136:3300/0 conn(0x7ff0940af1f0 0x7ff0940ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.787+0000 7ff092000640 1 -- 172.21.15.6:0/3244854300 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0940697d0 con 0x7ff094159100 2024-08-17T02:29:46.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.787+0000 7ff092000640 1 -- 172.21.15.6:0/3244854300 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7ff084001470 con 0x7ff094159100 2024-08-17T02:29:46.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.787+0000 7ff092000640 1 -- 172.21.15.6:0/3244854300 >> v1:172.21.15.6:6789/0 conn(0x7ff094159100 legacy=0x7ff0940aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.787+0000 7ff092000640 1 --2- 172.21.15.6:0/3244854300 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff094069d40 0x7ff0780039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.788+0000 7ff092000640 1 --2- 172.21.15.6:0/3244854300 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff078003f50 0x7ff078004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.788+0000 7ff092000640 1 --2- 172.21.15.6:0/3244854300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff078004cc0 0x7ff078005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.788+0000 7ff092000640 1 -- 172.21.15.6:0/3244854300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff094069210 con 0x7ff078004cc0 2024-08-17T02:29:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.788+0000 7ff092000640 1 -- 172.21.15.6:0/3244854300 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940694f0 con 0x7ff078003f50 2024-08-17T02:29:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.788+0000 7ff092000640 1 -- 172.21.15.6:0/3244854300 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07800ba00 con 0x7ff094069d40 2024-08-17T02:29:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.788+0000 7ff093e00640 1 --2- 172.21.15.6:0/3244854300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff078004cc0 0x7ff078005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.788+0000 7ff092a00640 1 --2- 172.21.15.6:0/3244854300 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff078003f50 0x7ff078004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.788+0000 7ff093400640 1 --2- 172.21.15.6:0/3244854300 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff094069d40 0x7ff0780039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.788+0000 7ff093e00640 1 -- 172.21.15.6:0/3244854300 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff094069d40 msgr2=0x7ff0780039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.788+0000 7ff093e00640 1 --2- 172.21.15.6:0/3244854300 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff094069d40 0x7ff0780039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.788+0000 7ff093e00640 1 -- 172.21.15.6:0/3244854300 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff078003f50 msgr2=0x7ff078004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.788+0000 7ff093e00640 1 --2- 172.21.15.6:0/3244854300 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff078003f50 0x7ff078004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.788+0000 7ff093e00640 1 -- 172.21.15.6:0/3244854300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0780034e0 con 0x7ff078004cc0 2024-08-17T02:29:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.788+0000 7ff093400640 1 --2- 172.21.15.6:0/3244854300 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff094069d40 0x7ff0780039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.789+0000 7ff093e00640 1 --2- 172.21.15.6:0/3244854300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff078004cc0 0x7ff078005130 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff09406ba00 tx=0x7ff08c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b746294fe192912 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.789+0000 7ff092000640 1 -- 172.21.15.6:0/3244854300 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c031420 con 0x7ff078004cc0 2024-08-17T02:29:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.789+0000 7ff092000640 1 -- 172.21.15.6:0/3244854300 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c00f040 con 0x7ff078004cc0 2024-08-17T02:29:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.790+0000 7ff092000640 1 -- 172.21.15.6:0/3244854300 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c0317b0 con 0x7ff078004cc0 2024-08-17T02:29:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.790+0000 7ff09a000640 1 -- 172.21.15.6:0/3244854300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff078004cc0 msgr2=0x7ff078005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.790+0000 7ff09a000640 1 --2- 172.21.15.6:0/3244854300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff078004cc0 0x7ff078005130 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff09406ba00 tx=0x7ff08c00b040 comp rx=0 tx=0).stop 2024-08-17T02:29:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.790+0000 7ff093e00640 1 -- 172.21.15.6:0/3244854300 reap_dead start 2024-08-17T02:29:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.790+0000 7ff09a000640 1 -- 172.21.15.6:0/3244854300 shutdown_connections 2024-08-17T02:29:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.790+0000 7ff09a000640 1 -- 172.21.15.6:0/3244854300 >> 172.21.15.6:0/3244854300 conn(0x7ff0940ce5e0 msgr2=0x7ff094095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.790+0000 7ff09a000640 1 -- 172.21.15.6:0/3244854300 shutdown_connections 2024-08-17T02:29:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.790+0000 7ff09a000640 1 -- 172.21.15.6:0/3244854300 wait complete. 2024-08-17T02:29:46.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.792+0000 7ff09a000640 1 Processor -- start 2024-08-17T02:29:46.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.792+0000 7ff09a000640 1 -- start start 2024-08-17T02:29:46.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.793+0000 7ff09a000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff078004cc0 0x7ff0940cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.793+0000 7ff09a000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0940cd5f0 0x7ff09409a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.793+0000 7ff09a000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff09409a750 0x7ff094156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.793+0000 7ff09a000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09409abf0 con 0x7ff078004cc0 2024-08-17T02:29:46.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.793+0000 7ff09a000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09416a360 con 0x7ff09409a750 2024-08-17T02:29:46.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.793+0000 7ff09a000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff094156f30 con 0x7ff0940cd5f0 2024-08-17T02:29:46.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.793+0000 7ff093400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff078004cc0 0x7ff0940cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.793+0000 7ff093400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff078004cc0 0x7ff0940cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40712/0 (socket says 172.21.15.6:40712) 2024-08-17T02:29:46.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.793+0000 7ff093400640 1 -- 172.21.15.6:0/1632463687 learned_addr learned my addr 172.21.15.6:0/1632463687 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:46.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.793+0000 7ff092a00640 1 --2- 172.21.15.6:0/1632463687 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0940cd5f0 0x7ff09409a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.793+0000 7ff093e00640 1 --2- 172.21.15.6:0/1632463687 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff09409a750 0x7ff094156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.793+0000 7ff093400640 1 -- 172.21.15.6:0/1632463687 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0940cd5f0 msgr2=0x7ff09409a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.793+0000 7ff093400640 1 --2- 172.21.15.6:0/1632463687 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0940cd5f0 0x7ff09409a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.793+0000 7ff093400640 1 -- 172.21.15.6:0/1632463687 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff09409a750 msgr2=0x7ff094156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.793+0000 7ff093400640 1 --2- 172.21.15.6:0/1632463687 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff09409a750 0x7ff094156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.793+0000 7ff093400640 1 -- 172.21.15.6:0/1632463687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff094157210 con 0x7ff078004cc0 2024-08-17T02:29:46.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.794+0000 7ff093400640 1 --2- 172.21.15.6:0/1632463687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff078004cc0 0x7ff0940cd0b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff084000fd0 tx=0x7ff0940b1450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:46.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.794+0000 7ff08aa00640 1 -- 172.21.15.6:0/1632463687 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08400c8a0 con 0x7ff078004cc0 2024-08-17T02:29:46.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.794+0000 7ff08aa00640 1 -- 172.21.15.6:0/1632463687 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08400ca00 con 0x7ff078004cc0 2024-08-17T02:29:46.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.794+0000 7ff08aa00640 1 -- 172.21.15.6:0/1632463687 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08400cdc0 con 0x7ff078004cc0 2024-08-17T02:29:46.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.794+0000 7ff09a000640 1 -- 172.21.15.6:0/1632463687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0941574f0 con 0x7ff078004cc0 2024-08-17T02:29:46.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.794+0000 7ff09a000640 1 -- 172.21.15.6:0/1632463687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff094156740 con 0x7ff078004cc0 2024-08-17T02:29:46.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.795+0000 7ff09a000640 1 -- 172.21.15.6:0/1632463687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff094063fb0 con 0x7ff078004cc0 2024-08-17T02:29:46.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.796+0000 7ff08aa00640 1 -- 172.21.15.6:0/1632463687 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff084013630 con 0x7ff078004cc0 2024-08-17T02:29:46.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.797+0000 7ff08aa00640 1 --2- 172.21.15.6:0/1632463687 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff074065180 0x7ff074067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.797+0000 7ff08aa00640 1 -- 172.21.15.6:0/1632463687 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7ff0840822e0 con 0x7ff078004cc0 2024-08-17T02:29:46.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.797+0000 7ff092a00640 1 --2- 172.21.15.6:0/1632463687 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff074065180 0x7ff074067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.798+0000 7ff092a00640 1 --2- 172.21.15.6:0/1632463687 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff074065180 0x7ff074067630 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff080006e40 tx=0x7ff080008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:46.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.800+0000 7ff08aa00640 1 -- 172.21.15.6:0/1632463687 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff084050280 con 0x7ff078004cc0 2024-08-17T02:29:46.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.982+0000 7ff09a000640 1 -- 172.21.15.6:0/1632463687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0940b39a0 con 0x7ff078004cc0 2024-08-17T02:29:46.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.983+0000 7ff08aa00640 1 -- 172.21.15.6:0/1632463687 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15460 (secure 0 0 0) 0x7ff0840538a0 con 0x7ff078004cc0 2024-08-17T02:29:46.984 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:46.984 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:29:44.709515+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000329200.meta","create_time":"2024-08-17T02:27:32.084585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000329200"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000329200.data","create_time":"2024-08-17T02:27:32.953304+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000329200"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/285178879":"2024-08-18T02:29:41.592570+0000","172.21.15.6:6833/285178879":"2024-08-18T02:29:41.592570+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.985+0000 7ff09a000640 1 -- 172.21.15.6:0/1632463687 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff074065180 msgr2=0x7ff074067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.985+0000 7ff09a000640 1 --2- 172.21.15.6:0/1632463687 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff074065180 0x7ff074067630 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff080006e40 tx=0x7ff080008040 comp rx=0 tx=0).stop 2024-08-17T02:29:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.985+0000 7ff09a000640 1 -- 172.21.15.6:0/1632463687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff078004cc0 msgr2=0x7ff0940cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.985+0000 7ff09a000640 1 --2- 172.21.15.6:0/1632463687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff078004cc0 0x7ff0940cd0b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff084000fd0 tx=0x7ff0940b1450 comp rx=0 tx=0).stop 2024-08-17T02:29:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.985+0000 7ff09a000640 1 -- 172.21.15.6:0/1632463687 shutdown_connections 2024-08-17T02:29:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.985+0000 7ff09a000640 1 --2- 172.21.15.6:0/1632463687 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff074065180 0x7ff074067630 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.985+0000 7ff09a000640 1 --2- 172.21.15.6:0/1632463687 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff09409a750 0x7ff094156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.985+0000 7ff09a000640 1 --2- 172.21.15.6:0/1632463687 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0940cd5f0 0x7ff09409a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.985+0000 7ff09a000640 1 --2- 172.21.15.6:0/1632463687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff078004cc0 0x7ff0940cd0b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.985+0000 7ff09a000640 1 -- 172.21.15.6:0/1632463687 >> 172.21.15.6:0/1632463687 conn(0x7ff0940ce5e0 msgr2=0x7ff0940b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.985+0000 7ff09a000640 1 -- 172.21.15.6:0/1632463687 shutdown_connections 2024-08-17T02:29:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:46.985+0000 7ff09a000640 1 -- 172.21.15.6:0/1632463687 wait complete. 2024-08-17T02:29:47.001 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000329200 and related pools 2024-08-17T02:29:47.001 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:47.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.152+0000 7fd589600640 1 Processor -- start 2024-08-17T02:29:47.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.152+0000 7fd589600640 1 -- start start 2024-08-17T02:29:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.153+0000 7fd589600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5841590b0 0x7fd5840b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.153+0000 7fd589600640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5840c92b0 con 0x7fd5840afca0 2024-08-17T02:29:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.153+0000 7fd589600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5840ad480 con 0x7fd5840acf10 2024-08-17T02:29:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.153+0000 7fd589600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5840b0980 con 0x7fd5841590b0 2024-08-17T02:29:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.154+0000 7fd582a00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd5840afca0 0x7fd5841589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39728/0 (socket says 172.21.15.6:39728) 2024-08-17T02:29:47.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.154+0000 7fd582a00640 1 -- 172.21.15.6:0/638395663 learned_addr learned my addr 172.21.15.6:0/638395663 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:47.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.154+0000 7fd582000640 1 --2- 172.21.15.6:0/638395663 >> v2:172.21.15.6:3300/0 conn(0x7fd5841590b0 0x7fd5840b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.154+0000 7fd582000640 1 -- 172.21.15.6:0/638395663 >> v1:172.21.15.136:6789/0 conn(0x7fd5840acf10 legacy=0x7fd5840c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:47.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.154+0000 7fd582000640 1 -- 172.21.15.6:0/638395663 >> v1:172.21.15.6:6789/0 conn(0x7fd5840afca0 legacy=0x7fd5841589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.154+0000 7fd582000640 1 -- 172.21.15.6:0/638395663 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5840ad760 con 0x7fd5841590b0 2024-08-17T02:29:47.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.155+0000 7fd582000640 1 --2- 172.21.15.6:0/638395663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5841590b0 0x7fd5840b0070 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd570009850 tx=0x7fd5700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597eae77b1e73916 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.155+0000 7fd581600640 1 -- 172.21.15.6:0/638395663 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57002adb0 con 0x7fd5841590b0 2024-08-17T02:29:47.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.155+0000 7fd581600640 1 -- 172.21.15.6:0/638395663 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd570032440 con 0x7fd5841590b0 2024-08-17T02:29:47.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.155+0000 7fd581600640 1 -- 172.21.15.6:0/638395663 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570032820 con 0x7fd5841590b0 2024-08-17T02:29:47.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.156+0000 7fd589600640 1 -- 172.21.15.6:0/638395663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5841590b0 msgr2=0x7fd5840b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.156+0000 7fd589600640 1 --2- 172.21.15.6:0/638395663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5841590b0 0x7fd5840b0070 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd570009850 tx=0x7fd5700090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.156+0000 7fd589600640 1 -- 172.21.15.6:0/638395663 shutdown_connections 2024-08-17T02:29:47.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.156+0000 7fd589600640 1 --2- 172.21.15.6:0/638395663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5841590b0 0x7fd5840b0070 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.156+0000 7fd589600640 1 -- 172.21.15.6:0/638395663 >> 172.21.15.6:0/638395663 conn(0x7fd584066e60 msgr2=0x7fd584067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:47.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.156+0000 7fd589600640 1 -- 172.21.15.6:0/638395663 shutdown_connections 2024-08-17T02:29:47.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.156+0000 7fd589600640 1 -- 172.21.15.6:0/638395663 wait complete. 2024-08-17T02:29:47.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.158+0000 7fd589600640 1 Processor -- start 2024-08-17T02:29:47.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.158+0000 7fd589600640 1 -- start start 2024-08-17T02:29:47.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.158+0000 7fd589600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5840acf10 0x7fd5841402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.158+0000 7fd589600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5840afca0 0x7fd5841565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.158+0000 7fd589600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5841590b0 0x7fd584156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.159+0000 7fd589600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5840c1110 con 0x7fd5841590b0 2024-08-17T02:29:47.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.159+0000 7fd589600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd584165f50 con 0x7fd5840acf10 2024-08-17T02:29:47.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.159+0000 7fd589600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5840c07e0 con 0x7fd5840afca0 2024-08-17T02:29:47.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.159+0000 7fd583400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5841590b0 0x7fd584156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.159+0000 7fd583400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5841590b0 0x7fd584156ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40736/0 (socket says 172.21.15.6:40736) 2024-08-17T02:29:47.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.159+0000 7fd583400640 1 -- 172.21.15.6:0/1827509113 learned_addr learned my addr 172.21.15.6:0/1827509113 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:47.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.159+0000 7fd582a00640 1 --2- 172.21.15.6:0/1827509113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5840acf10 0x7fd5841402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.159+0000 7fd582000640 1 --2- 172.21.15.6:0/1827509113 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5840afca0 0x7fd5841565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.159+0000 7fd583400640 1 -- 172.21.15.6:0/1827509113 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5840afca0 msgr2=0x7fd5841565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.159+0000 7fd583400640 1 --2- 172.21.15.6:0/1827509113 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5840afca0 0x7fd5841565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.159+0000 7fd583400640 1 -- 172.21.15.6:0/1827509113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5840acf10 msgr2=0x7fd5841402f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.159+0000 7fd583400640 1 --2- 172.21.15.6:0/1827509113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5840acf10 0x7fd5841402f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.159+0000 7fd583400640 1 -- 172.21.15.6:0/1827509113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd570009390 con 0x7fd5841590b0 2024-08-17T02:29:47.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.159+0000 7fd582000640 1 --2- 172.21.15.6:0/1827509113 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5840afca0 0x7fd5841565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:47.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.160+0000 7fd583400640 1 --2- 172.21.15.6:0/1827509113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5841590b0 0x7fd584156ae0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00b7f0 tx=0x7fd57c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.160+0000 7fd57a000640 1 -- 172.21.15.6:0/1827509113 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c00c490 con 0x7fd5841590b0 2024-08-17T02:29:47.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.160+0000 7fd57a000640 1 -- 172.21.15.6:0/1827509113 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c00c5f0 con 0x7fd5841590b0 2024-08-17T02:29:47.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.160+0000 7fd57a000640 1 -- 172.21.15.6:0/1827509113 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c00c9f0 con 0x7fd5841590b0 2024-08-17T02:29:47.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.160+0000 7fd589600640 1 -- 172.21.15.6:0/1827509113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5840c0ac0 con 0x7fd5841590b0 2024-08-17T02:29:47.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.160+0000 7fd589600640 1 -- 172.21.15.6:0/1827509113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd584140830 con 0x7fd5841590b0 2024-08-17T02:29:47.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.161+0000 7fd589600640 1 -- 172.21.15.6:0/1827509113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5840c1280 con 0x7fd5841590b0 2024-08-17T02:29:47.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.162+0000 7fd57a000640 1 -- 172.21.15.6:0/1827509113 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd57c012070 con 0x7fd5841590b0 2024-08-17T02:29:47.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.163+0000 7fd57a000640 1 --2- 172.21.15.6:0/1827509113 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd564065150 0x7fd564067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.163+0000 7fd57a000640 1 -- 172.21.15.6:0/1827509113 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fd57c081e40 con 0x7fd5841590b0 2024-08-17T02:29:47.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.163+0000 7fd582a00640 1 --2- 172.21.15.6:0/1827509113 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd564065150 0x7fd564067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.164+0000 7fd582a00640 1 --2- 172.21.15.6:0/1827509113 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd564065150 0x7fd564067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd574007880 tx=0x7fd574007e20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.167+0000 7fd57a000640 1 -- 172.21.15.6:0/1827509113 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd57c04fe80 con 0x7fd5841590b0 2024-08-17T02:29:47.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.390+0000 7fd589600640 1 -- 172.21.15.6:0/1827509113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd584063fb0 con 0x7fd5841590b0 2024-08-17T02:29:47.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.391+0000 7fd57a000640 1 -- 172.21.15.6:0/1827509113 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4615 (secure 0 0 0) 0x7fd57c01a020 con 0x7fd5841590b0 2024-08-17T02:29:47.392 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:47.392 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/4280185456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":4280185456},{"type":"v1","addr":"172.21.15.136:6836","nonce":4280185456}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2517061869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":2517061869},{"type":"v1","addr":"172.21.15.136:6837","nonce":2517061869}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2625056728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2625056728},{"type":"v1","addr":"172.21.15.6:6835","nonce":2625056728}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:33.919463+0000","modified":"2024-08-17T02:27:35.926590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4935":{"gid":4935,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.6:6834/2620799775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2620799775},{"type":"v1","addr":"172.21.15.6:6834","nonce":2620799775}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000329200","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:47.392 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-08-17T02:29:47.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.393+0000 7fd589600640 1 -- 172.21.15.6:0/1827509113 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd564065150 msgr2=0x7fd564067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.393+0000 7fd589600640 1 --2- 172.21.15.6:0/1827509113 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd564065150 0x7fd564067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd574007880 tx=0x7fd574007e20 comp rx=0 tx=0).stop 2024-08-17T02:29:47.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.393+0000 7fd589600640 1 -- 172.21.15.6:0/1827509113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5841590b0 msgr2=0x7fd584156ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.393+0000 7fd589600640 1 --2- 172.21.15.6:0/1827509113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5841590b0 0x7fd584156ae0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00b7f0 tx=0x7fd57c009840 comp rx=0 tx=0).stop 2024-08-17T02:29:47.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.394+0000 7fd589600640 1 -- 172.21.15.6:0/1827509113 shutdown_connections 2024-08-17T02:29:47.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.394+0000 7fd589600640 1 --2- 172.21.15.6:0/1827509113 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd564065150 0x7fd564067600 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.394+0000 7fd589600640 1 --2- 172.21.15.6:0/1827509113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5841590b0 0x7fd584156ae0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.394+0000 7fd589600640 1 --2- 172.21.15.6:0/1827509113 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5840afca0 0x7fd5841565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.394+0000 7fd589600640 1 --2- 172.21.15.6:0/1827509113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5840acf10 0x7fd5841402f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.394+0000 7fd589600640 1 -- 172.21.15.6:0/1827509113 >> 172.21.15.6:0/1827509113 conn(0x7fd584066e60 msgr2=0x7fd5840cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:47.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.394+0000 7fd589600640 1 -- 172.21.15.6:0/1827509113 shutdown_connections 2024-08-17T02:29:47.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.394+0000 7fd589600640 1 -- 172.21.15.6:0/1827509113 wait complete. 2024-08-17T02:29:47.409 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.561+0000 7f0dc6200640 1 Processor -- start 2024-08-17T02:29:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.561+0000 7f0dc6200640 1 -- start start 2024-08-17T02:29:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.562+0000 7f0dc6200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0dc00afca0 0x7f0dc00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.562+0000 7f0dc6200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0dc00acf10 0x7f0dc0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.562+0000 7f0dc6200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0dc01589a0 0x7f0dc0158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.562+0000 7f0dc6200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc00b0980 con 0x7f0dc00acf10 2024-08-17T02:29:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.562+0000 7f0dc6200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc015a4e0 con 0x7f0dc01589a0 2024-08-17T02:29:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.562+0000 7f0dc6200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00c92b0 con 0x7f0dc00afca0 2024-08-17T02:29:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.562+0000 7f0db7e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0dc00acf10 0x7f0dc0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.562+0000 7f0db7e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0dc00acf10 0x7f0dc0159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40748/0 (socket says 172.21.15.6:40748) 2024-08-17T02:29:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.562+0000 7f0db7e00640 1 -- 172.21.15.6:0/1999243482 learned_addr learned my addr 172.21.15.6:0/1999243482 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.563+0000 7f0dbfe00640 1 --2- 172.21.15.6:0/1999243482 >> v2:172.21.15.136:3300/0 conn(0x7f0dc01589a0 0x7f0dc0158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.563+0000 7f0dbf400640 1 --2- 172.21.15.6:0/1999243482 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0dc00afca0 0x7f0dc00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.563+0000 7f0db7e00640 1 -- 172.21.15.6:0/1999243482 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0dc00afca0 msgr2=0x7f0dc00b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.563+0000 7f0db7e00640 1 --2- 172.21.15.6:0/1999243482 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0dc00afca0 0x7f0dc00b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.563+0000 7f0db7e00640 1 -- 172.21.15.6:0/1999243482 >> v2:172.21.15.136:3300/0 conn(0x7f0dc01589a0 msgr2=0x7f0dc0158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.563+0000 7f0db7e00640 1 --2- 172.21.15.6:0/1999243482 >> v2:172.21.15.136:3300/0 conn(0x7f0dc01589a0 0x7f0dc0158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.563+0000 7f0db7e00640 1 -- 172.21.15.6:0/1999243482 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc0159360 con 0x7f0dc00acf10 2024-08-17T02:29:47.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.564+0000 7f0db7e00640 1 --2- 172.21.15.6:0/1999243482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc00acf10 0x7f0dc0159fa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009910 tx=0x7f0da80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9755910407f35dee server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.564+0000 7f0dbea00640 1 -- 172.21.15.6:0/1999243482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8031510 con 0x7f0dc00acf10 2024-08-17T02:29:47.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.564+0000 7f0dbea00640 1 -- 172.21.15.6:0/1999243482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da802f050 con 0x7f0dc00acf10 2024-08-17T02:29:47.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.564+0000 7f0dbea00640 1 -- 172.21.15.6:0/1999243482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da80318e0 con 0x7f0dc00acf10 2024-08-17T02:29:47.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.564+0000 7f0dc6200640 1 -- 172.21.15.6:0/1999243482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc00acf10 msgr2=0x7f0dc0159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.564+0000 7f0dc6200640 1 --2- 172.21.15.6:0/1999243482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc00acf10 0x7f0dc0159fa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009910 tx=0x7f0da80091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.565+0000 7f0dc6200640 1 -- 172.21.15.6:0/1999243482 shutdown_connections 2024-08-17T02:29:47.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.565+0000 7f0dc6200640 1 --2- 172.21.15.6:0/1999243482 >> v2:172.21.15.136:3300/0 conn(0x7f0dc01589a0 0x7f0dc0158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.565+0000 7f0dc6200640 1 --2- 172.21.15.6:0/1999243482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc00acf10 0x7f0dc0159fa0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.565+0000 7f0dc6200640 1 --2- 172.21.15.6:0/1999243482 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0dc00afca0 0x7f0dc00b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.565+0000 7f0dc6200640 1 -- 172.21.15.6:0/1999243482 >> 172.21.15.6:0/1999243482 conn(0x7f0dc0066e60 msgr2=0x7f0dc0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:47.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.565+0000 7f0dc6200640 1 -- 172.21.15.6:0/1999243482 shutdown_connections 2024-08-17T02:29:47.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.565+0000 7f0dc6200640 1 -- 172.21.15.6:0/1999243482 wait complete. 2024-08-17T02:29:47.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.566+0000 7f0dc6200640 1 Processor -- start 2024-08-17T02:29:47.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.566+0000 7f0dc6200640 1 -- start start 2024-08-17T02:29:47.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.567+0000 7f0dc6200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0dc00acf10 0x7f0dc00c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.567+0000 7f0dc6200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc00afca0 0x7f0dc0169aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.567+0000 7f0dc6200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0dc01589a0 0x7f0dc00c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.567+0000 7f0dc6200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc0169fe0 con 0x7f0dc00afca0 2024-08-17T02:29:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.567+0000 7f0dc6200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00c5f00 con 0x7f0dc01589a0 2024-08-17T02:29:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.567+0000 7f0dc6200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00c52f0 con 0x7f0dc00acf10 2024-08-17T02:29:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.567+0000 7f0db7e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc00afca0 0x7f0dc0169aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.567+0000 7f0db7e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc00afca0 0x7f0dc0169aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40764/0 (socket says 172.21.15.6:40764) 2024-08-17T02:29:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.567+0000 7f0db7e00640 1 -- 172.21.15.6:0/61955505 learned_addr learned my addr 172.21.15.6:0/61955505 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.567+0000 7f0dbf400640 1 --2- 172.21.15.6:0/61955505 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0dc00acf10 0x7f0dc00c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.568+0000 7f0dbfe00640 1 --2- 172.21.15.6:0/61955505 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0dc01589a0 0x7f0dc00c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.568+0000 7f0db7e00640 1 -- 172.21.15.6:0/61955505 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0dc00acf10 msgr2=0x7f0dc00c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.568+0000 7f0db7e00640 1 --2- 172.21.15.6:0/61955505 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0dc00acf10 0x7f0dc00c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.568+0000 7f0db7e00640 1 -- 172.21.15.6:0/61955505 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0dc01589a0 msgr2=0x7f0dc00c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.568+0000 7f0db7e00640 1 --2- 172.21.15.6:0/61955505 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0dc01589a0 0x7f0dc00c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.568+0000 7f0db7e00640 1 -- 172.21.15.6:0/61955505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da8009450 con 0x7f0dc00afca0 2024-08-17T02:29:47.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.568+0000 7f0dbfe00640 1 --2- 172.21.15.6:0/61955505 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0dc01589a0 0x7f0dc00c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:47.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.568+0000 7f0db7e00640 1 --2- 172.21.15.6:0/61955505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc00afca0 0x7f0dc0169aa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0da8006c70 tx=0x7f0da8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.568+0000 7f0db6a00640 1 -- 172.21.15.6:0/61955505 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8033860 con 0x7f0dc00afca0 2024-08-17T02:29:47.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.568+0000 7f0db6a00640 1 -- 172.21.15.6:0/61955505 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da80339c0 con 0x7f0dc00afca0 2024-08-17T02:29:47.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.568+0000 7f0db6a00640 1 -- 172.21.15.6:0/61955505 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8033da0 con 0x7f0dc00afca0 2024-08-17T02:29:47.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.568+0000 7f0dc6200640 1 -- 172.21.15.6:0/61955505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc00c55d0 con 0x7f0dc00afca0 2024-08-17T02:29:47.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.569+0000 7f0dc6200640 1 -- 172.21.15.6:0/61955505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc00c5b90 con 0x7f0dc00afca0 2024-08-17T02:29:47.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.570+0000 7f0dc6200640 1 -- 172.21.15.6:0/61955505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc00c60b0 con 0x7f0dc00afca0 2024-08-17T02:29:47.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.570+0000 7f0db6a00640 1 -- 172.21.15.6:0/61955505 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0da803c430 con 0x7f0dc00afca0 2024-08-17T02:29:47.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.571+0000 7f0db6a00640 1 --2- 172.21.15.6:0/61955505 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0d9c065150 0x7f0d9c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.571+0000 7f0db6a00640 1 -- 172.21.15.6:0/61955505 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f0da8042030 con 0x7f0dc00afca0 2024-08-17T02:29:47.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.571+0000 7f0dbf400640 1 --2- 172.21.15.6:0/61955505 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0d9c065150 0x7f0d9c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.572+0000 7f0dbf400640 1 --2- 172.21.15.6:0/61955505 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0d9c065150 0x7f0d9c067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0dc006a660 tx=0x7f0db0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.575+0000 7f0db6a00640 1 -- 172.21.15.6:0/61955505 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0dc00c60b0 con 0x7f0dc00afca0 2024-08-17T02:29:47.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.796+0000 7f0dc6200640 1 -- 172.21.15.6:0/61955505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0dc00c6070 con 0x7f0dc00afca0 2024-08-17T02:29:47.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.797+0000 7f0db6a00640 1 -- 172.21.15.6:0/61955505 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4615 (secure 0 0 0) 0x7f0da80713c0 con 0x7f0dc00afca0 2024-08-17T02:29:47.798 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:47.798 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/4280185456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":4280185456},{"type":"v1","addr":"172.21.15.136:6836","nonce":4280185456}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2517061869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":2517061869},{"type":"v1","addr":"172.21.15.136:6837","nonce":2517061869}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2625056728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2625056728},{"type":"v1","addr":"172.21.15.6:6835","nonce":2625056728}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:33.919463+0000","modified":"2024-08-17T02:27:35.926590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4935":{"gid":4935,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.6:6834/2620799775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2620799775},{"type":"v1","addr":"172.21.15.6:6834","nonce":2620799775}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000329200","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:47.798 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-08-17T02:29:47.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.799+0000 7f0dc6200640 1 -- 172.21.15.6:0/61955505 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0d9c065150 msgr2=0x7f0d9c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.799+0000 7f0dc6200640 1 --2- 172.21.15.6:0/61955505 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0d9c065150 0x7f0d9c067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0dc006a660 tx=0x7f0db0008040 comp rx=0 tx=0).stop 2024-08-17T02:29:47.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.799+0000 7f0dc6200640 1 -- 172.21.15.6:0/61955505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc00afca0 msgr2=0x7f0dc0169aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.799+0000 7f0dc6200640 1 --2- 172.21.15.6:0/61955505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc00afca0 0x7f0dc0169aa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0da8006c70 tx=0x7f0da8037000 comp rx=0 tx=0).stop 2024-08-17T02:29:47.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.799+0000 7f0dc6200640 1 -- 172.21.15.6:0/61955505 shutdown_connections 2024-08-17T02:29:47.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.799+0000 7f0dc6200640 1 --2- 172.21.15.6:0/61955505 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0d9c065150 0x7f0d9c067600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.799+0000 7f0dc6200640 1 --2- 172.21.15.6:0/61955505 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0dc01589a0 0x7f0dc00c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.799+0000 7f0dc6200640 1 --2- 172.21.15.6:0/61955505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc00afca0 0x7f0dc0169aa0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.799+0000 7f0dc6200640 1 --2- 172.21.15.6:0/61955505 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0dc00acf10 0x7f0dc00c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.799+0000 7f0dc6200640 1 -- 172.21.15.6:0/61955505 >> 172.21.15.6:0/61955505 conn(0x7f0dc0066e60 msgr2=0x7f0dc01512d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:47.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.799+0000 7f0dc6200640 1 -- 172.21.15.6:0/61955505 shutdown_connections 2024-08-17T02:29:47.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.799+0000 7f0dc6200640 1 -- 172.21.15.6:0/61955505 wait complete. 2024-08-17T02:29:47.814 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:47.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.964+0000 7f31d4400640 1 Processor -- start 2024-08-17T02:29:47.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.964+0000 7f31d4400640 1 -- start start 2024-08-17T02:29:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.965+0000 7f31d4400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f31cc1590b0 0x7f31cc0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.965+0000 7f31d4400640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31cc0c92b0 con 0x7f31cc0acf10 2024-08-17T02:29:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.966+0000 7f31d4400640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31cc0ad480 con 0x7f31cc0afca0 2024-08-17T02:29:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.966+0000 7f31d4400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31cc0b0980 con 0x7f31cc1590b0 2024-08-17T02:29:47.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.966+0000 7f31d2400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f31cc0acf10 0x7f31cc0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39732/0 (socket says 172.21.15.6:39732) 2024-08-17T02:29:47.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.966+0000 7f31d2400640 1 -- 172.21.15.6:0/1355414561 learned_addr learned my addr 172.21.15.6:0/1355414561 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:47.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.966+0000 7f31d1000640 1 --2- 172.21.15.6:0/1355414561 >> v2:172.21.15.136:3300/0 conn(0x7f31cc1590b0 0x7f31cc0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.966+0000 7f31cbe00640 1 -- 172.21.15.6:0/1355414561 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926624836 0 0) 0x7f31cc0c92b0 con 0x7f31cc0acf10 2024-08-17T02:29:47.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.966+0000 7f31cbe00640 1 -- 172.21.15.6:0/1355414561 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b40034e0 con 0x7f31cc0acf10 2024-08-17T02:29:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.966+0000 7f31d1000640 1 -- 172.21.15.6:0/1355414561 >> v1:172.21.15.136:6789/0 conn(0x7f31cc0afca0 legacy=0x7f31cc1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.966+0000 7f31d1000640 1 -- 172.21.15.6:0/1355414561 >> v1:172.21.15.6:6789/0 conn(0x7f31cc0acf10 legacy=0x7f31cc0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.966+0000 7f31d1000640 1 -- 172.21.15.6:0/1355414561 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc0ad760 con 0x7f31cc1590b0 2024-08-17T02:29:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.967+0000 7f31d1000640 1 --2- 172.21.15.6:0/1355414561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31cc1590b0 0x7f31cc0b0070 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009850 tx=0x7f31b80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4b6951bab16f301 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.968+0000 7f31cbe00640 1 -- 172.21.15.6:0/1355414561 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8031510 con 0x7f31cc1590b0 2024-08-17T02:29:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.968+0000 7f31cbe00640 1 -- 172.21.15.6:0/1355414561 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b802f050 con 0x7f31cc1590b0 2024-08-17T02:29:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.968+0000 7f31cbe00640 1 -- 172.21.15.6:0/1355414561 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b80318a0 con 0x7f31cc1590b0 2024-08-17T02:29:47.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.968+0000 7f31d4400640 1 -- 172.21.15.6:0/1355414561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31cc1590b0 msgr2=0x7f31cc0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.968+0000 7f31d4400640 1 --2- 172.21.15.6:0/1355414561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31cc1590b0 0x7f31cc0b0070 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009850 tx=0x7f31b80090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.968+0000 7f31d4400640 1 -- 172.21.15.6:0/1355414561 shutdown_connections 2024-08-17T02:29:47.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.968+0000 7f31d4400640 1 --2- 172.21.15.6:0/1355414561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31cc1590b0 0x7f31cc0b0070 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.968+0000 7f31d4400640 1 -- 172.21.15.6:0/1355414561 >> 172.21.15.6:0/1355414561 conn(0x7f31cc066e60 msgr2=0x7f31cc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:47.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.969+0000 7f31d4400640 1 -- 172.21.15.6:0/1355414561 shutdown_connections 2024-08-17T02:29:47.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.969+0000 7f31d4400640 1 -- 172.21.15.6:0/1355414561 wait complete. 2024-08-17T02:29:47.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.970+0000 7f31d4400640 1 Processor -- start 2024-08-17T02:29:47.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.970+0000 7f31d4400640 1 -- start start 2024-08-17T02:29:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.971+0000 7f31d4400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc0acf10 0x7f31cc168f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.971+0000 7f31d4400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31cc0afca0 0x7f31cc06a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.971+0000 7f31d4400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f31cc1590b0 0x7f31cc1558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.971+0000 7f31d4400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc157200 con 0x7f31cc0acf10 2024-08-17T02:29:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.971+0000 7f31d4400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc1565f0 con 0x7f31cc0afca0 2024-08-17T02:29:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.971+0000 7f31d4400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc1568d0 con 0x7f31cc1590b0 2024-08-17T02:29:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.971+0000 7f31d1a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc0acf10 0x7f31cc168f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.971+0000 7f31d1a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc0acf10 0x7f31cc168f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40780/0 (socket says 172.21.15.6:40780) 2024-08-17T02:29:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.971+0000 7f31d1a00640 1 -- 172.21.15.6:0/3732680243 learned_addr learned my addr 172.21.15.6:0/3732680243 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.971+0000 7f31d1000640 1 --2- 172.21.15.6:0/3732680243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31cc0afca0 0x7f31cc06a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.971+0000 7f31d2400640 1 --2- 172.21.15.6:0/3732680243 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f31cc1590b0 0x7f31cc1558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.972+0000 7f31d1a00640 1 -- 172.21.15.6:0/3732680243 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f31cc1590b0 msgr2=0x7f31cc1558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.972+0000 7f31d1a00640 1 --2- 172.21.15.6:0/3732680243 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f31cc1590b0 0x7f31cc1558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.972+0000 7f31d1a00640 1 -- 172.21.15.6:0/3732680243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31cc0afca0 msgr2=0x7f31cc06a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.972+0000 7f31d1a00640 1 --2- 172.21.15.6:0/3732680243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31cc0afca0 0x7f31cc06a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.972+0000 7f31d1a00640 1 -- 172.21.15.6:0/3732680243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b8009390 con 0x7f31cc0acf10 2024-08-17T02:29:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.972+0000 7f31d1a00640 1 --2- 172.21.15.6:0/3732680243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc0acf10 0x7f31cc168f80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f31c000c560 tx=0x7f31c0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.972+0000 7f31c8c00640 1 -- 172.21.15.6:0/3732680243 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0011590 con 0x7f31cc0acf10 2024-08-17T02:29:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.972+0000 7f31c8c00640 1 -- 172.21.15.6:0/3732680243 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c0011710 con 0x7f31cc0acf10 2024-08-17T02:29:47.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.972+0000 7f31c8c00640 1 -- 172.21.15.6:0/3732680243 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0011ad0 con 0x7f31cc0acf10 2024-08-17T02:29:47.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.972+0000 7f31d4400640 1 -- 172.21.15.6:0/3732680243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31cc156bb0 con 0x7f31cc0acf10 2024-08-17T02:29:47.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.972+0000 7f31d4400640 1 -- 172.21.15.6:0/3732680243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31cc0a5020 con 0x7f31cc0acf10 2024-08-17T02:29:47.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.973+0000 7f31d4400640 1 -- 172.21.15.6:0/3732680243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31cc063fb0 con 0x7f31cc0acf10 2024-08-17T02:29:47.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.974+0000 7f31c8c00640 1 -- 172.21.15.6:0/3732680243 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f31c001b3b0 con 0x7f31cc0acf10 2024-08-17T02:29:47.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.975+0000 7f31c8c00640 1 --2- 172.21.15.6:0/3732680243 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f31ac065150 0x7f31ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.975+0000 7f31c8c00640 1 -- 172.21.15.6:0/3732680243 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f31c0081a60 con 0x7f31cc0acf10 2024-08-17T02:29:47.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.975+0000 7f31d1000640 1 --2- 172.21.15.6:0/3732680243 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f31ac065150 0x7f31ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.976+0000 7f31d1000640 1 --2- 172.21.15.6:0/3732680243 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f31ac065150 0x7f31ac067600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f31b8036000 tx=0x7f31b8037000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:47.979+0000 7f31c8c00640 1 -- 172.21.15.6:0/3732680243 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f31c004fab0 con 0x7f31cc0acf10 2024-08-17T02:29:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.161+0000 7f31d4400640 1 -- 172.21.15.6:0/3732680243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31cc067b70 con 0x7f31cc0acf10 2024-08-17T02:29:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.162+0000 7f31c8c00640 1 -- 172.21.15.6:0/3732680243 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15460 (secure 0 0 0) 0x7f31c0017070 con 0x7f31cc0acf10 2024-08-17T02:29:48.165 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:48.166 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:29:44.709515+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000329200.meta","create_time":"2024-08-17T02:27:32.084585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000329200"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000329200.data","create_time":"2024-08-17T02:27:32.953304+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000329200"}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/285178879":"2024-08-18T02:29:41.592570+0000","172.21.15.6:6833/285178879":"2024-08-18T02:29:41.592570+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:48.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.164+0000 7f31d4400640 1 -- 172.21.15.6:0/3732680243 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f31ac065150 msgr2=0x7f31ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.164+0000 7f31d4400640 1 --2- 172.21.15.6:0/3732680243 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f31ac065150 0x7f31ac067600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f31b8036000 tx=0x7f31b8037000 comp rx=0 tx=0).stop 2024-08-17T02:29:48.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.164+0000 7f31d4400640 1 -- 172.21.15.6:0/3732680243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc0acf10 msgr2=0x7f31cc168f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.164+0000 7f31d4400640 1 --2- 172.21.15.6:0/3732680243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc0acf10 0x7f31cc168f80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f31c000c560 tx=0x7f31c0007ef0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.164+0000 7f31d4400640 1 -- 172.21.15.6:0/3732680243 shutdown_connections 2024-08-17T02:29:48.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.164+0000 7f31d4400640 1 --2- 172.21.15.6:0/3732680243 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f31ac065150 0x7f31ac067600 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.164+0000 7f31d4400640 1 --2- 172.21.15.6:0/3732680243 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f31cc1590b0 0x7f31cc1558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.164+0000 7f31d4400640 1 --2- 172.21.15.6:0/3732680243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31cc0afca0 0x7f31cc06a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.164+0000 7f31d4400640 1 --2- 172.21.15.6:0/3732680243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc0acf10 0x7f31cc168f80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.164+0000 7f31d4400640 1 -- 172.21.15.6:0/3732680243 >> 172.21.15.6:0/3732680243 conn(0x7f31cc066e60 msgr2=0x7f31cc1543e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:48.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.165+0000 7f31d4400640 1 -- 172.21.15.6:0/3732680243 shutdown_connections 2024-08-17T02:29:48.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.165+0000 7f31d4400640 1 -- 172.21.15.6:0/3732680243 wait complete. 2024-08-17T02:29:48.180 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000329200 2024-08-17T02:29:48.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.332+0000 7f0bb0a00640 1 Processor -- start 2024-08-17T02:29:48.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.333+0000 7f0bb0a00640 1 -- start start 2024-08-17T02:29:48.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.334+0000 7f0bb0a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0bac0aed20 0x7f0bac156d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.334+0000 7f0bb0a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bac0af0f0 0x7f0bac0cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.334+0000 7f0bb0a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bac15b240 con 0x7f0bac0cc5a0 2024-08-17T02:29:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.334+0000 7f0bb0a00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bac15a630 con 0x7f0bac0aed20 2024-08-17T02:29:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.334+0000 7f0bb0a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac15a910 con 0x7f0bac0af0f0 2024-08-17T02:29:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.334+0000 7f0bab400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0bac0aed20 0x7f0bac156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.334+0000 7f0babe00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f0bac0cc5a0 0x7f0bac155e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:57942/0 (socket says 172.21.15.6:57942) 2024-08-17T02:29:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.334+0000 7f0babe00640 1 -- 172.21.15.6:0/3512683255 learned_addr learned my addr 172.21.15.6:0/3512683255 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.334+0000 7f0ba3e00640 1 --2- 172.21.15.6:0/3512683255 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bac0af0f0 0x7f0bac0cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.335+0000 7f0baaa00640 1 -- 172.21.15.6:0/3512683255 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990222132 0 0) 0x7f0bac15b240 con 0x7f0bac0cc5a0 2024-08-17T02:29:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.335+0000 7f0baaa00640 1 -- 172.21.15.6:0/3512683255 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b900034e0 con 0x7f0bac0cc5a0 2024-08-17T02:29:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.335+0000 7f0bab400640 1 -- 172.21.15.6:0/3512683255 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bac0af0f0 msgr2=0x7f0bac0cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.335+0000 7f0bab400640 1 --2- 172.21.15.6:0/3512683255 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bac0af0f0 0x7f0bac0cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.335+0000 7f0bab400640 1 -- 172.21.15.6:0/3512683255 >> v1:172.21.15.136:6789/0 conn(0x7f0bac0cc5a0 legacy=0x7f0bac155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.335+0000 7f0bab400640 1 -- 172.21.15.6:0/3512683255 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac15abf0 con 0x7f0bac0aed20 2024-08-17T02:29:48.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.336+0000 7f0bab400640 1 --2- 172.21.15.6:0/3512683255 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bac0aed20 0x7f0bac156d60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009850 tx=0x7f0b9c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f74b1c7b6b4d3dff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:48.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.336+0000 7f0baaa00640 1 -- 172.21.15.6:0/3512683255 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c02ad00 con 0x7f0bac0aed20 2024-08-17T02:29:48.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.337+0000 7f0baaa00640 1 -- 172.21.15.6:0/3512683255 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9c02ae60 con 0x7f0bac0aed20 2024-08-17T02:29:48.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.337+0000 7f0baaa00640 1 -- 172.21.15.6:0/3512683255 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c032670 con 0x7f0bac0aed20 2024-08-17T02:29:48.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.337+0000 7f0bb0a00640 1 -- 172.21.15.6:0/3512683255 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bac0aed20 msgr2=0x7f0bac156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.337+0000 7f0bb0a00640 1 --2- 172.21.15.6:0/3512683255 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bac0aed20 0x7f0bac156d60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009850 tx=0x7f0b9c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.337+0000 7f0bb0a00640 1 -- 172.21.15.6:0/3512683255 shutdown_connections 2024-08-17T02:29:48.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.337+0000 7f0bb0a00640 1 --2- 172.21.15.6:0/3512683255 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bac0af0f0 0x7f0bac0cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.337+0000 7f0bb0a00640 1 --2- 172.21.15.6:0/3512683255 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bac0aed20 0x7f0bac156d60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.337+0000 7f0bb0a00640 1 -- 172.21.15.6:0/3512683255 >> 172.21.15.6:0/3512683255 conn(0x7f0bac06e590 msgr2=0x7f0bac06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:48.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.337+0000 7f0bb0a00640 1 -- 172.21.15.6:0/3512683255 shutdown_connections 2024-08-17T02:29:48.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.337+0000 7f0bb0a00640 1 -- 172.21.15.6:0/3512683255 wait complete. 2024-08-17T02:29:48.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.339+0000 7f0bb0a00640 1 Processor -- start 2024-08-17T02:29:48.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.339+0000 7f0bb0a00640 1 -- start start 2024-08-17T02:29:48.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.340+0000 7f0bb0a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bac0aed20 0x7f0bac0b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.340+0000 7f0bb0a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac0af0f0 0x7f0bac0c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.340+0000 7f0bb0a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bac0cc5a0 0x7f0bac0b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.340+0000 7f0bb0a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0b3c10 con 0x7f0bac0af0f0 2024-08-17T02:29:48.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.340+0000 7f0bb0a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0c9260 con 0x7f0bac0cc5a0 2024-08-17T02:29:48.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.340+0000 7f0bb0a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0b3000 con 0x7f0bac0aed20 2024-08-17T02:29:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.340+0000 7f0ba3e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac0af0f0 0x7f0bac0c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.340+0000 7f0ba3e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac0af0f0 0x7f0bac0c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40792/0 (socket says 172.21.15.6:40792) 2024-08-17T02:29:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.340+0000 7f0ba3e00640 1 -- 172.21.15.6:0/2474249960 learned_addr learned my addr 172.21.15.6:0/2474249960 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.340+0000 7f0babe00640 1 --2- 172.21.15.6:0/2474249960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bac0cc5a0 0x7f0bac0b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.340+0000 7f0bab400640 1 --2- 172.21.15.6:0/2474249960 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bac0aed20 0x7f0bac0b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.341+0000 7f0ba3e00640 1 -- 172.21.15.6:0/2474249960 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bac0aed20 msgr2=0x7f0bac0b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.341+0000 7f0ba3e00640 1 --2- 172.21.15.6:0/2474249960 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bac0aed20 0x7f0bac0b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.341+0000 7f0ba3e00640 1 -- 172.21.15.6:0/2474249960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bac0cc5a0 msgr2=0x7f0bac0b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.341+0000 7f0ba3e00640 1 --2- 172.21.15.6:0/2474249960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bac0cc5a0 0x7f0bac0b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.341+0000 7f0ba3e00640 1 -- 172.21.15.6:0/2474249960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c009390 con 0x7f0bac0af0f0 2024-08-17T02:29:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.341+0000 7f0ba3e00640 1 --2- 172.21.15.6:0/2474249960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac0af0f0 0x7f0bac0c8d20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400ea50 tx=0x7f0b940090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.341+0000 7f0ba2a00640 1 -- 172.21.15.6:0/2474249960 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9400ca10 con 0x7f0bac0af0f0 2024-08-17T02:29:48.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.341+0000 7f0ba2a00640 1 -- 172.21.15.6:0/2474249960 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9400cb70 con 0x7f0bac0af0f0 2024-08-17T02:29:48.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.341+0000 7f0ba2a00640 1 -- 172.21.15.6:0/2474249960 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94013470 con 0x7f0bac0af0f0 2024-08-17T02:29:48.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.341+0000 7f0bb0a00640 1 -- 172.21.15.6:0/2474249960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bac0b32e0 con 0x7f0bac0af0f0 2024-08-17T02:29:48.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.341+0000 7f0bb0a00640 1 -- 172.21.15.6:0/2474249960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bac0b38a0 con 0x7f0bac0af0f0 2024-08-17T02:29:48.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.342+0000 7f0bb0a00640 1 -- 172.21.15.6:0/2474249960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bac0b3dc0 con 0x7f0bac0af0f0 2024-08-17T02:29:48.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.343+0000 7f0ba2a00640 1 -- 172.21.15.6:0/2474249960 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0b94013860 con 0x7f0bac0af0f0 2024-08-17T02:29:48.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.344+0000 7f0ba2a00640 1 --2- 172.21.15.6:0/2474249960 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0b88065150 0x7f0b88067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.344+0000 7f0ba2a00640 1 -- 172.21.15.6:0/2474249960 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f0b94082760 con 0x7f0bac0af0f0 2024-08-17T02:29:48.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.345+0000 7f0bab400640 1 --2- 172.21.15.6:0/2474249960 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0b88065150 0x7f0b88067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.345+0000 7f0bab400640 1 --2- 172.21.15.6:0/2474249960 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0b88065150 0x7f0b88067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c034000 tx=0x7f0b9c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:48.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.348+0000 7f0ba2a00640 1 -- 172.21.15.6:0/2474249960 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0bac0b3dc0 con 0x7f0bac0af0f0 2024-08-17T02:29:48.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.567+0000 7f0bb0a00640 1 -- 172.21.15.6:0/2474249960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000329200"} v 0) v1 -- 0x7f0bac0b3dc0 con 0x7f0bac0af0f0 2024-08-17T02:29:48.568 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-08-17T02:29:48.568+0000 7f074d600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:29:48.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.574+0000 7f0ba2a00640 1 -- 172.21.15.6:0/2474249960 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000329200"}]=0 volume_0000000000329200 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 195+0+0 (secure 0 0 0) 0x7f0bac0b3dc0 con 0x7f0bac0af0f0 2024-08-17T02:29:48.575 INFO:teuthology.orchestra.run.smithi006.stderr:volume_0000000000329200 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:29:48.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.577+0000 7f0bb0a00640 1 -- 172.21.15.6:0/2474249960 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0b88065150 msgr2=0x7f0b88067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.577+0000 7f0bb0a00640 1 --2- 172.21.15.6:0/2474249960 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0b88065150 0x7f0b88067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c034000 tx=0x7f0b9c032000 comp rx=0 tx=0).stop 2024-08-17T02:29:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.577+0000 7f0bb0a00640 1 -- 172.21.15.6:0/2474249960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac0af0f0 msgr2=0x7f0bac0c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.577+0000 7f0bb0a00640 1 --2- 172.21.15.6:0/2474249960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac0af0f0 0x7f0bac0c8d20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400ea50 tx=0x7f0b940090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.577+0000 7f0bb0a00640 1 -- 172.21.15.6:0/2474249960 shutdown_connections 2024-08-17T02:29:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.577+0000 7f0bb0a00640 1 --2- 172.21.15.6:0/2474249960 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0b88065150 0x7f0b88067600 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.577+0000 7f0bb0a00640 1 --2- 172.21.15.6:0/2474249960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bac0cc5a0 0x7f0bac0b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.577+0000 7f0bb0a00640 1 --2- 172.21.15.6:0/2474249960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac0af0f0 0x7f0bac0c8d20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.577+0000 7f0bb0a00640 1 --2- 172.21.15.6:0/2474249960 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bac0aed20 0x7f0bac0b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.577+0000 7f0bb0a00640 1 -- 172.21.15.6:0/2474249960 >> 172.21.15.6:0/2474249960 conn(0x7f0bac06e590 msgr2=0x7f0bac0ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.577+0000 7f0bb0a00640 1 -- 172.21.15.6:0/2474249960 shutdown_connections 2024-08-17T02:29:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.577+0000 7f0bb0a00640 1 -- 172.21.15.6:0/2474249960 wait complete. 2024-08-17T02:29:48.579 INFO:tasks.ceph.mds.c.smithi006.stderr: -3082> 2024-08-17T02:27:40.768+0000 7fd95aa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:29:48.594 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000329200 --yes-i-really-mean-it 2024-08-17T02:29:48.622 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-08-17T02:29:48.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.748+0000 7fb356200640 1 Processor -- start 2024-08-17T02:29:48.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.749+0000 7fb356200640 1 -- start start 2024-08-17T02:29:48.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.750+0000 7fb356200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb350158e10 0x7fb350068180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.750+0000 7fb356200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3500c40a0 con 0x7fb3501591e0 2024-08-17T02:29:48.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.750+0000 7fb356200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb350069240 con 0x7fb350068dd0 2024-08-17T02:29:48.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.750+0000 7fb356200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500694e0 con 0x7fb350158e10 2024-08-17T02:29:48.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.750+0000 7fb347e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb3501591e0 0x7fb3500686c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39740/0 (socket says 172.21.15.6:39740) 2024-08-17T02:29:48.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.750+0000 7fb347e00640 1 -- 172.21.15.6:0/2998658950 learned_addr learned my addr 172.21.15.6:0/2998658950 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:48.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.750+0000 7fb34f400640 1 --2- 172.21.15.6:0/2998658950 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb350158e10 0x7fb350068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.750+0000 7fb34ea00640 1 -- 172.21.15.6:0/2998658950 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077586437 0 0) 0x7fb3500c40a0 con 0x7fb3501591e0 2024-08-17T02:29:48.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.751+0000 7fb34ea00640 1 -- 172.21.15.6:0/2998658950 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3340034e0 con 0x7fb3501591e0 2024-08-17T02:29:48.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.751+0000 7fb34ea00640 1 -- 172.21.15.6:0/2998658950 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2434418635 0 0) 0x7fb3340034e0 con 0x7fb3501591e0 2024-08-17T02:29:48.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.751+0000 7fb34ea00640 1 -- 172.21.15.6:0/2998658950 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb350158e10 msgr2=0x7fb350068180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:48.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.751+0000 7fb34ea00640 1 --2- 172.21.15.6:0/2998658950 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb350158e10 0x7fb350068180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.751+0000 7fb34ea00640 1 -- 172.21.15.6:0/2998658950 >> v1:172.21.15.136:6789/0 conn(0x7fb350068dd0 legacy=0x7fb3500cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.751+0000 7fb34ea00640 1 -- 172.21.15.6:0/2998658950 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3500c3a50 con 0x7fb3501591e0 2024-08-17T02:29:48.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.751+0000 7fb34ea00640 1 -- 172.21.15.6:0/2998658950 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7fb338001470 con 0x7fb3501591e0 2024-08-17T02:29:48.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.751+0000 7fb34ea00640 1 -- 172.21.15.6:0/2998658950 >> v1:172.21.15.6:6789/0 conn(0x7fb3501591e0 legacy=0x7fb3500686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.751+0000 7fb34ea00640 1 --2- 172.21.15.6:0/2998658950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb334003a00 0x7fb334003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.751+0000 7fb34ea00640 1 --2- 172.21.15.6:0/2998658950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb334004780 0x7fb334004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.751+0000 7fb34ea00640 1 --2- 172.21.15.6:0/2998658950 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb350158e10 0x7fb3340051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.751+0000 7fb34ea00640 1 -- 172.21.15.6:0/2998658950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500694e0 con 0x7fb334003a00 2024-08-17T02:29:48.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.751+0000 7fb34ea00640 1 -- 172.21.15.6:0/2998658950 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33400bb60 con 0x7fb334004780 2024-08-17T02:29:48.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.751+0000 7fb34ea00640 1 -- 172.21.15.6:0/2998658950 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33400bcf0 con 0x7fb350158e10 2024-08-17T02:29:48.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.751+0000 7fb34f400640 1 --2- 172.21.15.6:0/2998658950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb334003a00 0x7fb334003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.751+0000 7fb347e00640 1 --2- 172.21.15.6:0/2998658950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb334004780 0x7fb334004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.751+0000 7fb34fe00640 1 --2- 172.21.15.6:0/2998658950 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb350158e10 0x7fb3340051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.752+0000 7fb34f400640 1 -- 172.21.15.6:0/2998658950 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb350158e10 msgr2=0x7fb3340051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:48.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.752+0000 7fb34f400640 1 --2- 172.21.15.6:0/2998658950 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb350158e10 0x7fb3340051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.752+0000 7fb34f400640 1 -- 172.21.15.6:0/2998658950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb334004780 msgr2=0x7fb334004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:48.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.752+0000 7fb34f400640 1 --2- 172.21.15.6:0/2998658950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb334004780 0x7fb334004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.752+0000 7fb34f400640 1 -- 172.21.15.6:0/2998658950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3340034e0 con 0x7fb334003a00 2024-08-17T02:29:48.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.752+0000 7fb34fe00640 1 --2- 172.21.15.6:0/2998658950 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb350158e10 0x7fb3340051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:48.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.752+0000 7fb347e00640 1 --2- 172.21.15.6:0/2998658950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb334004780 0x7fb334004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:48.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.753+0000 7fb34f400640 1 --2- 172.21.15.6:0/2998658950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb334003a00 0x7fb334003e10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb340009ba0 tx=0x7fb3400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fbd45d56773c89b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:48.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.753+0000 7fb34ea00640 1 -- 172.21.15.6:0/2998658950 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340031400 con 0x7fb334003a00 2024-08-17T02:29:48.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.753+0000 7fb34ea00640 1 -- 172.21.15.6:0/2998658950 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34002d050 con 0x7fb334003a00 2024-08-17T02:29:48.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.753+0000 7fb34ea00640 1 -- 172.21.15.6:0/2998658950 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340031790 con 0x7fb334003a00 2024-08-17T02:29:48.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.753+0000 7fb356200640 1 -- 172.21.15.6:0/2998658950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb334003a00 msgr2=0x7fb334003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.753+0000 7fb356200640 1 --2- 172.21.15.6:0/2998658950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb334003a00 0x7fb334003e10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb340009ba0 tx=0x7fb3400090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.753+0000 7fb34fe00640 1 -- 172.21.15.6:0/2998658950 reap_dead start 2024-08-17T02:29:48.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.754+0000 7fb356200640 1 -- 172.21.15.6:0/2998658950 shutdown_connections 2024-08-17T02:29:48.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.754+0000 7fb356200640 1 -- 172.21.15.6:0/2998658950 >> 172.21.15.6:0/2998658950 conn(0x7fb3500ce590 msgr2=0x7fb3500ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:48.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.754+0000 7fb356200640 1 -- 172.21.15.6:0/2998658950 shutdown_connections 2024-08-17T02:29:48.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.754+0000 7fb356200640 1 -- 172.21.15.6:0/2998658950 wait complete. 2024-08-17T02:29:48.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.755+0000 7fb356200640 1 Processor -- start 2024-08-17T02:29:48.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.755+0000 7fb356200640 1 -- start start 2024-08-17T02:29:48.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.756+0000 7fb356200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb334003a00 0x7fb3500c5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.756+0000 7fb356200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3501595b0 0x7fb350154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.756+0000 7fb356200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3500b2710 0x7fb3500b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.756+0000 7fb356200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb350159a20 con 0x7fb334003a00 2024-08-17T02:29:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.756+0000 7fb356200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500c5ba0 con 0x7fb3501595b0 2024-08-17T02:29:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.756+0000 7fb356200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500b1c30 con 0x7fb3500b2710 2024-08-17T02:29:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.756+0000 7fb34f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb334003a00 0x7fb3500c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.756+0000 7fb34f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb334003a00 0x7fb3500c5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40828/0 (socket says 172.21.15.6:40828) 2024-08-17T02:29:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.756+0000 7fb34f400640 1 -- 172.21.15.6:0/3294536490 learned_addr learned my addr 172.21.15.6:0/3294536490 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.756+0000 7fb347e00640 1 --2- 172.21.15.6:0/3294536490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3501595b0 0x7fb350154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.756+0000 7fb34fe00640 1 --2- 172.21.15.6:0/3294536490 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3500b2710 0x7fb3500b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.757+0000 7fb34f400640 1 -- 172.21.15.6:0/3294536490 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3500b2710 msgr2=0x7fb3500b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.757+0000 7fb34f400640 1 --2- 172.21.15.6:0/3294536490 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3500b2710 0x7fb3500b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.757+0000 7fb34f400640 1 -- 172.21.15.6:0/3294536490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3501595b0 msgr2=0x7fb350154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.757+0000 7fb34f400640 1 --2- 172.21.15.6:0/3294536490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3501595b0 0x7fb350154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.757+0000 7fb34f400640 1 -- 172.21.15.6:0/3294536490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3500b1f10 con 0x7fb334003a00 2024-08-17T02:29:48.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.757+0000 7fb34f400640 1 --2- 172.21.15.6:0/3294536490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb334003a00 0x7fb3500c5570 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb34002aae0 tx=0x7fb340035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:48.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.757+0000 7fb346a00640 1 -- 172.21.15.6:0/3294536490 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340000d10 con 0x7fb334003a00 2024-08-17T02:29:48.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.757+0000 7fb346a00640 1 -- 172.21.15.6:0/3294536490 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb340030a60 con 0x7fb334003a00 2024-08-17T02:29:48.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.757+0000 7fb346a00640 1 -- 172.21.15.6:0/3294536490 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340030e20 con 0x7fb334003a00 2024-08-17T02:29:48.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.757+0000 7fb356200640 1 -- 172.21.15.6:0/3294536490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3500b21f0 con 0x7fb334003a00 2024-08-17T02:29:48.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.758+0000 7fb356200640 1 -- 172.21.15.6:0/3294536490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3500c78a0 con 0x7fb334003a00 2024-08-17T02:29:48.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.759+0000 7fb356200640 1 -- 172.21.15.6:0/3294536490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3500b1a90 con 0x7fb334003a00 2024-08-17T02:29:48.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.759+0000 7fb346a00640 1 -- 172.21.15.6:0/3294536490 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb34003c630 con 0x7fb334003a00 2024-08-17T02:29:48.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.760+0000 7fb346a00640 1 --2- 172.21.15.6:0/3294536490 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb32c065180 0x7fb32c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.760+0000 7fb346a00640 1 -- 172.21.15.6:0/3294536490 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5923+0+0 (secure 0 0 0) 0x7fb3400a36a0 con 0x7fb334003a00 2024-08-17T02:29:48.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.761+0000 7fb347e00640 1 --2- 172.21.15.6:0/3294536490 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb32c065180 0x7fb32c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.761+0000 7fb347e00640 1 --2- 172.21.15.6:0/3294536490 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb32c065180 0x7fb32c067630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb338000fd0 tx=0x7fb338007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:48.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.764+0000 7fb346a00640 1 -- 172.21.15.6:0/3294536490 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb3500b1a90 con 0x7fb334003a00 2024-08-17T02:29:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:48.982+0000 7fb356200640 1 -- 172.21.15.6:0/3294536490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000329200", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb3500b1a90 con 0x7fb334003a00 2024-08-17T02:29:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.574+0000 7fb346a00640 1 -- 172.21.15.6:0/3294536490 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000329200", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 121+0+0 (secure 0 0 0) 0x7fb3500b1a90 con 0x7fb334003a00 2024-08-17T02:29:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.576+0000 7fb356200640 1 -- 172.21.15.6:0/3294536490 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb32c065180 msgr2=0x7fb32c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.576+0000 7fb356200640 1 --2- 172.21.15.6:0/3294536490 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb32c065180 0x7fb32c067630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb338000fd0 tx=0x7fb338007040 comp rx=0 tx=0).stop 2024-08-17T02:29:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.576+0000 7fb356200640 1 -- 172.21.15.6:0/3294536490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb334003a00 msgr2=0x7fb3500c5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.576+0000 7fb356200640 1 --2- 172.21.15.6:0/3294536490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb334003a00 0x7fb3500c5570 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb34002aae0 tx=0x7fb340035000 comp rx=0 tx=0).stop 2024-08-17T02:29:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.576+0000 7fb356200640 1 -- 172.21.15.6:0/3294536490 shutdown_connections 2024-08-17T02:29:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.576+0000 7fb356200640 1 --2- 172.21.15.6:0/3294536490 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fb32c065180 0x7fb32c067630 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.576+0000 7fb356200640 1 --2- 172.21.15.6:0/3294536490 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3500b2710 0x7fb3500b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.576+0000 7fb356200640 1 --2- 172.21.15.6:0/3294536490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3501595b0 0x7fb350154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.576+0000 7fb356200640 1 --2- 172.21.15.6:0/3294536490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb334003a00 0x7fb3500c5570 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.576+0000 7fb356200640 1 -- 172.21.15.6:0/3294536490 >> 172.21.15.6:0/3294536490 conn(0x7fb3500ce590 msgr2=0x7fb3500cd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.577+0000 7fb356200640 1 -- 172.21.15.6:0/3294536490 shutdown_connections 2024-08-17T02:29:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.577+0000 7fb356200640 1 -- 172.21.15.6:0/3294536490 wait complete. 2024-08-17T02:29:49.597 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000329200.meta cephfs.volume_0000000000329200.meta --yes-i-really-really-mean-it 2024-08-17T02:29:49.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.795+0000 7fc011200640 1 Processor -- start 2024-08-17T02:29:49.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.795+0000 7fc011200640 1 -- start start 2024-08-17T02:29:49.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.797+0000 7fc011200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc00c158d60 0x7fc00c0c5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.797+0000 7fc011200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc00c0a9a60 0x7fc00c0cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.797+0000 7fc011200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc00c0afcd0 0x7fc00c0cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.797+0000 7fc011200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00c0c59c0 con 0x7fc00c158d60 2024-08-17T02:29:49.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.797+0000 7fc011200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00c0630e0 con 0x7fc00c0a9a60 2024-08-17T02:29:49.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.797+0000 7fc011200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c0633c0 con 0x7fc00c0afcd0 2024-08-17T02:29:49.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.797+0000 7fc009e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc00c158d60 0x7fc00c0c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:49.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.797+0000 7fc009e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc00c158d60 0x7fc00c0c5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40840/0 (socket says 172.21.15.6:40840) 2024-08-17T02:29:49.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.797+0000 7fc009e00640 1 -- 172.21.15.6:0/2816374307 learned_addr learned my addr 172.21.15.6:0/2816374307 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:49.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.797+0000 7fc009e00640 1 -- 172.21.15.6:0/2816374307 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc00c0afcd0 msgr2=0x7fc00c0cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:49.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.797+0000 7fc009e00640 1 --2- 172.21.15.6:0/2816374307 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc00c0afcd0 0x7fc00c0cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.797+0000 7fc009e00640 1 -- 172.21.15.6:0/2816374307 >> v2:172.21.15.136:3300/0 conn(0x7fc00c0a9a60 msgr2=0x7fc00c0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:49.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.797+0000 7fc009e00640 1 --2- 172.21.15.6:0/2816374307 >> v2:172.21.15.136:3300/0 conn(0x7fc00c0a9a60 0x7fc00c0cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.797+0000 7fc009e00640 1 -- 172.21.15.6:0/2816374307 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c067000 con 0x7fc00c158d60 2024-08-17T02:29:49.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.798+0000 7fc009e00640 1 --2- 172.21.15.6:0/2816374307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00c158d60 0x7fc00c0c5480 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc00c09a330 tx=0x7fbffc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4eff19835fff86f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:49.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.799+0000 7fc009400640 1 -- 172.21.15.6:0/2816374307 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc02ad40 con 0x7fc00c158d60 2024-08-17T02:29:49.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.799+0000 7fc009400640 1 -- 172.21.15.6:0/2816374307 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc032440 con 0x7fc00c158d60 2024-08-17T02:29:49.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.799+0000 7fc009400640 1 -- 172.21.15.6:0/2816374307 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc02aea0 con 0x7fc00c158d60 2024-08-17T02:29:49.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.799+0000 7fc011200640 1 -- 172.21.15.6:0/2816374307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00c158d60 msgr2=0x7fc00c0c5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.799+0000 7fc011200640 1 --2- 172.21.15.6:0/2816374307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00c158d60 0x7fc00c0c5480 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc00c09a330 tx=0x7fbffc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.799+0000 7fc011200640 1 -- 172.21.15.6:0/2816374307 shutdown_connections 2024-08-17T02:29:49.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.799+0000 7fc011200640 1 --2- 172.21.15.6:0/2816374307 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc00c0afcd0 0x7fc00c0cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.799+0000 7fc011200640 1 --2- 172.21.15.6:0/2816374307 >> v2:172.21.15.136:3300/0 conn(0x7fc00c0a9a60 0x7fc00c0cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.799+0000 7fc011200640 1 --2- 172.21.15.6:0/2816374307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00c158d60 0x7fc00c0c5480 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.799+0000 7fc011200640 1 -- 172.21.15.6:0/2816374307 >> 172.21.15.6:0/2816374307 conn(0x7fc00c0af1f0 msgr2=0x7fc00c0af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:49.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.799+0000 7fc011200640 1 -- 172.21.15.6:0/2816374307 shutdown_connections 2024-08-17T02:29:49.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.799+0000 7fc011200640 1 -- 172.21.15.6:0/2816374307 wait complete. 2024-08-17T02:29:49.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.801+0000 7fc011200640 1 Processor -- start 2024-08-17T02:29:49.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.801+0000 7fc011200640 1 -- start start 2024-08-17T02:29:49.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.802+0000 7fc011200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00c0a9a60 0x7fc00c06b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.802+0000 7fc011200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc00c0afcd0 0x7fc00c0960f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.802+0000 7fc011200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc00c158d60 0x7fc00c098140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.802+0000 7fc011200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c097b70 con 0x7fc00c0a9a60 2024-08-17T02:29:49.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.802+0000 7fc011200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c096ad0 con 0x7fc00c158d60 2024-08-17T02:29:49.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.802+0000 7fc011200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c096db0 con 0x7fc00c0afcd0 2024-08-17T02:29:49.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.802+0000 7fc009e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00c0a9a60 0x7fc00c06b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:49.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.802+0000 7fc009e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00c0a9a60 0x7fc00c06b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40852/0 (socket says 172.21.15.6:40852) 2024-08-17T02:29:49.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.802+0000 7fc009e00640 1 -- 172.21.15.6:0/324995420 learned_addr learned my addr 172.21.15.6:0/324995420 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:49.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.802+0000 7fc003e00640 1 --2- 172.21.15.6:0/324995420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc00c0afcd0 0x7fc00c0960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:49.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.802+0000 7fc00a800640 1 --2- 172.21.15.6:0/324995420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc00c158d60 0x7fc00c098140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:49.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.802+0000 7fc009e00640 1 -- 172.21.15.6:0/324995420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc00c0afcd0 msgr2=0x7fc00c0960f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.802+0000 7fc009e00640 1 --2- 172.21.15.6:0/324995420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc00c0afcd0 0x7fc00c0960f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.802+0000 7fc009e00640 1 -- 172.21.15.6:0/324995420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc00c158d60 msgr2=0x7fc00c098140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.802+0000 7fc009e00640 1 --2- 172.21.15.6:0/324995420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc00c158d60 0x7fc00c098140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.802+0000 7fc009e00640 1 -- 172.21.15.6:0/324995420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc009450 con 0x7fc00c0a9a60 2024-08-17T02:29:49.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.803+0000 7fc009e00640 1 --2- 172.21.15.6:0/324995420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00c0a9a60 0x7fc00c06b3a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbffc009940 tx=0x7fbffc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:49.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.803+0000 7fc001600640 1 -- 172.21.15.6:0/324995420 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc031b30 con 0x7fc00c0a9a60 2024-08-17T02:29:49.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.803+0000 7fc001600640 1 -- 172.21.15.6:0/324995420 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc031c90 con 0x7fc00c0a9a60 2024-08-17T02:29:49.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.803+0000 7fc001600640 1 -- 172.21.15.6:0/324995420 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc03e6a0 con 0x7fc00c0a9a60 2024-08-17T02:29:49.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.803+0000 7fc011200640 1 -- 172.21.15.6:0/324995420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00c097090 con 0x7fc00c0a9a60 2024-08-17T02:29:49.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.803+0000 7fc011200640 1 -- 172.21.15.6:0/324995420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00c097650 con 0x7fc00c0a9a60 2024-08-17T02:29:49.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.804+0000 7fc011200640 1 -- 172.21.15.6:0/324995420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00c063fb0 con 0x7fc00c0a9a60 2024-08-17T02:29:49.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.805+0000 7fc001600640 1 -- 172.21.15.6:0/324995420 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbffc03c400 con 0x7fc00c0a9a60 2024-08-17T02:29:49.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.806+0000 7fc001600640 1 --2- 172.21.15.6:0/324995420 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbfe8065220 0x7fbfe80676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.806+0000 7fc001600640 1 -- 172.21.15.6:0/324995420 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5923+0+0 (secure 0 0 0) 0x7fbffc0a2d50 con 0x7fc00c0a9a60 2024-08-17T02:29:49.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.806+0000 7fc003e00640 1 --2- 172.21.15.6:0/324995420 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbfe8065220 0x7fbfe80676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:49.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.807+0000 7fc003e00640 1 --2- 172.21.15.6:0/324995420 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbfe8065220 0x7fbfe80676d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbff4006fd0 tx=0x7fbff4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:49.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.810+0000 7fc001600640 1 -- 172.21.15.6:0/324995420 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbffc0d4e40 con 0x7fc00c0a9a60 2024-08-17T02:29:49.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:49.996+0000 7fc011200640 1 -- 172.21.15.6:0/324995420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000329200.meta", "pool2": "cephfs.volume_0000000000329200.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc00c06a490 con 0x7fc00c0a9a60 2024-08-17T02:29:50.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.748+0000 7fc001600640 1 -- 172.21.15.6:0/324995420 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000329200.meta", "pool2": "cephfs.volume_0000000000329200.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000329200.meta' removed v42) v1 ==== 241+0+0 (secure 0 0 0) 0x7fbffc037100 con 0x7fc00c0a9a60 2024-08-17T02:29:50.749 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs.volume_0000000000329200.meta' removed 2024-08-17T02:29:50.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.751+0000 7fc011200640 1 -- 172.21.15.6:0/324995420 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbfe8065220 msgr2=0x7fbfe80676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.751+0000 7fc011200640 1 --2- 172.21.15.6:0/324995420 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbfe8065220 0x7fbfe80676d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbff4006fd0 tx=0x7fbff4008040 comp rx=0 tx=0).stop 2024-08-17T02:29:50.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.751+0000 7fc011200640 1 -- 172.21.15.6:0/324995420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00c0a9a60 msgr2=0x7fc00c06b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.751+0000 7fc011200640 1 --2- 172.21.15.6:0/324995420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00c0a9a60 0x7fc00c06b3a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbffc009940 tx=0x7fbffc032000 comp rx=0 tx=0).stop 2024-08-17T02:29:50.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.751+0000 7fc011200640 1 -- 172.21.15.6:0/324995420 shutdown_connections 2024-08-17T02:29:50.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.751+0000 7fc011200640 1 --2- 172.21.15.6:0/324995420 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbfe8065220 0x7fbfe80676d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.751+0000 7fc011200640 1 --2- 172.21.15.6:0/324995420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc00c158d60 0x7fc00c098140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.751+0000 7fc011200640 1 --2- 172.21.15.6:0/324995420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc00c0afcd0 0x7fc00c0960f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.751+0000 7fc011200640 1 --2- 172.21.15.6:0/324995420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00c0a9a60 0x7fc00c06b3a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.751+0000 7fc011200640 1 -- 172.21.15.6:0/324995420 >> 172.21.15.6:0/324995420 conn(0x7fc00c0af1f0 msgr2=0x7fc00c0b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:50.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.751+0000 7fc011200640 1 -- 172.21.15.6:0/324995420 shutdown_connections 2024-08-17T02:29:50.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.751+0000 7fc011200640 1 -- 172.21.15.6:0/324995420 wait complete. 2024-08-17T02:29:50.769 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000329200.data cephfs.volume_0000000000329200.data --yes-i-really-really-mean-it 2024-08-17T02:29:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.927+0000 7f43c9c00640 1 Processor -- start 2024-08-17T02:29:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.927+0000 7f43c9c00640 1 -- start start 2024-08-17T02:29:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.929+0000 7f43c9c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f43c4158dc0 0x7f43c40ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.929+0000 7f43c9c00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43c40cf520 0x7f43c40cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.929+0000 7f43c9c00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c40b3ac0 con 0x7f43c41589f0 2024-08-17T02:29:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.929+0000 7f43c9c00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c40b3190 con 0x7f43c40cf520 2024-08-17T02:29:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.929+0000 7f43c9c00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c40b3470 con 0x7f43c4158dc0 2024-08-17T02:29:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.929+0000 7f43c9200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43c40cf520 0x7f43c40cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.929+0000 7f43c9200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43c40cf520 0x7f43c40cf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40862/0 (socket says 172.21.15.6:40862) 2024-08-17T02:29:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.929+0000 7f43c9200640 1 -- 172.21.15.6:0/2926194553 learned_addr learned my addr 172.21.15.6:0/2926194553 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.929+0000 7f43bb400640 1 --2- 172.21.15.6:0/2926194553 >> v2:172.21.15.136:3300/0 conn(0x7f43c4158dc0 0x7f43c40ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.929+0000 7f43c9200640 1 -- 172.21.15.6:0/2926194553 >> v2:172.21.15.136:3300/0 conn(0x7f43c4158dc0 msgr2=0x7f43c40ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.929+0000 7f43c9200640 1 --2- 172.21.15.6:0/2926194553 >> v2:172.21.15.136:3300/0 conn(0x7f43c4158dc0 0x7f43c40ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.929+0000 7f43c9200640 1 -- 172.21.15.6:0/2926194553 >> v1:172.21.15.136:6789/0 conn(0x7f43c41589f0 legacy=0x7f43c40ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.929+0000 7f43c9200640 1 -- 172.21.15.6:0/2926194553 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c40b3750 con 0x7f43c40cf520 2024-08-17T02:29:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.930+0000 7f43c9200640 1 --2- 172.21.15.6:0/2926194553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c40cf520 0x7f43c40cf910 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f43c4087f10 tx=0x7f43bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d9b15a2eb10539 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.931+0000 7f43c3400640 1 -- 172.21.15.6:0/2926194553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc02e050 con 0x7f43c40cf520 2024-08-17T02:29:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.931+0000 7f43c3400640 1 -- 172.21.15.6:0/2926194553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc007400 con 0x7f43c40cf520 2024-08-17T02:29:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.931+0000 7f43c3400640 1 -- 172.21.15.6:0/2926194553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0077e0 con 0x7f43c40cf520 2024-08-17T02:29:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.931+0000 7f43c9c00640 1 -- 172.21.15.6:0/2926194553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c40cf520 msgr2=0x7f43c40cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.931+0000 7f43c9c00640 1 --2- 172.21.15.6:0/2926194553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c40cf520 0x7f43c40cf910 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f43c4087f10 tx=0x7f43bc009840 comp rx=0 tx=0).stop 2024-08-17T02:29:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.931+0000 7f43c9c00640 1 -- 172.21.15.6:0/2926194553 shutdown_connections 2024-08-17T02:29:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.931+0000 7f43c9c00640 1 --2- 172.21.15.6:0/2926194553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c40cf520 0x7f43c40cf910 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.931+0000 7f43c9c00640 1 --2- 172.21.15.6:0/2926194553 >> v2:172.21.15.136:3300/0 conn(0x7f43c4158dc0 0x7f43c40ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.931+0000 7f43c9c00640 1 -- 172.21.15.6:0/2926194553 >> 172.21.15.6:0/2926194553 conn(0x7f43c4087a80 msgr2=0x7f43c406e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.931+0000 7f43c9c00640 1 -- 172.21.15.6:0/2926194553 shutdown_connections 2024-08-17T02:29:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.931+0000 7f43c9c00640 1 -- 172.21.15.6:0/2926194553 wait complete. 2024-08-17T02:29:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.933+0000 7f43c9c00640 1 Processor -- start 2024-08-17T02:29:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.933+0000 7f43c9c00640 1 -- start start 2024-08-17T02:29:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.934+0000 7f43c9c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c40cf520 0x7f43c4142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.934+0000 7f43c9c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43c41589f0 0x7f43c40c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.934+0000 7f43c9c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43c4158dc0 0x7f43c415c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.934+0000 7f43c9c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40c5600 con 0x7f43c40cf520 2024-08-17T02:29:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.934+0000 7f43c9c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40c58e0 con 0x7f43c41589f0 2024-08-17T02:29:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.934+0000 7f43c9c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40c5bc0 con 0x7f43c4158dc0 2024-08-17T02:29:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.934+0000 7f43c3e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c40cf520 0x7f43c4142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.934+0000 7f43c3e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c40cf520 0x7f43c4142890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40878/0 (socket says 172.21.15.6:40878) 2024-08-17T02:29:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.934+0000 7f43c3e00640 1 -- 172.21.15.6:0/3679192882 learned_addr learned my addr 172.21.15.6:0/3679192882 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.934+0000 7f43c3e00640 1 -- 172.21.15.6:0/3679192882 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43c4158dc0 msgr2=0x7f43c415c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.934+0000 7f43c3e00640 1 --2- 172.21.15.6:0/3679192882 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43c4158dc0 0x7f43c415c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.934+0000 7f43bb400640 1 --2- 172.21.15.6:0/3679192882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43c41589f0 0x7f43c40c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.934+0000 7f43c3e00640 1 -- 172.21.15.6:0/3679192882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43c41589f0 msgr2=0x7f43c40c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.935+0000 7f43c3e00640 1 --2- 172.21.15.6:0/3679192882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43c41589f0 0x7f43c40c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.935+0000 7f43c3e00640 1 -- 172.21.15.6:0/3679192882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc009ae0 con 0x7f43c40cf520 2024-08-17T02:29:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.935+0000 7f43bb400640 1 --2- 172.21.15.6:0/3679192882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43c41589f0 0x7f43c40c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.935+0000 7f43c3e00640 1 --2- 172.21.15.6:0/3679192882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c40cf520 0x7f43c4142890 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f43b400c560 tx=0x7f43b4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.935+0000 7f43bbe00640 1 -- 172.21.15.6:0/3679192882 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b4011590 con 0x7f43c40cf520 2024-08-17T02:29:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.935+0000 7f43bbe00640 1 -- 172.21.15.6:0/3679192882 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b4011710 con 0x7f43c40cf520 2024-08-17T02:29:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.935+0000 7f43bbe00640 1 -- 172.21.15.6:0/3679192882 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b4011ad0 con 0x7f43c40cf520 2024-08-17T02:29:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.935+0000 7f43c9c00640 1 -- 172.21.15.6:0/3679192882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c40c5ea0 con 0x7f43c40cf520 2024-08-17T02:29:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.935+0000 7f43c9c00640 1 -- 172.21.15.6:0/3679192882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c4142dd0 con 0x7f43c40cf520 2024-08-17T02:29:50.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.936+0000 7f43c9c00640 1 -- 172.21.15.6:0/3679192882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c4063f10 con 0x7f43c40cf520 2024-08-17T02:29:50.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.937+0000 7f43bbe00640 1 -- 172.21.15.6:0/3679192882 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f43b401b3b0 con 0x7f43c40cf520 2024-08-17T02:29:50.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.938+0000 7f43bbe00640 1 --2- 172.21.15.6:0/3679192882 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f43a0065150 0x7f43a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.938+0000 7f43bbe00640 1 -- 172.21.15.6:0/3679192882 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5448+0+0 (secure 0 0 0) 0x7f43b4081990 con 0x7f43c40cf520 2024-08-17T02:29:50.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.939+0000 7f43bb400640 1 --2- 172.21.15.6:0/3679192882 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f43a0065150 0x7f43a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.940+0000 7f43bb400640 1 --2- 172.21.15.6:0/3679192882 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f43a0065150 0x7f43a0067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f43c40c72f0 tx=0x7f43ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:50.942+0000 7f43bbe00640 1 -- 172.21.15.6:0/3679192882 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f43b404fab0 con 0x7f43c40cf520 2024-08-17T02:29:51.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.127+0000 7f43c9c00640 1 -- 172.21.15.6:0/3679192882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000329200.data", "pool2": "cephfs.volume_0000000000329200.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f43c4088a10 con 0x7f43c40cf520 2024-08-17T02:29:51.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.761+0000 7f43bbe00640 1 -- 172.21.15.6:0/3679192882 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000329200.data", "pool2": "cephfs.volume_0000000000329200.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000329200.data' removed v43) v1 ==== 241+0+0 (secure 0 0 0) 0x7f43b4017070 con 0x7f43c40cf520 2024-08-17T02:29:51.762 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs.volume_0000000000329200.data' removed 2024-08-17T02:29:51.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.764+0000 7f43c9c00640 1 -- 172.21.15.6:0/3679192882 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f43a0065150 msgr2=0x7f43a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.764+0000 7f43c9c00640 1 --2- 172.21.15.6:0/3679192882 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f43a0065150 0x7f43a0067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f43c40c72f0 tx=0x7f43ac008040 comp rx=0 tx=0).stop 2024-08-17T02:29:51.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.764+0000 7f43c9c00640 1 -- 172.21.15.6:0/3679192882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c40cf520 msgr2=0x7f43c4142890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.764+0000 7f43c9c00640 1 --2- 172.21.15.6:0/3679192882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c40cf520 0x7f43c4142890 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f43b400c560 tx=0x7f43b4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.764+0000 7f43c9c00640 1 -- 172.21.15.6:0/3679192882 shutdown_connections 2024-08-17T02:29:51.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.764+0000 7f43c9c00640 1 --2- 172.21.15.6:0/3679192882 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f43a0065150 0x7f43a0067600 secure :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f43c40c72f0 tx=0x7f43ac008040 comp rx=0 tx=0).stop 2024-08-17T02:29:51.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.764+0000 7f43c9c00640 1 --2- 172.21.15.6:0/3679192882 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43c4158dc0 0x7f43c415c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.764+0000 7f43c9c00640 1 --2- 172.21.15.6:0/3679192882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43c41589f0 0x7f43c40c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.764+0000 7f43c9c00640 1 --2- 172.21.15.6:0/3679192882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c40cf520 0x7f43c4142890 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.764+0000 7f43c9c00640 1 -- 172.21.15.6:0/3679192882 >> 172.21.15.6:0/3679192882 conn(0x7f43c4087a80 msgr2=0x7f43c4159220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:51.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.765+0000 7f43c9c00640 1 -- 172.21.15.6:0/3679192882 shutdown_connections 2024-08-17T02:29:51.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.765+0000 7f43c9c00640 1 -- 172.21.15.6:0/3679192882 wait complete. 2024-08-17T02:29:51.783 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:29:51.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.939+0000 7f88e9e00640 1 Processor -- start 2024-08-17T02:29:51.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.939+0000 7f88e9e00640 1 -- start start 2024-08-17T02:29:51.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.940+0000 7f88e9e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f88e4158f50 0x7f88e406c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.940+0000 7f88e9e00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e40b00c0 con 0x7f88e40af040 2024-08-17T02:29:51.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.940+0000 7f88e9e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e40af7d0 con 0x7f88e4158b80 2024-08-17T02:29:51.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.940+0000 7f88e9e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e40afa70 con 0x7f88e4158f50 2024-08-17T02:29:51.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.940+0000 7f88e3e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f88e40af040 0x7f88e40b0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39754/0 (socket says 172.21.15.6:39754) 2024-08-17T02:29:51.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.940+0000 7f88e3e00640 1 -- 172.21.15.6:0/2745239407 learned_addr learned my addr 172.21.15.6:0/2745239407 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:51.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.941+0000 7f88e9400640 1 --2- 172.21.15.6:0/2745239407 >> v2:172.21.15.136:3300/0 conn(0x7f88e4158f50 0x7f88e406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.941+0000 7f88e3400640 1 -- 172.21.15.6:0/2745239407 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345730213 0 0) 0x7f88e40b00c0 con 0x7f88e40af040 2024-08-17T02:29:51.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.941+0000 7f88e3400640 1 -- 172.21.15.6:0/2745239407 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88cc0034e0 con 0x7f88e40af040 2024-08-17T02:29:51.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.941+0000 7f88e3400640 1 -- 172.21.15.6:0/2745239407 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694592380 0 0) 0x7f88e40af7d0 con 0x7f88e4158b80 2024-08-17T02:29:51.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.941+0000 7f88e3400640 1 -- 172.21.15.6:0/2745239407 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88e40b00c0 con 0x7f88e4158b80 2024-08-17T02:29:51.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.941+0000 7f88e9400640 1 -- 172.21.15.6:0/2745239407 >> v1:172.21.15.136:6789/0 conn(0x7f88e4158b80 legacy=0x7f88e40ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.941+0000 7f88e9400640 1 -- 172.21.15.6:0/2745239407 >> v1:172.21.15.6:6789/0 conn(0x7f88e40af040 legacy=0x7f88e40b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.941+0000 7f88e3400640 1 -- 172.21.15.6:0/2745239407 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1621421218 0 0) 0x7f88cc0034e0 con 0x7f88e40af040 2024-08-17T02:29:51.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.941+0000 7f88e9400640 1 -- 172.21.15.6:0/2745239407 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e40afd50 con 0x7f88e4158f50 2024-08-17T02:29:51.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.942+0000 7f88e9400640 1 --2- 172.21.15.6:0/2745239407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88e4158f50 0x7f88e406c400 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009e60 tx=0x7f88dc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=185147bb1f34094c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.942+0000 7f88e3400640 1 -- 172.21.15.6:0/2745239407 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d0001470 con 0x7f88e4158f50 2024-08-17T02:29:51.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.943+0000 7f88e3400640 1 -- 172.21.15.6:0/2745239407 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc02d050 con 0x7f88e4158f50 2024-08-17T02:29:51.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.943+0000 7f88e3400640 1 -- 172.21.15.6:0/2745239407 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc031630 con 0x7f88e4158f50 2024-08-17T02:29:51.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.943+0000 7f88e9e00640 1 -- 172.21.15.6:0/2745239407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88e4158f50 msgr2=0x7f88e406c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.943+0000 7f88e9e00640 1 --2- 172.21.15.6:0/2745239407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88e4158f50 0x7f88e406c400 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009e60 tx=0x7f88dc009780 comp rx=0 tx=0).stop 2024-08-17T02:29:51.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.943+0000 7f88e9e00640 1 -- 172.21.15.6:0/2745239407 shutdown_connections 2024-08-17T02:29:51.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.943+0000 7f88e9e00640 1 --2- 172.21.15.6:0/2745239407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88e4158f50 0x7f88e406c400 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.943+0000 7f88e9e00640 1 -- 172.21.15.6:0/2745239407 >> 172.21.15.6:0/2745239407 conn(0x7f88e4095a70 msgr2=0x7f88e4095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:51.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.943+0000 7f88e9e00640 1 -- 172.21.15.6:0/2745239407 shutdown_connections 2024-08-17T02:29:51.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.943+0000 7f88e9e00640 1 -- 172.21.15.6:0/2745239407 wait complete. 2024-08-17T02:29:51.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.945+0000 7f88e9e00640 1 Processor -- start 2024-08-17T02:29:51.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.945+0000 7f88e9e00640 1 -- start start 2024-08-17T02:29:51.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.946+0000 7f88e9e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f88e40af040 0x7f88e4147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.946+0000 7f88e9e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e4158b80 0x7f88e416bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.946+0000 7f88e9e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88e4158f50 0x7f88e416c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.946+0000 7f88e9e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e415ea80 con 0x7f88e4158b80 2024-08-17T02:29:51.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.946+0000 7f88e9e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e415ed60 con 0x7f88e4158f50 2024-08-17T02:29:51.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.946+0000 7f88e9e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e40988f0 con 0x7f88e40af040 2024-08-17T02:29:51.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.946+0000 7f88e3e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e4158b80 0x7f88e416bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.946+0000 7f88e3e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e4158b80 0x7f88e416bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40882/0 (socket says 172.21.15.6:40882) 2024-08-17T02:29:51.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.946+0000 7f88e3e00640 1 -- 172.21.15.6:0/653071111 learned_addr learned my addr 172.21.15.6:0/653071111 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:51.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.946+0000 7f88e9400640 1 --2- 172.21.15.6:0/653071111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88e4158f50 0x7f88e416c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.946+0000 7f88e8a00640 1 --2- 172.21.15.6:0/653071111 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f88e40af040 0x7f88e4147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.946+0000 7f88e3e00640 1 -- 172.21.15.6:0/653071111 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f88e40af040 msgr2=0x7f88e4147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.946+0000 7f88e3e00640 1 --2- 172.21.15.6:0/653071111 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f88e40af040 0x7f88e4147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.947+0000 7f88e3e00640 1 -- 172.21.15.6:0/653071111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88e4158f50 msgr2=0x7f88e416c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.947+0000 7f88e3e00640 1 --2- 172.21.15.6:0/653071111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88e4158f50 0x7f88e416c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.947+0000 7f88e3e00640 1 -- 172.21.15.6:0/653071111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc009a20 con 0x7f88e4158b80 2024-08-17T02:29:51.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.947+0000 7f88e3e00640 1 --2- 172.21.15.6:0/653071111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e4158b80 0x7f88e416bf60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f88d000cb70 tx=0x7f88d0001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.947+0000 7f88d7e00640 1 -- 172.21.15.6:0/653071111 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d0007360 con 0x7f88e4158b80 2024-08-17T02:29:51.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.947+0000 7f88e9e00640 1 -- 172.21.15.6:0/653071111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e4098bd0 con 0x7f88e4158b80 2024-08-17T02:29:51.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.948+0000 7f88d7e00640 1 -- 172.21.15.6:0/653071111 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d0007500 con 0x7f88e4158b80 2024-08-17T02:29:51.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.948+0000 7f88d7e00640 1 -- 172.21.15.6:0/653071111 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d0007670 con 0x7f88e4158b80 2024-08-17T02:29:51.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.948+0000 7f88e9e00640 1 -- 172.21.15.6:0/653071111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e4158060 con 0x7f88e4158b80 2024-08-17T02:29:51.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.949+0000 7f88e9e00640 1 -- 172.21.15.6:0/653071111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e4098e10 con 0x7f88e4158b80 2024-08-17T02:29:51.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.950+0000 7f88d7e00640 1 -- 172.21.15.6:0/653071111 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f88d0004cc0 con 0x7f88e4158b80 2024-08-17T02:29:51.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.952+0000 7f88d7e00640 1 --2- 172.21.15.6:0/653071111 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f88c4065150 0x7f88c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.952+0000 7f88d7e00640 1 -- 172.21.15.6:0/653071111 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f88d0081b10 con 0x7f88e4158b80 2024-08-17T02:29:51.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.953+0000 7f88e8a00640 1 --2- 172.21.15.6:0/653071111 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f88c4065150 0x7f88c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.955+0000 7f88e8a00640 1 --2- 172.21.15.6:0/653071111 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f88c4065150 0x7f88c4067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f88d80037e0 tx=0x7f88d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:51.957+0000 7f88d7e00640 1 -- 172.21.15.6:0/653071111 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f88e4098e10 con 0x7f88e4158b80 2024-08-17T02:29:52.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.142+0000 7f88e9e00640 1 -- 172.21.15.6:0/653071111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f88e4098e10 con 0x7f88e4158b80 2024-08-17T02:29:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.146+0000 7f88d7e00640 1 -- 172.21.15.6:0/653071111 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f88e4098e10 con 0x7f88e4158b80 2024-08-17T02:29:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.148+0000 7f88e9e00640 1 -- 172.21.15.6:0/653071111 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f88c4065150 msgr2=0x7f88c4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.148+0000 7f88e9e00640 1 --2- 172.21.15.6:0/653071111 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f88c4065150 0x7f88c4067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f88d80037e0 tx=0x7f88d8009040 comp rx=0 tx=0).stop 2024-08-17T02:29:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.148+0000 7f88e9e00640 1 -- 172.21.15.6:0/653071111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e4158b80 msgr2=0x7f88e416bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.148+0000 7f88e9e00640 1 --2- 172.21.15.6:0/653071111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e4158b80 0x7f88e416bf60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f88d000cb70 tx=0x7f88d0001b00 comp rx=0 tx=0).stop 2024-08-17T02:29:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.148+0000 7f88e9e00640 1 -- 172.21.15.6:0/653071111 shutdown_connections 2024-08-17T02:29:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.148+0000 7f88e9e00640 1 --2- 172.21.15.6:0/653071111 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f88c4065150 0x7f88c4067600 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.148+0000 7f88e9e00640 1 --2- 172.21.15.6:0/653071111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88e4158f50 0x7f88e416c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.148+0000 7f88e9e00640 1 --2- 172.21.15.6:0/653071111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e4158b80 0x7f88e416bf60 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.148+0000 7f88e9e00640 1 --2- 172.21.15.6:0/653071111 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f88e40af040 0x7f88e4147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.148+0000 7f88e9e00640 1 -- 172.21.15.6:0/653071111 >> 172.21.15.6:0/653071111 conn(0x7f88e4095a70 msgr2=0x7f88e40cac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.148+0000 7f88e9e00640 1 -- 172.21.15.6:0/653071111 shutdown_connections 2024-08-17T02:29:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.148+0000 7f88e9e00640 1 -- 172.21.15.6:0/653071111 wait complete. 2024-08-17T02:29:52.164 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:29:52.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.314+0000 7f41f3200640 1 Processor -- start 2024-08-17T02:29:52.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.314+0000 7f41f3200640 1 -- start start 2024-08-17T02:29:52.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.315+0000 7f41f3200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41f415a490 0x7f41f40ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.315+0000 7f41f3200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41f40b1920 0x7f41f40b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.315+0000 7f41f3200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f415b6b0 con 0x7f41f4158c60 2024-08-17T02:29:52.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.315+0000 7f41f3200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f40b0540 con 0x7f41f415a490 2024-08-17T02:29:52.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.315+0000 7f41f3200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f415a8b0 con 0x7f41f40b1920 2024-08-17T02:29:52.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.315+0000 7f41ebe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41f415a490 0x7f41f40ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.315+0000 7f41ebe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41f415a490 0x7f41f40ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40896/0 (socket says 172.21.15.6:40896) 2024-08-17T02:29:52.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.315+0000 7f41ebe00640 1 -- 172.21.15.6:0/2757943489 learned_addr learned my addr 172.21.15.6:0/2757943489 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:52.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.315+0000 7f41f2800640 1 --2- 172.21.15.6:0/2757943489 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41f40b1920 0x7f41f40b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.316+0000 7f41ebe00640 1 -- 172.21.15.6:0/2757943489 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41f40b1920 msgr2=0x7f41f40b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:52.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.316+0000 7f41ebe00640 1 --2- 172.21.15.6:0/2757943489 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41f40b1920 0x7f41f40b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.316+0000 7f41ebe00640 1 -- 172.21.15.6:0/2757943489 >> v1:172.21.15.136:6789/0 conn(0x7f41f4158c60 legacy=0x7f41f4159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:52.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.316+0000 7f41ebe00640 1 -- 172.21.15.6:0/2757943489 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f415aac0 con 0x7f41f415a490 2024-08-17T02:29:52.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.317+0000 7f41ebe00640 1 --2- 172.21.15.6:0/2757943489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f415a490 0x7f41f40ca8b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009910 tx=0x7f41dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe49359a77c21e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.317+0000 7f41f1400640 1 -- 172.21.15.6:0/2757943489 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc02adb0 con 0x7f41f415a490 2024-08-17T02:29:52.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.317+0000 7f41f1400640 1 -- 172.21.15.6:0/2757943489 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41dc032440 con 0x7f41f415a490 2024-08-17T02:29:52.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.317+0000 7f41f1400640 1 -- 172.21.15.6:0/2757943489 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc032820 con 0x7f41f415a490 2024-08-17T02:29:52.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.317+0000 7f41f3200640 1 -- 172.21.15.6:0/2757943489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f415a490 msgr2=0x7f41f40ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.317+0000 7f41f3200640 1 --2- 172.21.15.6:0/2757943489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f415a490 0x7f41f40ca8b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009910 tx=0x7f41dc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.318+0000 7f41f3200640 1 -- 172.21.15.6:0/2757943489 shutdown_connections 2024-08-17T02:29:52.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.318+0000 7f41f3200640 1 --2- 172.21.15.6:0/2757943489 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41f40b1920 0x7f41f40b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.318+0000 7f41f3200640 1 --2- 172.21.15.6:0/2757943489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f415a490 0x7f41f40ca8b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.318+0000 7f41f3200640 1 -- 172.21.15.6:0/2757943489 >> 172.21.15.6:0/2757943489 conn(0x7f41f406e590 msgr2=0x7f41f406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:52.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.318+0000 7f41f3200640 1 -- 172.21.15.6:0/2757943489 shutdown_connections 2024-08-17T02:29:52.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.318+0000 7f41f3200640 1 -- 172.21.15.6:0/2757943489 wait complete. 2024-08-17T02:29:52.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.319+0000 7f41f3200640 1 Processor -- start 2024-08-17T02:29:52.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.319+0000 7f41f3200640 1 -- start start 2024-08-17T02:29:52.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.320+0000 7f41f3200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41f40b1920 0x7f41f40c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.320+0000 7f41f3200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f4158c60 0x7f41f40c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.320+0000 7f41f3200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41f415a490 0x7f41f4151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.320+0000 7f41f3200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f40c9070 con 0x7f41f4158c60 2024-08-17T02:29:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.320+0000 7f41f3200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f40c46b0 con 0x7f41f415a490 2024-08-17T02:29:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.320+0000 7f41f3200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f40c4990 con 0x7f41f40b1920 2024-08-17T02:29:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.320+0000 7f41ebe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f4158c60 0x7f41f40c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.320+0000 7f41ebe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f4158c60 0x7f41f40c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40912/0 (socket says 172.21.15.6:40912) 2024-08-17T02:29:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.320+0000 7f41ebe00640 1 -- 172.21.15.6:0/2197014429 learned_addr learned my addr 172.21.15.6:0/2197014429 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.320+0000 7f41f1e00640 1 --2- 172.21.15.6:0/2197014429 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41f40b1920 0x7f41f40c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.320+0000 7f41f2800640 1 --2- 172.21.15.6:0/2197014429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41f415a490 0x7f41f4151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.321+0000 7f41ebe00640 1 -- 172.21.15.6:0/2197014429 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41f40b1920 msgr2=0x7f41f40c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.321+0000 7f41ebe00640 1 --2- 172.21.15.6:0/2197014429 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41f40b1920 0x7f41f40c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.321+0000 7f41ebe00640 1 -- 172.21.15.6:0/2197014429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41f415a490 msgr2=0x7f41f4151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.321+0000 7f41ebe00640 1 --2- 172.21.15.6:0/2197014429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41f415a490 0x7f41f4151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.321+0000 7f41ebe00640 1 -- 172.21.15.6:0/2197014429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc009450 con 0x7f41f4158c60 2024-08-17T02:29:52.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.321+0000 7f41f2800640 1 --2- 172.21.15.6:0/2197014429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41f415a490 0x7f41f4151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:52.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.321+0000 7f41ebe00640 1 --2- 172.21.15.6:0/2197014429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f4158c60 0x7f41f40c8b30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f41dc035040 tx=0x7f41dc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.321+0000 7f41e9600640 1 -- 172.21.15.6:0/2197014429 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc031bb0 con 0x7f41f4158c60 2024-08-17T02:29:52.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.321+0000 7f41e9600640 1 -- 172.21.15.6:0/2197014429 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41dc031d30 con 0x7f41f4158c60 2024-08-17T02:29:52.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.321+0000 7f41e9600640 1 -- 172.21.15.6:0/2197014429 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc031ea0 con 0x7f41f4158c60 2024-08-17T02:29:52.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.321+0000 7f41f3200640 1 -- 172.21.15.6:0/2197014429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f40c4c70 con 0x7f41f4158c60 2024-08-17T02:29:52.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.322+0000 7f41f3200640 1 -- 172.21.15.6:0/2197014429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f40c5230 con 0x7f41f4158c60 2024-08-17T02:29:52.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.322+0000 7f41f3200640 1 -- 172.21.15.6:0/2197014429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f40c5450 con 0x7f41f4158c60 2024-08-17T02:29:52.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.323+0000 7f41e9600640 1 -- 172.21.15.6:0/2197014429 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f41dc039040 con 0x7f41f4158c60 2024-08-17T02:29:52.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.324+0000 7f41e9600640 1 --2- 172.21.15.6:0/2197014429 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f41d0065150 0x7f41d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.324+0000 7f41e9600640 1 -- 172.21.15.6:0/2197014429 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f41dc0a20a0 con 0x7f41f4158c60 2024-08-17T02:29:52.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.324+0000 7f41f1e00640 1 --2- 172.21.15.6:0/2197014429 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f41d0065150 0x7f41d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.325+0000 7f41f1e00640 1 --2- 172.21.15.6:0/2197014429 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f41d0065150 0x7f41d0067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f41e4007fd0 tx=0x7f41e4007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.328+0000 7f41e9600640 1 -- 172.21.15.6:0/2197014429 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f41dc070410 con 0x7f41f4158c60 2024-08-17T02:29:52.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.580+0000 7f41f3200640 1 -- 172.21.15.6:0/2197014429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f41f4070720 con 0x7f41f4158c60 2024-08-17T02:29:52.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.762+0000 7f41e9600640 1 -- 172.21.15.6:0/2197014429 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v159) v1 ==== 135+0+0 (secure 0 0 0) 0x7f41dc073a30 con 0x7f41f4158c60 2024-08-17T02:29:52.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.764+0000 7f41f3200640 1 -- 172.21.15.6:0/2197014429 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f41d0065150 msgr2=0x7f41d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.764+0000 7f41f3200640 1 --2- 172.21.15.6:0/2197014429 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f41d0065150 0x7f41d0067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f41e4007fd0 tx=0x7f41e4007e30 comp rx=0 tx=0).stop 2024-08-17T02:29:52.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.764+0000 7f41f3200640 1 -- 172.21.15.6:0/2197014429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f4158c60 msgr2=0x7f41f40c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.764+0000 7f41f3200640 1 --2- 172.21.15.6:0/2197014429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f4158c60 0x7f41f40c8b30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f41dc035040 tx=0x7f41dc032000 comp rx=0 tx=0).stop 2024-08-17T02:29:52.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.764+0000 7f41f3200640 1 -- 172.21.15.6:0/2197014429 shutdown_connections 2024-08-17T02:29:52.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.764+0000 7f41f3200640 1 --2- 172.21.15.6:0/2197014429 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f41d0065150 0x7f41d0067600 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.764+0000 7f41f3200640 1 --2- 172.21.15.6:0/2197014429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41f415a490 0x7f41f4151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.764+0000 7f41f3200640 1 --2- 172.21.15.6:0/2197014429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f4158c60 0x7f41f40c8b30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.764+0000 7f41f3200640 1 --2- 172.21.15.6:0/2197014429 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41f40b1920 0x7f41f40c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.764+0000 7f41f3200640 1 -- 172.21.15.6:0/2197014429 >> 172.21.15.6:0/2197014429 conn(0x7f41f406e590 msgr2=0x7f41f40cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.764+0000 7f41f3200640 1 -- 172.21.15.6:0/2197014429 shutdown_connections 2024-08-17T02:29:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:52.764+0000 7f41f3200640 1 -- 172.21.15.6:0/2197014429 wait complete. 2024-08-17T02:29:52.783 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:29:52.784 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:52.784 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:29:52.784 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:52.784 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:29:52.784 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:29:52.784 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:29:52.784 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:29:52.784 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:29:52.784 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:29:52.784 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:29:52.784 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:29:52.784 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:29:52.785 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:29:52.785 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:29:52.785 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:29:52.785 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:29:52.785 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:29:52.785 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:29:52.785 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:29:52.785 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:29:52.785 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:29:52.785 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:29:52.785 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:29:52.785 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:29:52.785 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000329200 --yes-i-really-mean-it' 2024-08-17T02:29:52.785 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:52.785 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:29:52.786 INFO:tasks.cephfs_test_runner:Ran 1 test in 169.500s 2024-08-17T02:29:52.786 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:52.786 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:29:52.786 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:52.786 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:29:52.786 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:52.786 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:29:52.786 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:29:52.786 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:29:52.786 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:29:52.786 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:29:52.786 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:29:52.787 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:29:52.787 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:29:52.787 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:29:52.787 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:29:52.787 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:29:52.787 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:29:52.787 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:29:52.787 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:29:52.787 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:29:52.787 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:29:52.787 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:29:52.787 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:29:52.787 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:29:52.787 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:29:52.787 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:29:52.787 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000329200 --yes-i-really-mean-it' 2024-08-17T02:29:52.787 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:52.788 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:53.009 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=97e8629d1ae14df1ad4d0496f4225ef3 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:53.010 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:29:53.023 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-17T02:29:53.045 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-17T02:29:53.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:53.045 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-08-17T02:29:53.084 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:29:53.085 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:29:53.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:53.086 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:29:53.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:53.183 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:29:53.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:53.445 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-08-17T02:29:53.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:53.723 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-08-17T02:29:53.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:53.759 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-08-17T02:29:53.859 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2024-08-17T02:29:53.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:53.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:53.862 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-08-17T02:29:53.902 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:29:53.902 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:29:53.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:53.903 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:29:54.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:54.004 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:29:54.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:54.251 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-08-17T02:29:54.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:54.580 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-08-17T02:29:54.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:54.617 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-08-17T02:29:54.716 INFO:teuthology.orchestra.run.smithi136.stderr:Cannot find device "ceph-brx" 2024-08-17T02:29:54.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:54.719 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:29:54.728 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:29:54.728 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:54.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.892+0000 7f9c2b200640 1 Processor -- start 2024-08-17T02:29:54.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.892+0000 7f9c2b200640 1 -- start start 2024-08-17T02:29:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.893+0000 7f9c2b200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c2c0cadc0 0x7f9c2c0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.893+0000 7f9c2b200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2c0cf600 con 0x7f9c2c158c90 2024-08-17T02:29:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.893+0000 7f9c2b200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2c0cea90 con 0x7f9c2c0cca40 2024-08-17T02:29:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.893+0000 7f9c2b200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c2c0ce890 con 0x7f9c2c0cadc0 2024-08-17T02:29:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.893+0000 7f9c29e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9c2c158c90 0x7f9c2c0ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46316/0 (socket says 172.21.15.6:46316) 2024-08-17T02:29:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.893+0000 7f9c29e00640 1 -- 172.21.15.6:0/6547847 learned_addr learned my addr 172.21.15.6:0/6547847 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.893+0000 7f9c23e00640 1 --2- 172.21.15.6:0/6547847 >> v2:172.21.15.6:3300/0 conn(0x7f9c2c0cadc0 0x7f9c2c0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.894+0000 7f9c23e00640 1 -- 172.21.15.6:0/6547847 >> v1:172.21.15.136:6789/0 conn(0x7f9c2c0cca40 legacy=0x7f9c2c0af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.894+0000 7f9c23e00640 1 -- 172.21.15.6:0/6547847 >> v1:172.21.15.6:6789/0 conn(0x7f9c2c158c90 legacy=0x7f9c2c0ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.894+0000 7f9c29400640 1 -- 172.21.15.6:0/6547847 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468338304 0 0) 0x7f9c2c0cf600 con 0x7f9c2c158c90 2024-08-17T02:29:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.894+0000 7f9c23e00640 1 -- 172.21.15.6:0/6547847 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c0ced30 con 0x7f9c2c0cadc0 2024-08-17T02:29:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.895+0000 7f9c23e00640 1 --2- 172.21.15.6:0/6547847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c2c0cadc0 0x7f9c2c0cc500 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9c14009850 tx=0x7f9c140090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1271b0918237d321 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.895+0000 7f9c29400640 1 -- 172.21.15.6:0/6547847 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1402ae20 con 0x7f9c2c0cadc0 2024-08-17T02:29:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.895+0000 7f9c29400640 1 -- 172.21.15.6:0/6547847 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c14032440 con 0x7f9c2c0cadc0 2024-08-17T02:29:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.895+0000 7f9c29400640 1 -- 172.21.15.6:0/6547847 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c140327e0 con 0x7f9c2c0cadc0 2024-08-17T02:29:54.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.896+0000 7f9c2b200640 1 -- 172.21.15.6:0/6547847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c2c0cadc0 msgr2=0x7f9c2c0cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.896+0000 7f9c2b200640 1 --2- 172.21.15.6:0/6547847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c2c0cadc0 0x7f9c2c0cc500 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9c14009850 tx=0x7f9c140090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.896+0000 7f9c2b200640 1 -- 172.21.15.6:0/6547847 shutdown_connections 2024-08-17T02:29:54.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.896+0000 7f9c2b200640 1 --2- 172.21.15.6:0/6547847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c2c0cadc0 0x7f9c2c0cc500 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.896+0000 7f9c2b200640 1 -- 172.21.15.6:0/6547847 >> 172.21.15.6:0/6547847 conn(0x7f9c2c087a80 msgr2=0x7f9c2c06e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:54.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.896+0000 7f9c2b200640 1 -- 172.21.15.6:0/6547847 shutdown_connections 2024-08-17T02:29:54.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.896+0000 7f9c2b200640 1 -- 172.21.15.6:0/6547847 wait complete. 2024-08-17T02:29:54.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.897+0000 7f9c2b200640 1 Processor -- start 2024-08-17T02:29:54.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.897+0000 7f9c2b200640 1 -- start start 2024-08-17T02:29:54.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.898+0000 7f9c2b200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c2c0cadc0 0x7f9c2c14e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.898+0000 7f9c2b200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c2c0cca40 0x7f9c2c0b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.898+0000 7f9c2b200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9c2c158c90 0x7f9c2c0b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.898+0000 7f9c2b200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c1596f0 con 0x7f9c2c0cadc0 2024-08-17T02:29:54.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.898+0000 7f9c2b200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c1590e0 con 0x7f9c2c0cca40 2024-08-17T02:29:54.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.898+0000 7f9c2b200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c14ec40 con 0x7f9c2c158c90 2024-08-17T02:29:54.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.898+0000 7f9c29e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c2c0cadc0 0x7f9c2c14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.899+0000 7f9c29e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c2c0cadc0 0x7f9c2c14e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51794/0 (socket says 172.21.15.6:51794) 2024-08-17T02:29:54.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.899+0000 7f9c29e00640 1 -- 172.21.15.6:0/3191301498 learned_addr learned my addr 172.21.15.6:0/3191301498 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:54.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.899+0000 7f9c23e00640 1 --2- 172.21.15.6:0/3191301498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c2c0cca40 0x7f9c2c0b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.899+0000 7f9c2a800640 1 --2- 172.21.15.6:0/3191301498 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9c2c158c90 0x7f9c2c0b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.899+0000 7f9c29e00640 1 -- 172.21.15.6:0/3191301498 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9c2c158c90 msgr2=0x7f9c2c0b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.899+0000 7f9c29e00640 1 --2- 172.21.15.6:0/3191301498 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9c2c158c90 0x7f9c2c0b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.899+0000 7f9c29e00640 1 -- 172.21.15.6:0/3191301498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c2c0cca40 msgr2=0x7f9c2c0b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.899+0000 7f9c29e00640 1 --2- 172.21.15.6:0/3191301498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c2c0cca40 0x7f9c2c0b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.899+0000 7f9c29e00640 1 -- 172.21.15.6:0/3191301498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c14009390 con 0x7f9c2c0cadc0 2024-08-17T02:29:54.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.899+0000 7f9c23e00640 1 --2- 172.21.15.6:0/3191301498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c2c0cca40 0x7f9c2c0b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:54.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.899+0000 7f9c29e00640 1 --2- 172.21.15.6:0/3191301498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c2c0cadc0 0x7f9c2c14e700 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00c510 tx=0x7f9c1c007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.900+0000 7f9c21600640 1 -- 172.21.15.6:0/3191301498 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c005aa0 con 0x7f9c2c0cadc0 2024-08-17T02:29:54.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.900+0000 7f9c21600640 1 -- 172.21.15.6:0/3191301498 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c005c00 con 0x7f9c2c0cadc0 2024-08-17T02:29:54.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.900+0000 7f9c21600640 1 -- 172.21.15.6:0/3191301498 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c0070d0 con 0x7f9c2c0cadc0 2024-08-17T02:29:54.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.900+0000 7f9c2b200640 1 -- 172.21.15.6:0/3191301498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2c0b32b0 con 0x7f9c2c0cadc0 2024-08-17T02:29:54.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.900+0000 7f9c2b200640 1 -- 172.21.15.6:0/3191301498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2c159380 con 0x7f9c2c0cadc0 2024-08-17T02:29:54.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.901+0000 7f9c2b200640 1 -- 172.21.15.6:0/3191301498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2c0b37b0 con 0x7f9c2c0cadc0 2024-08-17T02:29:54.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.902+0000 7f9c21600640 1 -- 172.21.15.6:0/3191301498 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9c1c007500 con 0x7f9c2c0cadc0 2024-08-17T02:29:54.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.903+0000 7f9c21600640 1 --2- 172.21.15.6:0/3191301498 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9c08065150 0x7f9c08067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.903+0000 7f9c21600640 1 -- 172.21.15.6:0/3191301498 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9c1c0816c0 con 0x7f9c2c0cadc0 2024-08-17T02:29:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.903+0000 7f9c23e00640 1 --2- 172.21.15.6:0/3191301498 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9c08065150 0x7f9c08067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.904+0000 7f9c23e00640 1 --2- 172.21.15.6:0/3191301498 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9c08065150 0x7f9c08067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9c14034000 tx=0x7f9c14032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:54.907+0000 7f9c21600640 1 -- 172.21.15.6:0/3191301498 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9c2c0b37b0 con 0x7f9c2c0cadc0 2024-08-17T02:29:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.091+0000 7f9c2b200640 1 -- 172.21.15.6:0/3191301498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c2c0b37b0 con 0x7f9c2c0cadc0 2024-08-17T02:29:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.092+0000 7f9c21600640 1 -- 172.21.15.6:0/3191301498 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12339 (secure 0 0 0) 0x7f9c2c0b37b0 con 0x7f9c2c0cadc0 2024-08-17T02:29:55.093 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:55.093 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:29:51.754037+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6834/2620799775":"2024-08-18T02:29:48.568759+0000","172.21.15.6:6832/2620799775":"2024-08-18T02:29:48.568759+0000","172.21.15.6:6835/285178879":"2024-08-18T02:29:41.592570+0000","172.21.15.6:6833/285178879":"2024-08-18T02:29:41.592570+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.094+0000 7f9c2b200640 1 -- 172.21.15.6:0/3191301498 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9c08065150 msgr2=0x7f9c08067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.094+0000 7f9c2b200640 1 --2- 172.21.15.6:0/3191301498 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9c08065150 0x7f9c08067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9c14034000 tx=0x7f9c14032000 comp rx=0 tx=0).stop 2024-08-17T02:29:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.094+0000 7f9c2b200640 1 -- 172.21.15.6:0/3191301498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c2c0cadc0 msgr2=0x7f9c2c14e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.094+0000 7f9c2b200640 1 --2- 172.21.15.6:0/3191301498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c2c0cadc0 0x7f9c2c14e700 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00c510 tx=0x7f9c1c007f30 comp rx=0 tx=0).stop 2024-08-17T02:29:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.094+0000 7f9c2b200640 1 -- 172.21.15.6:0/3191301498 shutdown_connections 2024-08-17T02:29:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.095+0000 7f9c2b200640 1 --2- 172.21.15.6:0/3191301498 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9c08065150 0x7f9c08067600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.095+0000 7f9c2b200640 1 --2- 172.21.15.6:0/3191301498 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9c2c158c90 0x7f9c2c0b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.095+0000 7f9c2b200640 1 --2- 172.21.15.6:0/3191301498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c2c0cca40 0x7f9c2c0b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.095+0000 7f9c2b200640 1 --2- 172.21.15.6:0/3191301498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c2c0cadc0 0x7f9c2c14e700 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.095+0000 7f9c2b200640 1 -- 172.21.15.6:0/3191301498 >> 172.21.15.6:0/3191301498 conn(0x7f9c2c087a80 msgr2=0x7f9c2c0cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:55.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.095+0000 7f9c2b200640 1 -- 172.21.15.6:0/3191301498 shutdown_connections 2024-08-17T02:29:55.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.095+0000 7f9c2b200640 1 -- 172.21.15.6:0/3191301498 wait complete. 2024-08-17T02:29:55.111 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:29:55.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.261+0000 7fd399400640 1 Processor -- start 2024-08-17T02:29:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.261+0000 7fd399400640 1 -- start start 2024-08-17T02:29:55.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.262+0000 7fd399400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3940ca050 0x7fd394156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.263+0000 7fd399400640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3940cb160 con 0x7fd3940ad960 2024-08-17T02:29:55.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.263+0000 7fd399400640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3940b0d10 con 0x7fd3940add30 2024-08-17T02:29:55.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.263+0000 7fd399400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3940ca550 con 0x7fd3940ca050 2024-08-17T02:29:55.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.263+0000 7fd392800640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd3940ad960 0x7fd394156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46330/0 (socket says 172.21.15.6:46330) 2024-08-17T02:29:55.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.263+0000 7fd392800640 1 -- 172.21.15.6:0/3405054310 learned_addr learned my addr 172.21.15.6:0/3405054310 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.263+0000 7fd38be00640 1 --2- 172.21.15.6:0/3405054310 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3940ca050 0x7fd394156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.263+0000 7fd391e00640 1 -- 172.21.15.6:0/3405054310 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368015374 0 0) 0x7fd3940cb160 con 0x7fd3940ad960 2024-08-17T02:29:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.263+0000 7fd391e00640 1 -- 172.21.15.6:0/3405054310 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3780034e0 con 0x7fd3940ad960 2024-08-17T02:29:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.263+0000 7fd391e00640 1 -- 172.21.15.6:0/3405054310 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 244271645 0 0) 0x7fd3780034e0 con 0x7fd3940ad960 2024-08-17T02:29:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.263+0000 7fd391e00640 1 -- 172.21.15.6:0/3405054310 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3940ca050 msgr2=0x7fd394156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.263+0000 7fd391e00640 1 --2- 172.21.15.6:0/3405054310 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3940ca050 0x7fd394156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd391e00640 1 -- 172.21.15.6:0/3405054310 >> v1:172.21.15.136:6789/0 conn(0x7fd3940add30 legacy=0x7fd3940aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd391e00640 1 -- 172.21.15.6:0/3405054310 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3940ca830 con 0x7fd3940ad960 2024-08-17T02:29:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd391e00640 1 -- 172.21.15.6:0/3405054310 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7fd384001470 con 0x7fd3940ad960 2024-08-17T02:29:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd391e00640 1 -- 172.21.15.6:0/3405054310 >> v1:172.21.15.6:6789/0 conn(0x7fd3940ad960 legacy=0x7fd394156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd391e00640 1 --2- 172.21.15.6:0/3405054310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd378003a00 0x7fd378003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd391e00640 1 --2- 172.21.15.6:0/3405054310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd378004780 0x7fd378004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd391e00640 1 --2- 172.21.15.6:0/3405054310 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3940ca050 0x7fd378005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd391e00640 1 -- 172.21.15.6:0/3405054310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3940ca550 con 0x7fd378003a00 2024-08-17T02:29:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd391e00640 1 -- 172.21.15.6:0/3405054310 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37800ba80 con 0x7fd378004780 2024-08-17T02:29:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd391e00640 1 -- 172.21.15.6:0/3405054310 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37800bc40 con 0x7fd3940ca050 2024-08-17T02:29:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd392800640 1 --2- 172.21.15.6:0/3405054310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd378003a00 0x7fd378003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd38be00640 1 --2- 172.21.15.6:0/3405054310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd378004780 0x7fd378004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd393200640 1 --2- 172.21.15.6:0/3405054310 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3940ca050 0x7fd378005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd38be00640 1 -- 172.21.15.6:0/3405054310 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3940ca050 msgr2=0x7fd378005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd38be00640 1 --2- 172.21.15.6:0/3405054310 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3940ca050 0x7fd378005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd38be00640 1 -- 172.21.15.6:0/3405054310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd378003a00 msgr2=0x7fd378003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd38be00640 1 --2- 172.21.15.6:0/3405054310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd378003a00 0x7fd378003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.264+0000 7fd38be00640 1 -- 172.21.15.6:0/3405054310 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3780034e0 con 0x7fd378004780 2024-08-17T02:29:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.265+0000 7fd38be00640 1 --2- 172.21.15.6:0/3405054310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd378004780 0x7fd378004bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd3940ca480 tx=0x7fd37c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebec4ed99eabdb81 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.266+0000 7fd391e00640 1 -- 172.21.15.6:0/3405054310 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c031400 con 0x7fd378004780 2024-08-17T02:29:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.266+0000 7fd391e00640 1 -- 172.21.15.6:0/3405054310 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c02d050 con 0x7fd378004780 2024-08-17T02:29:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.266+0000 7fd391e00640 1 -- 172.21.15.6:0/3405054310 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c0317b0 con 0x7fd378004780 2024-08-17T02:29:55.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.266+0000 7fd399400640 1 -- 172.21.15.6:0/3405054310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd378004780 msgr2=0x7fd378004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.266+0000 7fd399400640 1 --2- 172.21.15.6:0/3405054310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd378004780 0x7fd378004bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd3940ca480 tx=0x7fd37c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.266+0000 7fd393200640 1 -- 172.21.15.6:0/3405054310 reap_dead start 2024-08-17T02:29:55.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.266+0000 7fd399400640 1 -- 172.21.15.6:0/3405054310 shutdown_connections 2024-08-17T02:29:55.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.266+0000 7fd399400640 1 -- 172.21.15.6:0/3405054310 >> 172.21.15.6:0/3405054310 conn(0x7fd394066e60 msgr2=0x7fd394067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:55.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.266+0000 7fd399400640 1 -- 172.21.15.6:0/3405054310 shutdown_connections 2024-08-17T02:29:55.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.266+0000 7fd399400640 1 -- 172.21.15.6:0/3405054310 wait complete. 2024-08-17T02:29:55.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.268+0000 7fd399400640 1 Processor -- start 2024-08-17T02:29:55.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.268+0000 7fd399400640 1 -- start start 2024-08-17T02:29:55.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd399400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd378004780 0x7fd3940a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd399400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd394158740 0x7fd39414d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd399400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd394158b70 0x7fd39414d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd399400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39414dc70 con 0x7fd378004780 2024-08-17T02:29:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd399400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3940a9ce0 con 0x7fd394158b70 2024-08-17T02:29:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd399400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3940a8e20 con 0x7fd394158740 2024-08-17T02:29:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd392800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd378004780 0x7fd3940a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd392800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd378004780 0x7fd3940a88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51820/0 (socket says 172.21.15.6:51820) 2024-08-17T02:29:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd392800640 1 -- 172.21.15.6:0/1953032002 learned_addr learned my addr 172.21.15.6:0/1953032002 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd38be00640 1 --2- 172.21.15.6:0/1953032002 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd394158740 0x7fd39414d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd393200640 1 --2- 172.21.15.6:0/1953032002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd394158b70 0x7fd39414d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd392800640 1 -- 172.21.15.6:0/1953032002 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd394158740 msgr2=0x7fd39414d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd392800640 1 --2- 172.21.15.6:0/1953032002 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd394158740 0x7fd39414d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd392800640 1 -- 172.21.15.6:0/1953032002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd394158b70 msgr2=0x7fd39414d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd392800640 1 --2- 172.21.15.6:0/1953032002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd394158b70 0x7fd39414d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd392800640 1 -- 172.21.15.6:0/1953032002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3940a90d0 con 0x7fd378004780 2024-08-17T02:29:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd393200640 1 --2- 172.21.15.6:0/1953032002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd394158b70 0x7fd39414d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.269+0000 7fd38be00640 1 --2- 172.21.15.6:0/1953032002 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd394158740 0x7fd39414d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.270+0000 7fd392800640 1 --2- 172.21.15.6:0/1953032002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd378004780 0x7fd3940a88e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd384004b00 tx=0x7fd384001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.270+0000 7fd38a000640 1 -- 172.21.15.6:0/1953032002 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384018030 con 0x7fd378004780 2024-08-17T02:29:55.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.270+0000 7fd38a000640 1 -- 172.21.15.6:0/1953032002 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38400fa90 con 0x7fd378004780 2024-08-17T02:29:55.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.270+0000 7fd38a000640 1 -- 172.21.15.6:0/1953032002 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38400fe30 con 0x7fd378004780 2024-08-17T02:29:55.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.270+0000 7fd399400640 1 -- 172.21.15.6:0/1953032002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3940a93b0 con 0x7fd378004780 2024-08-17T02:29:55.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.270+0000 7fd399400640 1 -- 172.21.15.6:0/1953032002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3940a9970 con 0x7fd378004780 2024-08-17T02:29:55.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.271+0000 7fd399400640 1 -- 172.21.15.6:0/1953032002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd394063fb0 con 0x7fd378004780 2024-08-17T02:29:55.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.272+0000 7fd38a000640 1 -- 172.21.15.6:0/1953032002 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd38401b070 con 0x7fd378004780 2024-08-17T02:29:55.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.273+0000 7fd38a000640 1 --2- 172.21.15.6:0/1953032002 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd370065180 0x7fd370067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.273+0000 7fd38a000640 1 -- 172.21.15.6:0/1953032002 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd384019070 con 0x7fd378004780 2024-08-17T02:29:55.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.273+0000 7fd38be00640 1 --2- 172.21.15.6:0/1953032002 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd370065180 0x7fd370067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.274+0000 7fd38be00640 1 --2- 172.21.15.6:0/1953032002 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd370065180 0x7fd370067630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd37c034000 tx=0x7fd37c035000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:55.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.277+0000 7fd38a000640 1 -- 172.21.15.6:0/1953032002 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd384050130 con 0x7fd378004780 2024-08-17T02:29:55.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.461+0000 7fd399400640 1 -- 172.21.15.6:0/1953032002 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd39406b6f0 con 0x7fd370065180 2024-08-17T02:29:55.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.464+0000 7fd38a000640 1 -- 172.21.15.6:0/1953032002 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51041 (secure 0 0 0) 0x7fd39406b6f0 con 0x7fd370065180 2024-08-17T02:29:55.465 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:55.465 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-08-17T02:29:55.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.466+0000 7fd399400640 1 -- 172.21.15.6:0/1953032002 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd370065180 msgr2=0x7fd370067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.466+0000 7fd399400640 1 --2- 172.21.15.6:0/1953032002 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd370065180 0x7fd370067630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd37c034000 tx=0x7fd37c035000 comp rx=0 tx=0).stop 2024-08-17T02:29:55.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.466+0000 7fd399400640 1 -- 172.21.15.6:0/1953032002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd378004780 msgr2=0x7fd3940a88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.466+0000 7fd399400640 1 --2- 172.21.15.6:0/1953032002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd378004780 0x7fd3940a88e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd384004b00 tx=0x7fd384001df0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.466+0000 7fd399400640 1 -- 172.21.15.6:0/1953032002 shutdown_connections 2024-08-17T02:29:55.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.466+0000 7fd399400640 1 --2- 172.21.15.6:0/1953032002 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd370065180 0x7fd370067630 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.466+0000 7fd399400640 1 --2- 172.21.15.6:0/1953032002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd394158b70 0x7fd39414d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.466+0000 7fd399400640 1 --2- 172.21.15.6:0/1953032002 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd394158740 0x7fd39414d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.466+0000 7fd399400640 1 --2- 172.21.15.6:0/1953032002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd378004780 0x7fd3940a88e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.466+0000 7fd399400640 1 -- 172.21.15.6:0/1953032002 >> 172.21.15.6:0/1953032002 conn(0x7fd394066e60 msgr2=0x7fd394153fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.466+0000 7fd399400640 1 -- 172.21.15.6:0/1953032002 shutdown_connections 2024-08-17T02:29:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.466+0000 7fd399400640 1 -- 172.21.15.6:0/1953032002 wait complete. 2024-08-17T02:29:55.482 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-08-17T02:29:53.463745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387920,"kb_used_data":4896,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586800,"statfs":{"total":773094113280,"available":770648883200,"internally_reserved":0,"allocated":5013504,"data_stored":2753790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001700"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-08-17T02:29:44.716965+0000","last_change":"2024-08-17T02:26:27.275086+0000","last_active":"2024-08-17T02:29:44.716965+0000","last_peered":"2024-08-17T02:29:44.716965+0000","last_clean":"2024-08-17T02:29:44.716965+0000","last_became_active":"2024-08-17T02:26:27.274075+0000","last_became_peered":"2024-08-17T02:26:27.274075+0000","last_unstale":"2024-08-17T02:29:44.716965+0000","last_undegraded":"2024-08-17T02:29:44.716965+0000","last_fullsized":"2024-08-17T02:29:44.716965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_clean_scrub_stamp":"2024-08-17T02:26:26.139133+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:52.161982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302568,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069272,"statfs":{"total":96636764160,"available":96326934528,"internally_reserved":0,"allocated":1077248,"data_stored":791156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94899999999999995,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.748},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.51400000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93300000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.69399999999999995,"15min":0.67800000000000005},"min":{"1min":0.64000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98399999999999999,"5min":1.034,"15min":1.034},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73399999999999999,"15min":0.71699999999999997},"min":{"1min":0.64200000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.71999999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68100000000000005,"15min":0.65500000000000003},"min":{"1min":0.55700000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.64700000000000002,"15min":0.63100000000000001},"min":{"1min":0.57299999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.63200000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.60499999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73699999999999999,"15min":0.73299999999999998},"min":{"1min":0.52400000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.59399999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.59399999999999997,"15min":0.61799999999999999},"min":{"1min":0.42699999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69599999999999995,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.63100000000000001,"15min":0.66700000000000004},"min":{"1min":0.46100000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78900000000000003,"5min":1.226,"15min":1.226},"last":0.47099999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82799999999999996,"5min":1.075,"15min":1.075},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71599999999999997,"15min":0.73499999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84599999999999997,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.68500000000000005,"15min":0.70499999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.81299999999999994,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.71299999999999997,"15min":0.75600000000000001},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99099999999999999,"5min":1.855,"15min":1.855},"last":0.67500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297820,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074020,"statfs":{"total":96636764160,"available":96331796480,"internally_reserved":0,"allocated":475136,"data_stored":195157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64800000000000002,"15min":0.626},"min":{"1min":0.52200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63900000000000001,"15min":0.61599999999999999},"min":{"1min":0.55600000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92400000000000004,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.63100000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.51100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":0.999,"15min":0.999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.50800000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93100000000000005,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.79700000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.64200000000000002,"15min":0.60999999999999999},"min":{"1min":0.53200000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.624,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.68000000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.73799999999999999},"min":{"1min":0.61299999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.97499999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70899999999999996,"15min":0.68500000000000005},"min":{"1min":0.626,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88800000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.80800000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.627,"15min":0.64300000000000002},"min":{"1min":0.47599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.76600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.44,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76700000000000002,"5min":0.871,"15min":0.871},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71499999999999997,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90300000000000002,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70399999999999996,"15min":0.70899999999999996},"min":{"1min":0.49199999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85599999999999998,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297820,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074020,"statfs":{"total":96636764160,"available":96331796480,"internally_reserved":0,"allocated":471040,"data_stored":194567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.76500000000000001},"min":{"1min":0.53600000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92200000000000004,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.52600000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94199999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.47599999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.68899999999999995},"min":{"1min":0.56299999999999994,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91400000000000003,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.81699999999999995,"15min":0.871},"min":{"1min":0.47699999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82499999999999996,"5min":4.0670000000000002,"15min":4.0670000000000002},"last":0.42499999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70499999999999996,"15min":0.68899999999999995},"min":{"1min":0.63200000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.85299999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68100000000000005,"15min":0.66600000000000004},"min":{"1min":0.59299999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.76700000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.57299999999999995,"5min":0.433,"15min":0.433},"max":{"1min":0.91700000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.58399999999999996,"5min":0.504,"15min":0.504},"max":{"1min":0.89300000000000002,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.68899999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.57199999999999995,"15min":0.59399999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69999999999999996,"5min":0.879,"15min":0.879},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63,"15min":0.65000000000000002},"min":{"1min":0.44400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84499999999999997,"5min":0.877,"15min":0.877},"last":0.67200000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86499999999999999,"5min":0.879,"15min":0.879},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.79600000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.64600000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69999999999999996,"15min":0.71499999999999997},"min":{"1min":0.50600000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.55800000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86699999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.78000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297828,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074012,"statfs":{"total":96636764160,"available":96331788288,"internally_reserved":0,"allocated":479232,"data_stored":196049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.64700000000000002,"15min":0.61699999999999999},"min":{"1min":0.47599999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71799999999999997,"15min":0.70099999999999996},"min":{"1min":0.51100000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89800000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63800000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72899999999999998,"15min":0.72399999999999998},"min":{"1min":0.502,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93999999999999995,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.71499999999999997,"15min":0.69299999999999995},"min":{"1min":0.54200000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0009999999999999,"5min":1.234,"15min":1.234},"last":0.70699999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.56000000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0209999999999999,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.80800000000000005,"15min":0.80600000000000005},"min":{"1min":0.73599999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.98099999999999998,"5min":1.645,"15min":1.645},"last":0.75900000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.56200000000000006,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.72999999999999998,"15min":0.71799999999999997},"min":{"1min":0.63300000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.026,"5min":1.605,"15min":1.605},"last":0.68300000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64800000000000002,"15min":0.67000000000000004},"min":{"1min":0.45000000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.76900000000000002,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67700000000000005,"15min":0.68999999999999995},"min":{"1min":0.51900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.82999999999999996,"5min":1.429,"15min":1.429},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.51500000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83899999999999997,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.498,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.85599999999999998,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.58499999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.755,"15min":0.77800000000000002},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.95599999999999996,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94799999999999995,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.83299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297836,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074004,"statfs":{"total":96636764160,"available":96331780096,"internally_reserved":0,"allocated":491520,"data_stored":201324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.50700000000000001,"15min":0.52400000000000002},"min":{"1min":0.36099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68500000000000005,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.312},{"interface":"front","average":{"1min":0.498,"5min":0.45800000000000002,"15min":0.437},"min":{"1min":0.38200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70999999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.376}]},{"osd":1,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.35899999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69799999999999995,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.628,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.35999999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.439,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67200000000000004,"5min":1.375,"15min":1.375},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71099999999999997,"5min":1.347,"15min":1.347},"last":0.50800000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.63200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0289999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.96999999999999997,"5min":1.321,"15min":1.321},"last":0.74299999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79200000000000004,"15min":0.78500000000000003},"min":{"1min":0.65500000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0669999999999999,"5min":1.421,"15min":1.421},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78200000000000003,"15min":0.77800000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.98899999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.75900000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79300000000000004,"15min":0.78700000000000003},"min":{"1min":0.59999999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.103,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.70299999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.94899999999999995,"5min":1.389,"15min":1.389},"last":0.67200000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.78100000000000003,"15min":0.76700000000000002},"min":{"1min":0.58199999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.085,"5min":1.091,"15min":1.091},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.84499999999999997,"15min":0.85099999999999998},"min":{"1min":0.68000000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.014,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.90900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":483328,"data_stored":196071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.52700000000000002,"15min":0.56299999999999994},"min":{"1min":0.32500000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.70599999999999996,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":0.376},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57299999999999995,"15min":0.59099999999999997},"min":{"1min":0.44400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.61599999999999999,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.45800000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60699999999999998,"15min":0.63500000000000001},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64600000000000002,"5min":3.827,"15min":3.827},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58899999999999997,"15min":0.59699999999999998},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71499999999999997,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.42199999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52600000000000002,"15min":0.54500000000000004},"min":{"1min":0.34300000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.747,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.46400000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75900000000000001,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.51400000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.85499999999999998,"15min":0.879},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1739999999999999,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81200000000000006,"15min":0.81999999999999995},"min":{"1min":0.60799999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.073,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.83999999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.63900000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4259999999999999,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.61899999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3129999999999999,"5min":3.54,"15min":3.54},"last":0.88200000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79900000000000004,"15min":0.80900000000000005},"min":{"1min":0.66800000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.216,"5min":1.274,"15min":1.274},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4690000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.74199999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85999999999999999,"15min":0.872},"min":{"1min":0.60899999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.88200000000000001,"15min":0.89000000000000001},"min":{"1min":0.66800000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.264,"5min":2.302,"15min":2.302},"last":0.95899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297820,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074020,"statfs":{"total":96636764160,"available":96331796480,"internally_reserved":0,"allocated":471040,"data_stored":194567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.55100000000000005,"15min":0.59999999999999998},"min":{"1min":0.316,"5min":0.311,"15min":0.311},"max":{"1min":0.55700000000000005,"5min":2.871,"15min":2.871},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.625,"15min":0.67100000000000004},"min":{"1min":0.44700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65000000000000002,"5min":2.96,"15min":2.96},"last":0.46500000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.505,"15min":0.53800000000000003},"min":{"1min":0.35099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59799999999999998,"5min":2.371,"15min":2.371},"last":0.314},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.71299999999999997,"15min":0.80900000000000005},"min":{"1min":0.375,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.54300000000000004,"5min":5.468,"15min":5.468},"last":0.44500000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72399999999999998,"15min":0.77300000000000002},"min":{"1min":0.51200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.745,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.65500000000000003,"15min":0.70999999999999996},"min":{"1min":0.39200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":0.51800000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83099999999999996,"15min":0.84799999999999998},"min":{"1min":0.61799999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.98999999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.92200000000000004,"15min":0.96699999999999997},"min":{"1min":0.69199999999999995,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.96999999999999997,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.90000000000000002,"15min":0.94999999999999996},"min":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98299999999999998,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.86899999999999999,"15min":0.90700000000000003},"min":{"1min":0.66900000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.042,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":0.628}]},{"osd":6,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.91400000000000003,"15min":0.97599999999999998},"min":{"1min":0.61299999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.97799999999999998,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83299999999999996,"15min":0.85099999999999998},"min":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.95599999999999996,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.58799999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.98199999999999998,"15min":1.0740000000000001},"min":{"1min":0.66300000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.86899999999999999,"5min":5.5190000000000001,"15min":5.5190000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.97999999999999998,"15min":1.0660000000000001},"min":{"1min":0.59699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94799999999999995,"5min":4.5970000000000004,"15min":4.5970000000000004},"last":0.68999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1064960,"data_stored":784899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42099999999999999,"15min":0.40699999999999997},"min":{"1min":0.33100000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60499999999999998,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.47499999999999998,"15min":0.45800000000000002},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.47799999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.38300000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.40000000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52700000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.47299999999999998},"min":{"1min":0.39400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.46100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81999999999999995,"5min":0.873,"15min":0.873},"last":0.53500000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.78300000000000003,"15min":0.76800000000000002},"min":{"1min":0.66700000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.746},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.58199999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0529999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.85599999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.78800000000000003,"15min":0.77500000000000002},"min":{"1min":0.63900000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79300000000000004,"15min":0.78700000000000003},"min":{"1min":0.67500000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0169999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.78100000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.82899999999999996,"15min":0.81699999999999995},"min":{"1min":0.73099999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1040000000000001,"5min":1.109,"15min":1.109},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.82099999999999995,"15min":0.80500000000000005},"min":{"1min":0.66800000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.81100000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.86199999999999999,"15min":0.85499999999999998},"min":{"1min":0.70699999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.875,"5min":0.83099999999999996,"15min":0.82099999999999995},"min":{"1min":0.68700000000000006,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0800000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.88}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:55.484 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:55.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.634+0000 7f2fd8a00640 1 Processor -- start 2024-08-17T02:29:55.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.634+0000 7f2fd8a00640 1 -- start start 2024-08-17T02:29:55.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.635+0000 7f2fd8a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2fd4158bf0 0x7f2fd40af330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.635+0000 7f2fd8a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2fd40ac4b0 0x7f2fd4068770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.635+0000 7f2fd8a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd40682e0 con 0x7f2fd40ae4a0 2024-08-17T02:29:55.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.635+0000 7f2fd8a00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd40afca0 con 0x7f2fd40ac4b0 2024-08-17T02:29:55.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.635+0000 7f2fd8a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd40aff80 con 0x7f2fd4158bf0 2024-08-17T02:29:55.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.636+0000 7f2fd2800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2fd4158bf0 0x7f2fd40af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.636+0000 7f2fd3200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2fd40ac4b0 0x7f2fd4068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.636+0000 7f2fd2800640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2fd4158bf0 0x7f2fd40af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:39376/0 (socket says 172.21.15.6:39376) 2024-08-17T02:29:55.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.636+0000 7f2fd2800640 1 -- 172.21.15.6:0/3899194821 learned_addr learned my addr 172.21.15.6:0/3899194821 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:55.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.636+0000 7f2fd3200640 1 --2- 172.21.15.6:0/3899194821 >> v2:172.21.15.136:3300/0 conn(0x7f2fd40ac4b0 0x7f2fd4068770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:35722/0 (socket says 172.21.15.6:35722) 2024-08-17T02:29:55.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.636+0000 7f2fd2800640 1 -- 172.21.15.6:0/3899194821 >> v2:172.21.15.136:3300/0 conn(0x7f2fd40ac4b0 msgr2=0x7f2fd4068770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:55.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.636+0000 7f2fd2800640 1 --2- 172.21.15.6:0/3899194821 >> v2:172.21.15.136:3300/0 conn(0x7f2fd40ac4b0 0x7f2fd4068770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.636+0000 7f2fd2800640 1 -- 172.21.15.6:0/3899194821 >> v1:172.21.15.136:6789/0 conn(0x7f2fd40ae4a0 legacy=0x7f2fd40abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.636+0000 7f2fd2800640 1 -- 172.21.15.6:0/3899194821 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd40b0260 con 0x7f2fd4158bf0 2024-08-17T02:29:55.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.637+0000 7f2fd2800640 1 --2- 172.21.15.6:0/3899194821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2fd4158bf0 0x7f2fd40af330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009910 tx=0x7f2fc40091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eeb6151a2d8e223 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:55.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.638+0000 7f2fd1e00640 1 -- 172.21.15.6:0/3899194821 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc402ae40 con 0x7f2fd4158bf0 2024-08-17T02:29:55.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.638+0000 7f2fd1e00640 1 -- 172.21.15.6:0/3899194821 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc4032440 con 0x7f2fd4158bf0 2024-08-17T02:29:55.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.638+0000 7f2fd1e00640 1 -- 172.21.15.6:0/3899194821 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4032820 con 0x7f2fd4158bf0 2024-08-17T02:29:55.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.638+0000 7f2fd8a00640 1 -- 172.21.15.6:0/3899194821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2fd4158bf0 msgr2=0x7f2fd40af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.638+0000 7f2fd8a00640 1 --2- 172.21.15.6:0/3899194821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2fd4158bf0 0x7f2fd40af330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009910 tx=0x7f2fc40091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.638+0000 7f2fd8a00640 1 -- 172.21.15.6:0/3899194821 shutdown_connections 2024-08-17T02:29:55.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.638+0000 7f2fd8a00640 1 --2- 172.21.15.6:0/3899194821 >> v2:172.21.15.136:3300/0 conn(0x7f2fd40ac4b0 0x7f2fd4068770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.638+0000 7f2fd8a00640 1 --2- 172.21.15.6:0/3899194821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2fd4158bf0 0x7f2fd40af330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.638+0000 7f2fd8a00640 1 -- 172.21.15.6:0/3899194821 >> 172.21.15.6:0/3899194821 conn(0x7f2fd40ce420 msgr2=0x7f2fd4095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:55.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.638+0000 7f2fd8a00640 1 -- 172.21.15.6:0/3899194821 shutdown_connections 2024-08-17T02:29:55.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.638+0000 7f2fd8a00640 1 -- 172.21.15.6:0/3899194821 wait complete. 2024-08-17T02:29:55.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.640+0000 7f2fd8a00640 1 Processor -- start 2024-08-17T02:29:55.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.640+0000 7f2fd8a00640 1 -- start start 2024-08-17T02:29:55.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.641+0000 7f2fd8a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2fd40ac4b0 0x7f2fd4152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.641+0000 7f2fd8a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd40ae4a0 0x7f2fd40b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.641+0000 7f2fd8a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fd4158bf0 0x7f2fd40c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.641+0000 7f2fd8a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd40c8d80 con 0x7f2fd40ae4a0 2024-08-17T02:29:55.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.641+0000 7f2fd8a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd41528a0 con 0x7f2fd4158bf0 2024-08-17T02:29:55.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.641+0000 7f2fd8a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd40c8170 con 0x7f2fd40ac4b0 2024-08-17T02:29:55.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.641+0000 7f2fc9e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd40ae4a0 0x7f2fd40b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.641+0000 7f2fc9e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd40ae4a0 0x7f2fd40b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51832/0 (socket says 172.21.15.6:51832) 2024-08-17T02:29:55.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.641+0000 7f2fc9e00640 1 -- 172.21.15.6:0/1623699384 learned_addr learned my addr 172.21.15.6:0/1623699384 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:55.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.641+0000 7f2fd3200640 1 --2- 172.21.15.6:0/1623699384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fd4158bf0 0x7f2fd40c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.641+0000 7f2fd2800640 1 --2- 172.21.15.6:0/1623699384 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2fd40ac4b0 0x7f2fd4152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.641+0000 7f2fc9e00640 1 -- 172.21.15.6:0/1623699384 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2fd40ac4b0 msgr2=0x7f2fd4152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.641+0000 7f2fc9e00640 1 --2- 172.21.15.6:0/1623699384 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2fd40ac4b0 0x7f2fd4152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.641+0000 7f2fc9e00640 1 -- 172.21.15.6:0/1623699384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fd4158bf0 msgr2=0x7f2fd40c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.642+0000 7f2fc9e00640 1 --2- 172.21.15.6:0/1623699384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fd4158bf0 0x7f2fd40c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.642+0000 7f2fc9e00640 1 -- 172.21.15.6:0/1623699384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc4009450 con 0x7f2fd40ae4a0 2024-08-17T02:29:55.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.642+0000 7f2fc9e00640 1 --2- 172.21.15.6:0/1623699384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd40ae4a0 0x7f2fd40b1330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00c560 tx=0x7f2fbc007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:55.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.642+0000 7f2fcaa00640 1 -- 172.21.15.6:0/1623699384 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc011590 con 0x7f2fd40ae4a0 2024-08-17T02:29:55.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.642+0000 7f2fcaa00640 1 -- 172.21.15.6:0/1623699384 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc011710 con 0x7f2fd40ae4a0 2024-08-17T02:29:55.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.642+0000 7f2fd8a00640 1 -- 172.21.15.6:0/1623699384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd40c8450 con 0x7f2fd40ae4a0 2024-08-17T02:29:55.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.642+0000 7f2fcaa00640 1 -- 172.21.15.6:0/1623699384 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc011ad0 con 0x7f2fd40ae4a0 2024-08-17T02:29:55.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.642+0000 7f2fd8a00640 1 -- 172.21.15.6:0/1623699384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd40c8a10 con 0x7f2fd40ae4a0 2024-08-17T02:29:55.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.643+0000 7f2fd8a00640 1 -- 172.21.15.6:0/1623699384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd4070720 con 0x7f2fd40ae4a0 2024-08-17T02:29:55.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.644+0000 7f2fcaa00640 1 -- 172.21.15.6:0/1623699384 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2fbc01b3b0 con 0x7f2fd40ae4a0 2024-08-17T02:29:55.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.645+0000 7f2fcaa00640 1 --2- 172.21.15.6:0/1623699384 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2fb0065180 0x7f2fb0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.645+0000 7f2fcaa00640 1 -- 172.21.15.6:0/1623699384 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2fbc081620 con 0x7f2fd40ae4a0 2024-08-17T02:29:55.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.645+0000 7f2fd2800640 1 --2- 172.21.15.6:0/1623699384 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2fb0065180 0x7f2fb0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.646+0000 7f2fd2800640 1 --2- 172.21.15.6:0/1623699384 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2fb0065180 0x7f2fb0067630 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4034000 tx=0x7f2fc4032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:55.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.649+0000 7f2fcaa00640 1 -- 172.21.15.6:0/1623699384 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2fbc04fa30 con 0x7f2fd40ae4a0 2024-08-17T02:29:55.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.831+0000 7f2fd8a00640 1 -- 172.21.15.6:0/1623699384 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2fd4096d20 con 0x7f2fb0065180 2024-08-17T02:29:55.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.837+0000 7f2fcaa00640 1 -- 172.21.15.6:0/1623699384 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50951 (secure 0 0 0) 0x7f2fd4096d20 con 0x7f2fb0065180 2024-08-17T02:29:55.838 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:55.838 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-08-17T02:29:55.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.839+0000 7f2fd8a00640 1 -- 172.21.15.6:0/1623699384 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2fb0065180 msgr2=0x7f2fb0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.839+0000 7f2fd8a00640 1 --2- 172.21.15.6:0/1623699384 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2fb0065180 0x7f2fb0067630 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4034000 tx=0x7f2fc4032000 comp rx=0 tx=0).stop 2024-08-17T02:29:55.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.839+0000 7f2fd8a00640 1 -- 172.21.15.6:0/1623699384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd40ae4a0 msgr2=0x7f2fd40b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.839+0000 7f2fd8a00640 1 --2- 172.21.15.6:0/1623699384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd40ae4a0 0x7f2fd40b1330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00c560 tx=0x7f2fbc007ef0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.839+0000 7f2fd8a00640 1 -- 172.21.15.6:0/1623699384 shutdown_connections 2024-08-17T02:29:55.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.839+0000 7f2fd8a00640 1 --2- 172.21.15.6:0/1623699384 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f2fb0065180 0x7f2fb0067630 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.839+0000 7f2fd8a00640 1 --2- 172.21.15.6:0/1623699384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fd4158bf0 0x7f2fd40c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.839+0000 7f2fd8a00640 1 --2- 172.21.15.6:0/1623699384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd40ae4a0 0x7f2fd40b1330 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.839+0000 7f2fd8a00640 1 --2- 172.21.15.6:0/1623699384 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2fd40ac4b0 0x7f2fd4152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.839+0000 7f2fd8a00640 1 -- 172.21.15.6:0/1623699384 >> 172.21.15.6:0/1623699384 conn(0x7f2fd40ce420 msgr2=0x7f2fd40aa620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:55.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.839+0000 7f2fd8a00640 1 -- 172.21.15.6:0/1623699384 shutdown_connections 2024-08-17T02:29:55.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:55.839+0000 7f2fd8a00640 1 -- 172.21.15.6:0/1623699384 wait complete. 2024-08-17T02:29:55.855 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-08-17T02:29:55.464616+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2392356,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752582364,"statfs":{"total":773094113280,"available":770644340736,"internally_reserved":0,"allocated":5283840,"data_stored":2880488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.892090"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":185,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:29:50.752485+0000","last_change":"2024-08-17T02:26:27.275086+0000","last_active":"2024-08-17T02:29:50.752485+0000","last_peered":"2024-08-17T02:29:50.752485+0000","last_clean":"2024-08-17T02:29:50.752485+0000","last_became_active":"2024-08-17T02:26:27.274075+0000","last_became_peered":"2024-08-17T02:26:27.274075+0000","last_unstale":"2024-08-17T02:29:50.752485+0000","last_undegraded":"2024-08-17T02:29:50.752485+0000","last_fullsized":"2024-08-17T02:29:50.752485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_clean_scrub_stamp":"2024-08-17T02:26:26.139133+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:52.161982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302596,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069244,"statfs":{"total":96636764160,"available":96326905856,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94899999999999995,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.504},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.51400000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93300000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67900000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.69399999999999995,"15min":0.67800000000000005},"min":{"1min":0.64000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98399999999999999,"5min":1.034,"15min":1.034},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73399999999999999,"15min":0.71699999999999997},"min":{"1min":0.64200000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.63200000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68100000000000005,"15min":0.65500000000000003},"min":{"1min":0.55700000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.64700000000000002,"15min":0.63100000000000001},"min":{"1min":0.57299999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59899999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.60499999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73699999999999999,"15min":0.73299999999999998},"min":{"1min":0.52400000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.71999999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.59399999999999997,"15min":0.61799999999999999},"min":{"1min":0.42699999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69599999999999995,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.63100000000000001,"15min":0.66700000000000004},"min":{"1min":0.46100000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78900000000000003,"5min":1.226,"15min":1.226},"last":0.69699999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82799999999999996,"5min":1.075,"15min":1.075},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71599999999999997,"15min":0.73499999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84599999999999997,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.68500000000000005,"15min":0.70499999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.81299999999999994,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.71299999999999997,"15min":0.75600000000000001},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99099999999999999,"5min":1.855,"15min":1.855},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64800000000000002,"15min":0.626},"min":{"1min":0.52200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63900000000000001,"15min":0.61599999999999999},"min":{"1min":0.55600000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92400000000000004,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.79400000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.51100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":0.999,"15min":0.999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.50800000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93100000000000005,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.749}]},{"osd":2,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.64200000000000002,"15min":0.60999999999999999},"min":{"1min":0.53200000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.624,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.73199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.73799999999999999},"min":{"1min":0.61299999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.97499999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70899999999999996,"15min":0.68500000000000005},"min":{"1min":0.626,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88800000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.71299999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.627,"15min":0.64300000000000002},"min":{"1min":0.47599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.60899999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.44,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76700000000000002,"5min":0.871,"15min":0.871},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71499999999999997,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90300000000000002,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.81200000000000006}]},{"osd":7,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70399999999999996,"15min":0.70899999999999996},"min":{"1min":0.49199999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85599999999999998,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.83199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.76500000000000001},"min":{"1min":0.53600000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92200000000000004,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.626},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.52600000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94199999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.68899999999999995},"min":{"1min":0.56299999999999994,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91400000000000003,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.81699999999999995,"15min":0.871},"min":{"1min":0.47699999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82499999999999996,"5min":4.0670000000000002,"15min":4.0670000000000002},"last":0.60699999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70499999999999996,"15min":0.68899999999999995},"min":{"1min":0.63200000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.85299999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68100000000000005,"15min":0.66600000000000004},"min":{"1min":0.59299999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.57299999999999995,"5min":0.433,"15min":0.433},"max":{"1min":0.91700000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.58399999999999996,"5min":0.504,"15min":0.504},"max":{"1min":0.89300000000000002,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.52600000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.57199999999999995,"15min":0.59399999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69999999999999996,"5min":0.879,"15min":0.879},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63,"15min":0.65000000000000002},"min":{"1min":0.44400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84499999999999997,"5min":0.877,"15min":0.877},"last":0.53400000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86499999999999999,"5min":0.879,"15min":0.879},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.79600000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.55700000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69999999999999996,"15min":0.71499999999999997},"min":{"1min":0.50600000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.55800000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86699999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.73699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.64700000000000002,"15min":0.61699999999999999},"min":{"1min":0.47599999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71799999999999997,"15min":0.70099999999999996},"min":{"1min":0.51100000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89800000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58299999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72899999999999998,"15min":0.72399999999999998},"min":{"1min":0.502,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93999999999999995,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.71499999999999997,"15min":0.69299999999999995},"min":{"1min":0.54200000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0009999999999999,"5min":1.234,"15min":1.234},"last":0.70899999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.56000000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0209999999999999,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.80800000000000005,"15min":0.80600000000000005},"min":{"1min":0.73599999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.98099999999999998,"5min":1.645,"15min":1.645},"last":0.68000000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.56200000000000006,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.72999999999999998,"15min":0.71799999999999997},"min":{"1min":0.63300000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.026,"5min":1.605,"15min":1.605},"last":0.51700000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64800000000000002,"15min":0.67000000000000004},"min":{"1min":0.45000000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.76900000000000002,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.433},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67700000000000005,"15min":0.68999999999999995},"min":{"1min":0.51900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.82999999999999996,"5min":1.429,"15min":1.429},"last":0.60999999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.51500000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83899999999999997,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.498,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.85599999999999998,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.72799999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.755,"15min":0.77800000000000002},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.95599999999999996,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.752},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94799999999999995,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.69899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.50700000000000001,"15min":0.52400000000000002},"min":{"1min":0.36099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68500000000000005,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.45800000000000002,"15min":0.437},"min":{"1min":0.38200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70999999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45600000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.35899999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69799999999999995,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.498},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.628,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.436}]},{"osd":2,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.439,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67200000000000004,"5min":1.375,"15min":1.375},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71099999999999997,"5min":1.347,"15min":1.347},"last":0.56100000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.63200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0289999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.96999999999999997,"5min":1.321,"15min":1.321},"last":0.83199999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79200000000000004,"15min":0.78500000000000003},"min":{"1min":0.65500000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0669999999999999,"5min":1.421,"15min":1.421},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78200000000000003,"15min":0.77800000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.98899999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79300000000000004,"15min":0.78700000000000003},"min":{"1min":0.59999999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.103,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.70299999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.94899999999999995,"5min":1.389,"15min":1.389},"last":0.79600000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.78100000000000003,"15min":0.76700000000000002},"min":{"1min":0.58199999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.085,"5min":1.091,"15min":1.091},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.84499999999999997,"15min":0.85099999999999998},"min":{"1min":0.68000000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.014,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.89100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.52700000000000002,"15min":0.56299999999999994},"min":{"1min":0.32500000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.70599999999999996,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57299999999999995,"15min":0.59099999999999997},"min":{"1min":0.44400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.61599999999999999,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.32200000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60699999999999998,"15min":0.63500000000000001},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64600000000000002,"5min":3.827,"15min":3.827},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58899999999999997,"15min":0.59699999999999998},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71499999999999997,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.38200000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52600000000000002,"15min":0.54500000000000004},"min":{"1min":0.34300000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.747,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.46400000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75900000000000001,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.433}]},{"osd":4,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.85499999999999998,"15min":0.879},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1739999999999999,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81200000000000006,"15min":0.81999999999999995},"min":{"1min":0.60799999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.073,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.55700000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.63900000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4259999999999999,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":0.496},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.61899999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3129999999999999,"5min":3.54,"15min":3.54},"last":0.59299999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79900000000000004,"15min":0.80900000000000005},"min":{"1min":0.66800000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.216,"5min":1.274,"15min":1.274},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4690000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.57499999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85999999999999999,"15min":0.872},"min":{"1min":0.60899999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.88200000000000001,"15min":0.89000000000000001},"min":{"1min":0.66800000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.264,"5min":2.302,"15min":2.302},"last":0.626}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.55100000000000005,"15min":0.59999999999999998},"min":{"1min":0.316,"5min":0.311,"15min":0.311},"max":{"1min":0.55700000000000005,"5min":2.871,"15min":2.871},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.625,"15min":0.67100000000000004},"min":{"1min":0.44700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65000000000000002,"5min":2.96,"15min":2.96},"last":0.45400000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.505,"15min":0.53800000000000003},"min":{"1min":0.35099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59799999999999998,"5min":2.371,"15min":2.371},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.71299999999999997,"15min":0.80900000000000005},"min":{"1min":0.375,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.54300000000000004,"5min":5.468,"15min":5.468},"last":0.435}]},{"osd":3,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72399999999999998,"15min":0.77300000000000002},"min":{"1min":0.51200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.745,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.65500000000000003,"15min":0.70999999999999996},"min":{"1min":0.39200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":0.40999999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83099999999999996,"15min":0.84799999999999998},"min":{"1min":0.61799999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.98999999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.92200000000000004,"15min":0.96699999999999997},"min":{"1min":0.69199999999999995,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.96999999999999997,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.90000000000000002,"15min":0.94999999999999996},"min":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98299999999999998,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.86899999999999999,"15min":0.90700000000000003},"min":{"1min":0.66900000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.042,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":0.504}]},{"osd":6,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.91400000000000003,"15min":0.97599999999999998},"min":{"1min":0.61299999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.97799999999999998,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83299999999999996,"15min":0.85099999999999998},"min":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.95599999999999996,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.61499999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.98199999999999998,"15min":1.0740000000000001},"min":{"1min":0.66300000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.86899999999999999,"5min":5.5190000000000001,"15min":5.5190000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.97999999999999998,"15min":1.0660000000000001},"min":{"1min":0.59699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94799999999999995,"5min":4.5970000000000004,"15min":4.5970000000000004},"last":0.59399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42099999999999999,"15min":0.40699999999999997},"min":{"1min":0.33100000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60499999999999998,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.47499999999999998,"15min":0.45800000000000002},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.52300000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.38300000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.40000000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.57399999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.47299999999999998},"min":{"1min":0.39400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.46100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81999999999999995,"5min":0.873,"15min":0.873},"last":0.63}]},{"osd":4,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.78300000000000003,"15min":0.76800000000000002},"min":{"1min":0.66700000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.58199999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0529999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.73299999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.78800000000000003,"15min":0.77500000000000002},"min":{"1min":0.63900000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79300000000000004,"15min":0.78700000000000003},"min":{"1min":0.67500000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0169999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.78300000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.82899999999999996,"15min":0.81699999999999995},"min":{"1min":0.73099999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1040000000000001,"5min":1.109,"15min":1.109},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.82099999999999995,"15min":0.80500000000000005},"min":{"1min":0.66800000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.749}]},{"osd":7,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.86199999999999999,"15min":0.85499999999999998},"min":{"1min":0.70699999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.875,"5min":0.83099999999999996,"15min":0.82099999999999995},"min":{"1min":0.68700000000000006,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0800000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.85799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:55.856 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:29:55.857 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:56.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.007+0000 7fe24f000640 1 Processor -- start 2024-08-17T02:29:56.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.007+0000 7fe24f000640 1 -- start start 2024-08-17T02:29:56.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.009+0000 7fe24f000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe248155910 0x7fe2480ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.009+0000 7fe24f000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2480aefe0 0x7fe2480c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.009+0000 7fe24f000640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2480c97c0 con 0x7fe2480ade20 2024-08-17T02:29:56.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.009+0000 7fe24f000640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2480ae3a0 con 0x7fe2480aefe0 2024-08-17T02:29:56.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.009+0000 7fe24f000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2480c9170 con 0x7fe248155910 2024-08-17T02:29:56.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.009+0000 7fe23f400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe2480ade20 0x7fe2480ae8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46344/0 (socket says 172.21.15.6:46344) 2024-08-17T02:29:56.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.009+0000 7fe23f400640 1 -- 172.21.15.6:0/1918655760 learned_addr learned my addr 172.21.15.6:0/1918655760 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:56.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.009+0000 7fe24d000640 1 --2- 172.21.15.6:0/1918655760 >> v2:172.21.15.6:3300/0 conn(0x7fe2480aefe0 0x7fe2480c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.009+0000 7fe247e00640 1 --2- 172.21.15.6:0/1918655760 >> v2:172.21.15.136:3300/0 conn(0x7fe248155910 0x7fe2480ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.009+0000 7fe24d000640 1 -- 172.21.15.6:0/1918655760 >> v2:172.21.15.136:3300/0 conn(0x7fe248155910 msgr2=0x7fe2480ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.009+0000 7fe24d000640 1 --2- 172.21.15.6:0/1918655760 >> v2:172.21.15.136:3300/0 conn(0x7fe248155910 0x7fe2480ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.009+0000 7fe24d000640 1 -- 172.21.15.6:0/1918655760 >> v1:172.21.15.6:6789/0 conn(0x7fe2480ade20 legacy=0x7fe2480ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.009+0000 7fe24d000640 1 -- 172.21.15.6:0/1918655760 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2480c9450 con 0x7fe2480aefe0 2024-08-17T02:29:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.010+0000 7fe24d000640 1 --2- 172.21.15.6:0/1918655760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2480aefe0 0x7fe2480c9c50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe2480710a0 tx=0x7fe240009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143e1baf221ee400 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.011+0000 7fe247400640 1 -- 172.21.15.6:0/1918655760 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe240007550 con 0x7fe2480aefe0 2024-08-17T02:29:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.011+0000 7fe247400640 1 -- 172.21.15.6:0/1918655760 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24002d050 con 0x7fe2480aefe0 2024-08-17T02:29:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.011+0000 7fe247400640 1 -- 172.21.15.6:0/1918655760 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe240007920 con 0x7fe2480aefe0 2024-08-17T02:29:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.011+0000 7fe24f000640 1 -- 172.21.15.6:0/1918655760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2480aefe0 msgr2=0x7fe2480c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.011+0000 7fe24f000640 1 --2- 172.21.15.6:0/1918655760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2480aefe0 0x7fe2480c9c50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe2480710a0 tx=0x7fe240009780 comp rx=0 tx=0).stop 2024-08-17T02:29:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.011+0000 7fe24f000640 1 -- 172.21.15.6:0/1918655760 shutdown_connections 2024-08-17T02:29:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.011+0000 7fe24f000640 1 --2- 172.21.15.6:0/1918655760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2480aefe0 0x7fe2480c9c50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.011+0000 7fe24f000640 1 --2- 172.21.15.6:0/1918655760 >> v2:172.21.15.136:3300/0 conn(0x7fe248155910 0x7fe2480ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.011+0000 7fe24f000640 1 -- 172.21.15.6:0/1918655760 >> 172.21.15.6:0/1918655760 conn(0x7fe248066e60 msgr2=0x7fe248067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.011+0000 7fe24f000640 1 -- 172.21.15.6:0/1918655760 shutdown_connections 2024-08-17T02:29:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.011+0000 7fe24f000640 1 -- 172.21.15.6:0/1918655760 wait complete. 2024-08-17T02:29:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.013+0000 7fe24f000640 1 Processor -- start 2024-08-17T02:29:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.013+0000 7fe24f000640 1 -- start start 2024-08-17T02:29:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.014+0000 7fe24f000640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2480ade20 0x7fe248164d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.014+0000 7fe24f000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2480aefe0 0x7fe2481508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.014+0000 7fe24f000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe248155910 0x7fe24814ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.014+0000 7fe24f000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe248149700 con 0x7fe248155910 2024-08-17T02:29:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.014+0000 7fe24f000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24814da80 con 0x7fe2480aefe0 2024-08-17T02:29:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.014+0000 7fe24f000640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24814d730 con 0x7fe2480ade20 2024-08-17T02:29:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.014+0000 7fe24d000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe248155910 0x7fe24814ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.014+0000 7fe24d000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe248155910 0x7fe24814ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51852/0 (socket says 172.21.15.6:51852) 2024-08-17T02:29:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.014+0000 7fe24d000640 1 -- 172.21.15.6:0/440117545 learned_addr learned my addr 172.21.15.6:0/440117545 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.014+0000 7fe247e00640 1 --2- 172.21.15.6:0/440117545 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2480ade20 0x7fe248164d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.014+0000 7fe23f400640 1 --2- 172.21.15.6:0/440117545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2480aefe0 0x7fe2481508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.014+0000 7fe24d000640 1 -- 172.21.15.6:0/440117545 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2480ade20 msgr2=0x7fe248164d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.014+0000 7fe24d000640 1 --2- 172.21.15.6:0/440117545 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2480ade20 0x7fe248164d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.015+0000 7fe24d000640 1 -- 172.21.15.6:0/440117545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2480aefe0 msgr2=0x7fe2481508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.015+0000 7fe24d000640 1 --2- 172.21.15.6:0/440117545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2480aefe0 0x7fe2481508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.015+0000 7fe24d000640 1 -- 172.21.15.6:0/440117545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe240009a20 con 0x7fe248155910 2024-08-17T02:29:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.015+0000 7fe24d000640 1 --2- 172.21.15.6:0/440117545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe248155910 0x7fe24814ed50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe2400099f0 tx=0x7fe240037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.015+0000 7fe23fe00640 1 -- 172.21.15.6:0/440117545 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe240031b70 con 0x7fe248155910 2024-08-17T02:29:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.015+0000 7fe23fe00640 1 -- 172.21.15.6:0/440117545 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe240031cd0 con 0x7fe248155910 2024-08-17T02:29:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.015+0000 7fe23fe00640 1 -- 172.21.15.6:0/440117545 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe240045690 con 0x7fe248155910 2024-08-17T02:29:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.015+0000 7fe24f000640 1 -- 172.21.15.6:0/440117545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24814cb70 con 0x7fe248155910 2024-08-17T02:29:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.015+0000 7fe24f000640 1 -- 172.21.15.6:0/440117545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24814d1b0 con 0x7fe248155910 2024-08-17T02:29:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.016+0000 7fe24f000640 1 -- 172.21.15.6:0/440117545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe248067fd0 con 0x7fe248155910 2024-08-17T02:29:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.017+0000 7fe23fe00640 1 -- 172.21.15.6:0/440117545 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe24003c420 con 0x7fe248155910 2024-08-17T02:29:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.018+0000 7fe23fe00640 1 --2- 172.21.15.6:0/440117545 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe224065150 0x7fe224067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.018+0000 7fe23fe00640 1 -- 172.21.15.6:0/440117545 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe2400a39a0 con 0x7fe248155910 2024-08-17T02:29:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.018+0000 7fe247e00640 1 --2- 172.21.15.6:0/440117545 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe224065150 0x7fe224067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.019+0000 7fe247e00640 1 --2- 172.21.15.6:0/440117545 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe224065150 0x7fe224067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe23800bb40 tx=0x7fe238008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.022+0000 7fe23fe00640 1 -- 172.21.15.6:0/440117545 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe240071c60 con 0x7fe248155910 2024-08-17T02:29:56.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.202+0000 7fe24f000640 1 -- 172.21.15.6:0/440117545 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe248063fb0 con 0x7fe224065150 2024-08-17T02:29:56.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.205+0000 7fe23fe00640 1 -- 172.21.15.6:0/440117545 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50951 (secure 0 0 0) 0x7fe248063fb0 con 0x7fe224065150 2024-08-17T02:29:56.206 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:56.206 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-08-17T02:29:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.207+0000 7fe24f000640 1 -- 172.21.15.6:0/440117545 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe224065150 msgr2=0x7fe224067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.207+0000 7fe24f000640 1 --2- 172.21.15.6:0/440117545 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe224065150 0x7fe224067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe23800bb40 tx=0x7fe238008040 comp rx=0 tx=0).stop 2024-08-17T02:29:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.207+0000 7fe24f000640 1 -- 172.21.15.6:0/440117545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe248155910 msgr2=0x7fe24814ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.207+0000 7fe24f000640 1 --2- 172.21.15.6:0/440117545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe248155910 0x7fe24814ed50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe2400099f0 tx=0x7fe240037000 comp rx=0 tx=0).stop 2024-08-17T02:29:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.207+0000 7fe24f000640 1 -- 172.21.15.6:0/440117545 shutdown_connections 2024-08-17T02:29:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.207+0000 7fe24f000640 1 --2- 172.21.15.6:0/440117545 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe224065150 0x7fe224067600 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.207+0000 7fe24f000640 1 --2- 172.21.15.6:0/440117545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe248155910 0x7fe24814ed50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.207+0000 7fe24f000640 1 --2- 172.21.15.6:0/440117545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2480aefe0 0x7fe2481508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.207+0000 7fe24f000640 1 --2- 172.21.15.6:0/440117545 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2480ade20 0x7fe248164d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.207+0000 7fe24f000640 1 -- 172.21.15.6:0/440117545 >> 172.21.15.6:0/440117545 conn(0x7fe248066e60 msgr2=0x7fe2480c9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.207+0000 7fe24f000640 1 -- 172.21.15.6:0/440117545 shutdown_connections 2024-08-17T02:29:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.207+0000 7fe24f000640 1 -- 172.21.15.6:0/440117545 wait complete. 2024-08-17T02:29:56.223 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-08-17T02:29:55.464616+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2392356,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752582364,"statfs":{"total":773094113280,"available":770644340736,"internally_reserved":0,"allocated":5283840,"data_stored":2880488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.892090"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":185,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:29:50.752485+0000","last_change":"2024-08-17T02:26:27.275086+0000","last_active":"2024-08-17T02:29:50.752485+0000","last_peered":"2024-08-17T02:29:50.752485+0000","last_clean":"2024-08-17T02:29:50.752485+0000","last_became_active":"2024-08-17T02:26:27.274075+0000","last_became_peered":"2024-08-17T02:26:27.274075+0000","last_unstale":"2024-08-17T02:29:50.752485+0000","last_undegraded":"2024-08-17T02:29:50.752485+0000","last_fullsized":"2024-08-17T02:29:50.752485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_clean_scrub_stamp":"2024-08-17T02:26:26.139133+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:52.161982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302596,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069244,"statfs":{"total":96636764160,"available":96326905856,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94899999999999995,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.504},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.51400000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93300000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67900000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.69399999999999995,"15min":0.67800000000000005},"min":{"1min":0.64000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98399999999999999,"5min":1.034,"15min":1.034},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73399999999999999,"15min":0.71699999999999997},"min":{"1min":0.64200000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.63200000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68100000000000005,"15min":0.65500000000000003},"min":{"1min":0.55700000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.64700000000000002,"15min":0.63100000000000001},"min":{"1min":0.57299999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59899999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.60499999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73699999999999999,"15min":0.73299999999999998},"min":{"1min":0.52400000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.71999999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.59399999999999997,"15min":0.61799999999999999},"min":{"1min":0.42699999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69599999999999995,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.63100000000000001,"15min":0.66700000000000004},"min":{"1min":0.46100000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78900000000000003,"5min":1.226,"15min":1.226},"last":0.69699999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82799999999999996,"5min":1.075,"15min":1.075},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71599999999999997,"15min":0.73499999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84599999999999997,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.68500000000000005,"15min":0.70499999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.81299999999999994,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.71299999999999997,"15min":0.75600000000000001},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99099999999999999,"5min":1.855,"15min":1.855},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64800000000000002,"15min":0.626},"min":{"1min":0.52200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63900000000000001,"15min":0.61599999999999999},"min":{"1min":0.55600000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92400000000000004,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.79400000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.51100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":0.999,"15min":0.999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.50800000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93100000000000005,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.749}]},{"osd":2,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.64200000000000002,"15min":0.60999999999999999},"min":{"1min":0.53200000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.624,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.73199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.73799999999999999},"min":{"1min":0.61299999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.97499999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70899999999999996,"15min":0.68500000000000005},"min":{"1min":0.626,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88800000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.71299999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.627,"15min":0.64300000000000002},"min":{"1min":0.47599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.60899999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.44,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76700000000000002,"5min":0.871,"15min":0.871},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71499999999999997,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90300000000000002,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.81200000000000006}]},{"osd":7,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70399999999999996,"15min":0.70899999999999996},"min":{"1min":0.49199999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85599999999999998,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.83199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.76500000000000001},"min":{"1min":0.53600000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92200000000000004,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.626},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.52600000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94199999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.68899999999999995},"min":{"1min":0.56299999999999994,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91400000000000003,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.81699999999999995,"15min":0.871},"min":{"1min":0.47699999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82499999999999996,"5min":4.0670000000000002,"15min":4.0670000000000002},"last":0.60699999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70499999999999996,"15min":0.68899999999999995},"min":{"1min":0.63200000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.85299999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68100000000000005,"15min":0.66600000000000004},"min":{"1min":0.59299999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.57299999999999995,"5min":0.433,"15min":0.433},"max":{"1min":0.91700000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.58399999999999996,"5min":0.504,"15min":0.504},"max":{"1min":0.89300000000000002,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.52600000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.57199999999999995,"15min":0.59399999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69999999999999996,"5min":0.879,"15min":0.879},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63,"15min":0.65000000000000002},"min":{"1min":0.44400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84499999999999997,"5min":0.877,"15min":0.877},"last":0.53400000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86499999999999999,"5min":0.879,"15min":0.879},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.79600000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.55700000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69999999999999996,"15min":0.71499999999999997},"min":{"1min":0.50600000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.55800000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86699999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.73699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.64700000000000002,"15min":0.61699999999999999},"min":{"1min":0.47599999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71799999999999997,"15min":0.70099999999999996},"min":{"1min":0.51100000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89800000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58299999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72899999999999998,"15min":0.72399999999999998},"min":{"1min":0.502,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93999999999999995,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.71499999999999997,"15min":0.69299999999999995},"min":{"1min":0.54200000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0009999999999999,"5min":1.234,"15min":1.234},"last":0.70899999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.56000000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0209999999999999,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.80800000000000005,"15min":0.80600000000000005},"min":{"1min":0.73599999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.98099999999999998,"5min":1.645,"15min":1.645},"last":0.68000000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.56200000000000006,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.72999999999999998,"15min":0.71799999999999997},"min":{"1min":0.63300000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.026,"5min":1.605,"15min":1.605},"last":0.51700000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64800000000000002,"15min":0.67000000000000004},"min":{"1min":0.45000000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.76900000000000002,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.433},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67700000000000005,"15min":0.68999999999999995},"min":{"1min":0.51900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.82999999999999996,"5min":1.429,"15min":1.429},"last":0.60999999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.51500000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83899999999999997,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.498,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.85599999999999998,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.72799999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.755,"15min":0.77800000000000002},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.95599999999999996,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.752},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94799999999999995,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.69899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.50700000000000001,"15min":0.52400000000000002},"min":{"1min":0.36099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68500000000000005,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.45800000000000002,"15min":0.437},"min":{"1min":0.38200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70999999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45600000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.35899999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69799999999999995,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.498},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.628,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.436}]},{"osd":2,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.439,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67200000000000004,"5min":1.375,"15min":1.375},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71099999999999997,"5min":1.347,"15min":1.347},"last":0.56100000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.63200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0289999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.96999999999999997,"5min":1.321,"15min":1.321},"last":0.83199999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79200000000000004,"15min":0.78500000000000003},"min":{"1min":0.65500000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0669999999999999,"5min":1.421,"15min":1.421},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78200000000000003,"15min":0.77800000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.98899999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79300000000000004,"15min":0.78700000000000003},"min":{"1min":0.59999999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.103,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.70299999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.94899999999999995,"5min":1.389,"15min":1.389},"last":0.79600000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.78100000000000003,"15min":0.76700000000000002},"min":{"1min":0.58199999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.085,"5min":1.091,"15min":1.091},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.84499999999999997,"15min":0.85099999999999998},"min":{"1min":0.68000000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.014,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.89100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.52700000000000002,"15min":0.56299999999999994},"min":{"1min":0.32500000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.70599999999999996,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57299999999999995,"15min":0.59099999999999997},"min":{"1min":0.44400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.61599999999999999,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.32200000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60699999999999998,"15min":0.63500000000000001},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64600000000000002,"5min":3.827,"15min":3.827},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58899999999999997,"15min":0.59699999999999998},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71499999999999997,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.38200000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52600000000000002,"15min":0.54500000000000004},"min":{"1min":0.34300000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.747,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.46400000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75900000000000001,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.433}]},{"osd":4,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.85499999999999998,"15min":0.879},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1739999999999999,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81200000000000006,"15min":0.81999999999999995},"min":{"1min":0.60799999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.073,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.55700000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.63900000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4259999999999999,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":0.496},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.61899999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3129999999999999,"5min":3.54,"15min":3.54},"last":0.59299999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79900000000000004,"15min":0.80900000000000005},"min":{"1min":0.66800000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.216,"5min":1.274,"15min":1.274},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4690000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.57499999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85999999999999999,"15min":0.872},"min":{"1min":0.60899999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.88200000000000001,"15min":0.89000000000000001},"min":{"1min":0.66800000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.264,"5min":2.302,"15min":2.302},"last":0.626}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.55100000000000005,"15min":0.59999999999999998},"min":{"1min":0.316,"5min":0.311,"15min":0.311},"max":{"1min":0.55700000000000005,"5min":2.871,"15min":2.871},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.625,"15min":0.67100000000000004},"min":{"1min":0.44700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65000000000000002,"5min":2.96,"15min":2.96},"last":0.45400000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.505,"15min":0.53800000000000003},"min":{"1min":0.35099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59799999999999998,"5min":2.371,"15min":2.371},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.71299999999999997,"15min":0.80900000000000005},"min":{"1min":0.375,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.54300000000000004,"5min":5.468,"15min":5.468},"last":0.435}]},{"osd":3,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72399999999999998,"15min":0.77300000000000002},"min":{"1min":0.51200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.745,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.65500000000000003,"15min":0.70999999999999996},"min":{"1min":0.39200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":0.40999999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83099999999999996,"15min":0.84799999999999998},"min":{"1min":0.61799999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.98999999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.92200000000000004,"15min":0.96699999999999997},"min":{"1min":0.69199999999999995,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.96999999999999997,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.90000000000000002,"15min":0.94999999999999996},"min":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98299999999999998,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.86899999999999999,"15min":0.90700000000000003},"min":{"1min":0.66900000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.042,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":0.504}]},{"osd":6,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.91400000000000003,"15min":0.97599999999999998},"min":{"1min":0.61299999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.97799999999999998,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83299999999999996,"15min":0.85099999999999998},"min":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.95599999999999996,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.61499999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.98199999999999998,"15min":1.0740000000000001},"min":{"1min":0.66300000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.86899999999999999,"5min":5.5190000000000001,"15min":5.5190000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.97999999999999998,"15min":1.0660000000000001},"min":{"1min":0.59699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94799999999999995,"5min":4.5970000000000004,"15min":4.5970000000000004},"last":0.59399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42099999999999999,"15min":0.40699999999999997},"min":{"1min":0.33100000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60499999999999998,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.47499999999999998,"15min":0.45800000000000002},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.52300000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.38300000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.40000000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.57399999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.47299999999999998},"min":{"1min":0.39400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.46100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81999999999999995,"5min":0.873,"15min":0.873},"last":0.63}]},{"osd":4,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.78300000000000003,"15min":0.76800000000000002},"min":{"1min":0.66700000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.58199999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0529999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.73299999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.78800000000000003,"15min":0.77500000000000002},"min":{"1min":0.63900000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79300000000000004,"15min":0.78700000000000003},"min":{"1min":0.67500000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0169999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.78300000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.82899999999999996,"15min":0.81699999999999995},"min":{"1min":0.73099999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1040000000000001,"5min":1.109,"15min":1.109},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.82099999999999995,"15min":0.80500000000000005},"min":{"1min":0.66800000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.749}]},{"osd":7,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.86199999999999999,"15min":0.85499999999999998},"min":{"1min":0.70699999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.875,"5min":0.83099999999999996,"15min":0.82099999999999995},"min":{"1min":0.68700000000000006,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0800000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.85799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:56.224 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:56.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.375+0000 7fe024200640 1 Processor -- start 2024-08-17T02:29:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.375+0000 7fe024200640 1 -- start start 2024-08-17T02:29:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.376+0000 7fe024200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe01c0b1860 0x7fe01c069c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.376+0000 7fe024200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe01c06a360 0x7fe01c157a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.376+0000 7fe024200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01c157590 con 0x7fe01c0aae60 2024-08-17T02:29:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.376+0000 7fe024200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01c06b3a0 con 0x7fe01c0b1860 2024-08-17T02:29:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.376+0000 7fe024200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c06ab00 con 0x7fe01c06a360 2024-08-17T02:29:56.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.377+0000 7fe022200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe01c06a360 0x7fe01c157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:56.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.377+0000 7fe020e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe01c0b1860 0x7fe01c069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:56.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.377+0000 7fe020e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe01c0b1860 0x7fe01c069c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:35752/0 (socket says 172.21.15.6:35752) 2024-08-17T02:29:56.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.377+0000 7fe020e00640 1 -- 172.21.15.6:0/2942641184 learned_addr learned my addr 172.21.15.6:0/2942641184 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:56.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.377+0000 7fe01be00640 1 -- 172.21.15.6:0/2942641184 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744211483 0 0) 0x7fe01c157590 con 0x7fe01c0aae60 2024-08-17T02:29:56.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.378+0000 7fe022200640 1 -- 172.21.15.6:0/2942641184 >> v2:172.21.15.136:3300/0 conn(0x7fe01c0b1860 msgr2=0x7fe01c069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:56.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.378+0000 7fe022200640 1 --2- 172.21.15.6:0/2942641184 >> v2:172.21.15.136:3300/0 conn(0x7fe01c0b1860 0x7fe01c069c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.378+0000 7fe022200640 1 -- 172.21.15.6:0/2942641184 >> v1:172.21.15.136:6789/0 conn(0x7fe01c0aae60 legacy=0x7fe01c0b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:56.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.378+0000 7fe022200640 1 -- 172.21.15.6:0/2942641184 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c06ade0 con 0x7fe01c06a360 2024-08-17T02:29:56.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.378+0000 7fe020e00640 1 --2- 172.21.15.6:0/2942641184 >> v2:172.21.15.136:3300/0 conn(0x7fe01c0b1860 0x7fe01c069c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.379+0000 7fe022200640 1 --2- 172.21.15.6:0/2942641184 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe01c06a360 0x7fe01c157a20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe014009e90 tx=0x7fe014009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81868f95cc61521e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.379+0000 7fe01be00640 1 -- 172.21.15.6:0/2942641184 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe014007550 con 0x7fe01c06a360 2024-08-17T02:29:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.379+0000 7fe01be00640 1 -- 172.21.15.6:0/2942641184 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01402d050 con 0x7fe01c06a360 2024-08-17T02:29:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.379+0000 7fe01be00640 1 -- 172.21.15.6:0/2942641184 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0140078e0 con 0x7fe01c06a360 2024-08-17T02:29:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.379+0000 7fe024200640 1 -- 172.21.15.6:0/2942641184 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe01c06a360 msgr2=0x7fe01c157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.379+0000 7fe024200640 1 --2- 172.21.15.6:0/2942641184 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe01c06a360 0x7fe01c157a20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe014009e90 tx=0x7fe014009780 comp rx=0 tx=0).stop 2024-08-17T02:29:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.380+0000 7fe024200640 1 -- 172.21.15.6:0/2942641184 shutdown_connections 2024-08-17T02:29:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.380+0000 7fe024200640 1 --2- 172.21.15.6:0/2942641184 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe01c06a360 0x7fe01c157a20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.380+0000 7fe024200640 1 --2- 172.21.15.6:0/2942641184 >> v2:172.21.15.136:3300/0 conn(0x7fe01c0b1860 0x7fe01c069c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.380+0000 7fe024200640 1 -- 172.21.15.6:0/2942641184 >> 172.21.15.6:0/2942641184 conn(0x7fe01c066e60 msgr2=0x7fe01c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.380+0000 7fe024200640 1 -- 172.21.15.6:0/2942641184 shutdown_connections 2024-08-17T02:29:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.380+0000 7fe024200640 1 -- 172.21.15.6:0/2942641184 wait complete. 2024-08-17T02:29:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.381+0000 7fe024200640 1 Processor -- start 2024-08-17T02:29:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.381+0000 7fe024200640 1 -- start start 2024-08-17T02:29:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.382+0000 7fe024200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe01c06a360 0x7fe01c158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.382+0000 7fe024200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe01c0aae60 0x7fe01c16a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.382+0000 7fe024200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe01c0b1860 0x7fe01c16ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.382+0000 7fe024200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c158a80 con 0x7fe01c06a360 2024-08-17T02:29:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.382+0000 7fe024200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c15a650 con 0x7fe01c0aae60 2024-08-17T02:29:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.382+0000 7fe024200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c15a910 con 0x7fe01c0b1860 2024-08-17T02:29:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.382+0000 7fe021800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe01c06a360 0x7fe01c158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.383+0000 7fe021800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe01c06a360 0x7fe01c158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51862/0 (socket says 172.21.15.6:51862) 2024-08-17T02:29:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.383+0000 7fe021800640 1 -- 172.21.15.6:0/1398992837 learned_addr learned my addr 172.21.15.6:0/1398992837 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.383+0000 7fe022200640 1 --2- 172.21.15.6:0/1398992837 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe01c0b1860 0x7fe01c16ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.383+0000 7fe020e00640 1 --2- 172.21.15.6:0/1398992837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe01c0aae60 0x7fe01c16a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.383+0000 7fe021800640 1 -- 172.21.15.6:0/1398992837 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe01c0b1860 msgr2=0x7fe01c16ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.383+0000 7fe021800640 1 --2- 172.21.15.6:0/1398992837 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe01c0b1860 0x7fe01c16ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.383+0000 7fe021800640 1 -- 172.21.15.6:0/1398992837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe01c0aae60 msgr2=0x7fe01c16a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.383+0000 7fe021800640 1 --2- 172.21.15.6:0/1398992837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe01c0aae60 0x7fe01c16a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.383+0000 7fe021800640 1 -- 172.21.15.6:0/1398992837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe008009450 con 0x7fe01c06a360 2024-08-17T02:29:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.383+0000 7fe021800640 1 --2- 172.21.15.6:0/1398992837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe01c06a360 0x7fe01c158f10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe01000c5b0 tx=0x7fe010007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.383+0000 7fe018c00640 1 -- 172.21.15.6:0/1398992837 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe010012630 con 0x7fe01c06a360 2024-08-17T02:29:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.384+0000 7fe018c00640 1 -- 172.21.15.6:0/1398992837 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0100127d0 con 0x7fe01c06a360 2024-08-17T02:29:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.384+0000 7fe024200640 1 -- 172.21.15.6:0/1398992837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe014009a20 con 0x7fe01c06a360 2024-08-17T02:29:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.384+0000 7fe018c00640 1 -- 172.21.15.6:0/1398992837 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe010012b90 con 0x7fe01c06a360 2024-08-17T02:29:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.384+0000 7fe024200640 1 -- 172.21.15.6:0/1398992837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c158430 con 0x7fe01c06a360 2024-08-17T02:29:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.385+0000 7fe024200640 1 -- 172.21.15.6:0/1398992837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01c063fb0 con 0x7fe01c06a360 2024-08-17T02:29:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.386+0000 7fe018c00640 1 -- 172.21.15.6:0/1398992837 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe01001b400 con 0x7fe01c06a360 2024-08-17T02:29:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.386+0000 7fe018c00640 1 --2- 172.21.15.6:0/1398992837 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fdffc065150 0x7fdffc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.387+0000 7fe018c00640 1 -- 172.21.15.6:0/1398992837 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe010081ea0 con 0x7fe01c06a360 2024-08-17T02:29:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.387+0000 7fe020e00640 1 --2- 172.21.15.6:0/1398992837 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fdffc065150 0x7fdffc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.388+0000 7fe020e00640 1 --2- 172.21.15.6:0/1398992837 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fdffc065150 0x7fdffc067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe008009420 tx=0x7fe008008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.390+0000 7fe018c00640 1 -- 172.21.15.6:0/1398992837 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe010050160 con 0x7fe01c06a360 2024-08-17T02:29:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.574+0000 7fe024200640 1 -- 172.21.15.6:0/1398992837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe01c0cbb90 con 0x7fe01c06a360 2024-08-17T02:29:56.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.574+0000 7fe018c00640 1 -- 172.21.15.6:0/1398992837 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12339 (secure 0 0 0) 0x7fe010053780 con 0x7fe01c06a360 2024-08-17T02:29:56.575 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:29:56.575 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"fsid":"61589148-c13d-47c7-8fbb-d1646bb8e5e2","created":"2024-08-17T02:26:12.931865+0000","modified":"2024-08-17T02:29:51.754037+0000","last_up_change":"2024-08-17T02:26:24.134491+0000","last_in_change":"2024-08-17T02:26:15.818235+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:25.463503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"6723087a-acf7-4d6c-a252-3e9ad8778e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6823","nonce":36885},{"type":"v1","addr":"172.21.15.6:6825","nonce":36885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":36885},{"type":"v1","addr":"172.21.15.6:6827","nonce":36885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":36885},{"type":"v1","addr":"172.21.15.6:6831","nonce":36885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":36885},{"type":"v1","addr":"172.21.15.6:6829","nonce":36885}]},"public_addr":"172.21.15.6:6825/36885","cluster_addr":"172.21.15.6:6827/36885","heartbeat_back_addr":"172.21.15.6:6831/36885","heartbeat_front_addr":"172.21.15.6:6829/36885","state":["exists","up"]},{"osd":1,"uuid":"770e8a42-c2ec-4989-9e72-695089f35d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":36882},{"type":"v1","addr":"172.21.15.6:6809","nonce":36882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":36882},{"type":"v1","addr":"172.21.15.6:6811","nonce":36882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":36882},{"type":"v1","addr":"172.21.15.6:6815","nonce":36882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":36882},{"type":"v1","addr":"172.21.15.6:6813","nonce":36882}]},"public_addr":"172.21.15.6:6809/36882","cluster_addr":"172.21.15.6:6811/36882","heartbeat_back_addr":"172.21.15.6:6815/36882","heartbeat_front_addr":"172.21.15.6:6813/36882","state":["exists","up"]},{"osd":2,"uuid":"3c8b3d6f-5374-496c-b5b7-7fc3769c8bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":36884},{"type":"v1","addr":"172.21.15.6:6817","nonce":36884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":36884},{"type":"v1","addr":"172.21.15.6:6819","nonce":36884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":36884},{"type":"v1","addr":"172.21.15.6:6824","nonce":36884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":36884},{"type":"v1","addr":"172.21.15.6:6821","nonce":36884}]},"public_addr":"172.21.15.6:6817/36884","cluster_addr":"172.21.15.6:6819/36884","heartbeat_back_addr":"172.21.15.6:6824/36884","heartbeat_front_addr":"172.21.15.6:6821/36884","state":["exists","up"]},{"osd":3,"uuid":"f257b775-74b0-4e36-9493-99536f8c0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":36883},{"type":"v1","addr":"172.21.15.6:6801","nonce":36883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":36883},{"type":"v1","addr":"172.21.15.6:6803","nonce":36883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":36883},{"type":"v1","addr":"172.21.15.6:6807","nonce":36883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":36883},{"type":"v1","addr":"172.21.15.6:6805","nonce":36883}]},"public_addr":"172.21.15.6:6801/36883","cluster_addr":"172.21.15.6:6803/36883","heartbeat_back_addr":"172.21.15.6:6807/36883","heartbeat_front_addr":"172.21.15.6:6805/36883","state":["exists","up"]},{"osd":4,"uuid":"341b8afc-3c7c-43d9-9a4f-a01758853f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":37291},{"type":"v1","addr":"172.21.15.136:6801","nonce":37291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":37291},{"type":"v1","addr":"172.21.15.136:6803","nonce":37291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":37291},{"type":"v1","addr":"172.21.15.136:6813","nonce":37291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":37291},{"type":"v1","addr":"172.21.15.136:6807","nonce":37291}]},"public_addr":"172.21.15.136:6801/37291","cluster_addr":"172.21.15.136:6803/37291","heartbeat_back_addr":"172.21.15.136:6813/37291","heartbeat_front_addr":"172.21.15.136:6807/37291","state":["exists","up"]},{"osd":5,"uuid":"b728e85a-56ef-42ea-bf01-6cb390a743f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":37290},{"type":"v1","addr":"172.21.15.136:6806","nonce":37290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":37290},{"type":"v1","addr":"172.21.15.136:6809","nonce":37290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":37290},{"type":"v1","addr":"172.21.15.136:6815","nonce":37290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":37290},{"type":"v1","addr":"172.21.15.136:6812","nonce":37290}]},"public_addr":"172.21.15.136:6806/37290","cluster_addr":"172.21.15.136:6809/37290","heartbeat_back_addr":"172.21.15.136:6815/37290","heartbeat_front_addr":"172.21.15.136:6812/37290","state":["exists","up"]},{"osd":6,"uuid":"86cecff6-1678-424d-b980-f4cf3ea1c0cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":37292},{"type":"v1","addr":"172.21.15.136:6818","nonce":37292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":37292},{"type":"v1","addr":"172.21.15.136:6822","nonce":37292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":37292},{"type":"v1","addr":"172.21.15.136:6829","nonce":37292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":37292},{"type":"v1","addr":"172.21.15.136:6826","nonce":37292}]},"public_addr":"172.21.15.136:6818/37292","cluster_addr":"172.21.15.136:6822/37292","heartbeat_back_addr":"172.21.15.136:6829/37292","heartbeat_front_addr":"172.21.15.136:6826/37292","state":["exists","up"]},{"osd":7,"uuid":"9104ae61-807f-4fee-99ce-f40615e22d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":37309},{"type":"v1","addr":"172.21.15.136:6819","nonce":37309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6821","nonce":37309},{"type":"v1","addr":"172.21.15.136:6823","nonce":37309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":37309},{"type":"v1","addr":"172.21.15.136:6831","nonce":37309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":37309},{"type":"v1","addr":"172.21.15.136:6827","nonce":37309}]},"public_addr":"172.21.15.136:6819/37309","cluster_addr":"172.21.15.136:6823/37309","heartbeat_back_addr":"172.21.15.136:6831/37309","heartbeat_front_addr":"172.21.15.136:6827/37309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.237307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.136164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.244795+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.004545+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.075189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.059734+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.159516+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:21.115907+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6834/2620799775":"2024-08-18T02:29:48.568759+0000","172.21.15.6:6832/2620799775":"2024-08-18T02:29:48.568759+0000","172.21.15.6:6835/285178879":"2024-08-18T02:29:41.592570+0000","172.21.15.6:6833/285178879":"2024-08-18T02:29:41.592570+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:56.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.576+0000 7fe024200640 1 -- 172.21.15.6:0/1398992837 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fdffc065150 msgr2=0x7fdffc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:56.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.576+0000 7fe024200640 1 --2- 172.21.15.6:0/1398992837 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fdffc065150 0x7fdffc067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe008009420 tx=0x7fe008008040 comp rx=0 tx=0).stop 2024-08-17T02:29:56.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.576+0000 7fe024200640 1 -- 172.21.15.6:0/1398992837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe01c06a360 msgr2=0x7fe01c158f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:56.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.576+0000 7fe024200640 1 --2- 172.21.15.6:0/1398992837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe01c06a360 0x7fe01c158f10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe01000c5b0 tx=0x7fe010007d60 comp rx=0 tx=0).stop 2024-08-17T02:29:56.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.577+0000 7fe024200640 1 -- 172.21.15.6:0/1398992837 shutdown_connections 2024-08-17T02:29:56.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.577+0000 7fe024200640 1 --2- 172.21.15.6:0/1398992837 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fdffc065150 0x7fdffc067600 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.577+0000 7fe024200640 1 --2- 172.21.15.6:0/1398992837 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe01c0b1860 0x7fe01c16ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.577+0000 7fe024200640 1 --2- 172.21.15.6:0/1398992837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe01c0aae60 0x7fe01c16a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.577+0000 7fe024200640 1 --2- 172.21.15.6:0/1398992837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe01c06a360 0x7fe01c158f10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.577+0000 7fe024200640 1 -- 172.21.15.6:0/1398992837 >> 172.21.15.6:0/1398992837 conn(0x7fe01c066e60 msgr2=0x7fe01c0adab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:56.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.577+0000 7fe024200640 1 -- 172.21.15.6:0/1398992837 shutdown_connections 2024-08-17T02:29:56.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:56.577+0000 7fe024200640 1 -- 172.21.15.6:0/1398992837 wait complete. 2024-08-17T02:29:57.593 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:29:57.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.758+0000 7f221b200640 1 Processor -- start 2024-08-17T02:29:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.758+0000 7f221b200640 1 -- start start 2024-08-17T02:29:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.759+0000 7f221b200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f221c0b4f60 0x7f221c0ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.759+0000 7f221b200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221c0b3ac0 con 0x7f221c158dc0 2024-08-17T02:29:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.759+0000 7f221b200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221c0b3190 con 0x7f221c1589f0 2024-08-17T02:29:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.759+0000 7f221b200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221c0b3470 con 0x7f221c0b4f60 2024-08-17T02:29:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.759+0000 7f2213e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f221c158dc0 0x7f221c0cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46360/0 (socket says 172.21.15.6:46360) 2024-08-17T02:29:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.759+0000 7f2213e00640 1 -- 172.21.15.6:0/2255102335 learned_addr learned my addr 172.21.15.6:0/2255102335 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:57.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.759+0000 7f221a800640 1 --2- 172.21.15.6:0/2255102335 >> v2:172.21.15.136:3300/0 conn(0x7f221c0b4f60 0x7f221c0ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f2219400640 1 -- 172.21.15.6:0/2255102335 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387897876 0 0) 0x7f221c0b3ac0 con 0x7f221c158dc0 2024-08-17T02:29:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f2219400640 1 -- 172.21.15.6:0/2255102335 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22000034e0 con 0x7f221c158dc0 2024-08-17T02:29:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f2219400640 1 -- 172.21.15.6:0/2255102335 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1385544146 0 0) 0x7f221c0b3190 con 0x7f221c1589f0 2024-08-17T02:29:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f2219400640 1 -- 172.21.15.6:0/2255102335 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f221c0b3ac0 con 0x7f221c1589f0 2024-08-17T02:29:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f2219400640 1 -- 172.21.15.6:0/2255102335 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 268196970 0 0) 0x7f22000034e0 con 0x7f221c158dc0 2024-08-17T02:29:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f2219400640 1 -- 172.21.15.6:0/2255102335 >> v2:172.21.15.136:3300/0 conn(0x7f221c0b4f60 msgr2=0x7f221c0ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f2219400640 1 --2- 172.21.15.6:0/2255102335 >> v2:172.21.15.136:3300/0 conn(0x7f221c0b4f60 0x7f221c0ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f2219400640 1 -- 172.21.15.6:0/2255102335 >> v1:172.21.15.136:6789/0 conn(0x7f221c1589f0 legacy=0x7f221c0ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f2219400640 1 -- 172.21.15.6:0/2255102335 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c0b3750 con 0x7f221c158dc0 2024-08-17T02:29:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f2219400640 1 -- 172.21.15.6:0/2255102335 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f2204001470 con 0x7f221c158dc0 2024-08-17T02:29:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f221a800640 1 --2- 172.21.15.6:0/2255102335 >> v2:172.21.15.136:3300/0 conn(0x7f221c0b4f60 0x7f221c0ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f2219400640 1 -- 172.21.15.6:0/2255102335 >> v1:172.21.15.6:6789/0 conn(0x7f221c158dc0 legacy=0x7f221c0cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f2219400640 1 --2- 172.21.15.6:0/2255102335 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2200003b60 0x7f2200003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f2219400640 1 --2- 172.21.15.6:0/2255102335 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2200004780 0x7f2200004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f2219400640 1 --2- 172.21.15.6:0/2255102335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2200005130 0x7f220000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f2219400640 1 -- 172.21.15.6:0/2255102335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c0b3470 con 0x7f2200005130 2024-08-17T02:29:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f2219400640 1 -- 172.21.15.6:0/2255102335 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220000c020 con 0x7f2200004780 2024-08-17T02:29:57.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f2219400640 1 -- 172.21.15.6:0/2255102335 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220000c1e0 con 0x7f2200003b60 2024-08-17T02:29:57.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.760+0000 7f221a800640 1 --2- 172.21.15.6:0/2255102335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2200005130 0x7f220000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.761+0000 7f2213e00640 1 --2- 172.21.15.6:0/2255102335 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2200004780 0x7f2200004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.761+0000 7f2219e00640 1 --2- 172.21.15.6:0/2255102335 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2200003b60 0x7f2200003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.761+0000 7f221a800640 1 -- 172.21.15.6:0/2255102335 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2200003b60 msgr2=0x7f2200003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:57.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.761+0000 7f221a800640 1 --2- 172.21.15.6:0/2255102335 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2200003b60 0x7f2200003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.761+0000 7f221a800640 1 -- 172.21.15.6:0/2255102335 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2200004780 msgr2=0x7f2200004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:57.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.761+0000 7f221a800640 1 --2- 172.21.15.6:0/2255102335 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2200004780 0x7f2200004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.761+0000 7f221a800640 1 -- 172.21.15.6:0/2255102335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22000034e0 con 0x7f2200005130 2024-08-17T02:29:57.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.762+0000 7f221a800640 1 -- 172.21.15.6:0/2255102335 reap_dead start 2024-08-17T02:29:57.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.762+0000 7f221a800640 1 --2- 172.21.15.6:0/2255102335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2200005130 0x7f220000b9d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f221400e3c0 tx=0x7f221400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c324af062e42030 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:57.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.762+0000 7f2219400640 1 -- 172.21.15.6:0/2255102335 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2214036480 con 0x7f2200005130 2024-08-17T02:29:57.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.762+0000 7f2219400640 1 -- 172.21.15.6:0/2255102335 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221400f040 con 0x7f2200005130 2024-08-17T02:29:57.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.762+0000 7f2219400640 1 -- 172.21.15.6:0/2255102335 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2214036870 con 0x7f2200005130 2024-08-17T02:29:57.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.762+0000 7f221b200640 1 -- 172.21.15.6:0/2255102335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2200005130 msgr2=0x7f220000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.762+0000 7f221b200640 1 --2- 172.21.15.6:0/2255102335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2200005130 0x7f220000b9d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f221400e3c0 tx=0x7f221400b040 comp rx=0 tx=0).stop 2024-08-17T02:29:57.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.763+0000 7f221b200640 1 -- 172.21.15.6:0/2255102335 shutdown_connections 2024-08-17T02:29:57.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.763+0000 7f221b200640 1 --2- 172.21.15.6:0/2255102335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2200005130 0x7f220000b9d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.763+0000 7f221b200640 1 -- 172.21.15.6:0/2255102335 >> 172.21.15.6:0/2255102335 conn(0x7f221c087a80 msgr2=0x7f221c06e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:57.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.763+0000 7f221b200640 1 -- 172.21.15.6:0/2255102335 shutdown_connections 2024-08-17T02:29:57.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.763+0000 7f221b200640 1 -- 172.21.15.6:0/2255102335 wait complete. 2024-08-17T02:29:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.764+0000 7f221b200640 1 Processor -- start 2024-08-17T02:29:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.764+0000 7f221b200640 1 -- start start 2024-08-17T02:29:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.765+0000 7f221b200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2200005130 0x7f221c0b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.765+0000 7f221b200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f221c15ac80 0x7f221c153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.765+0000 7f221b200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221c15b0f0 0x7f221c154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.765+0000 7f221b200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c0b0550 con 0x7f221c15b0f0 2024-08-17T02:29:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.765+0000 7f221b200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c0b1ad0 con 0x7f2200005130 2024-08-17T02:29:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.765+0000 7f221b200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221c0b11a0 con 0x7f221c15ac80 2024-08-17T02:29:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.765+0000 7f221a800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221c15b0f0 0x7f221c154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.765+0000 7f221a800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221c15b0f0 0x7f221c154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51878/0 (socket says 172.21.15.6:51878) 2024-08-17T02:29:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.765+0000 7f221a800640 1 -- 172.21.15.6:0/2942721556 learned_addr learned my addr 172.21.15.6:0/2942721556 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.765+0000 7f2213e00640 1 --2- 172.21.15.6:0/2942721556 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f221c15ac80 0x7f221c153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.765+0000 7f2219e00640 1 --2- 172.21.15.6:0/2942721556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2200005130 0x7f221c0b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.766+0000 7f221a800640 1 -- 172.21.15.6:0/2942721556 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f221c15ac80 msgr2=0x7f221c153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.766+0000 7f221a800640 1 --2- 172.21.15.6:0/2942721556 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f221c15ac80 0x7f221c153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.766+0000 7f221a800640 1 -- 172.21.15.6:0/2942721556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2200005130 msgr2=0x7f221c0b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.766+0000 7f221a800640 1 --2- 172.21.15.6:0/2942721556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2200005130 0x7f221c0b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.766+0000 7f221a800640 1 -- 172.21.15.6:0/2942721556 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c0b1480 con 0x7f221c15b0f0 2024-08-17T02:29:57.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.766+0000 7f221a800640 1 --2- 172.21.15.6:0/2942721556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221c15b0f0 0x7f221c154280 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f221400e3c0 tx=0x7f2214036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:57.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.766+0000 7f2211600640 1 -- 172.21.15.6:0/2942721556 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221402cb00 con 0x7f221c15b0f0 2024-08-17T02:29:57.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.766+0000 7f2211600640 1 -- 172.21.15.6:0/2942721556 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221402cc80 con 0x7f221c15b0f0 2024-08-17T02:29:57.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.766+0000 7f221b200640 1 -- 172.21.15.6:0/2942721556 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221c0b1760 con 0x7f221c15b0f0 2024-08-17T02:29:57.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.766+0000 7f2211600640 1 -- 172.21.15.6:0/2942721556 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2214041420 con 0x7f221c15b0f0 2024-08-17T02:29:57.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.767+0000 7f221b200640 1 -- 172.21.15.6:0/2942721556 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c0af930 con 0x7f221c15b0f0 2024-08-17T02:29:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.767+0000 7f221b200640 1 -- 172.21.15.6:0/2942721556 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f221c063f10 con 0x7f221c15b0f0 2024-08-17T02:29:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.768+0000 7f2211600640 1 -- 172.21.15.6:0/2942721556 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f221402d410 con 0x7f221c15b0f0 2024-08-17T02:29:57.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.769+0000 7f2211600640 1 --2- 172.21.15.6:0/2942721556 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f21f8065150 0x7f21f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.769+0000 7f2211600640 1 -- 172.21.15.6:0/2942721556 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f221403d070 con 0x7f221c15b0f0 2024-08-17T02:29:57.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.769+0000 7f2211600640 1 --2- 172.21.15.6:0/2942721556 >> [v2:172.21.15.6:6823/36885,v1:172.21.15.6:6825/36885] conn(0x7f21f806b040 0x7f21f806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.769+0000 7f2211600640 1 -- 172.21.15.6:0/2942721556 --> [v2:172.21.15.6:6823/36885,v1:172.21.15.6:6825/36885] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21f806db00 con 0x7f21f806b040 2024-08-17T02:29:57.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.769+0000 7f2211600640 1 -- 172.21.15.6:0/2942721556 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22140a7220 con 0x7f221c15b0f0 2024-08-17T02:29:57.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.769+0000 7f2219e00640 1 --2- 172.21.15.6:0/2942721556 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f21f8065150 0x7f21f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.770+0000 7f2213e00640 1 --2- 172.21.15.6:0/2942721556 >> [v2:172.21.15.6:6823/36885,v1:172.21.15.6:6825/36885] conn(0x7f21f806b040 0x7f21f806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.770+0000 7f2213e00640 1 --2- 172.21.15.6:0/2942721556 >> [v2:172.21.15.6:6823/36885,v1:172.21.15.6:6825/36885] conn(0x7f21f806b040 0x7f21f806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:57.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.770+0000 7f2219e00640 1 --2- 172.21.15.6:0/2942721556 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f21f8065150 0x7f21f8067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f220c003a40 tx=0x7f220c00c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:57.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.771+0000 7f2211600640 1 -- 172.21.15.6:0/2942721556 <== osd.0 v2:172.21.15.6:6823/36885 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f21f806db00 con 0x7f21f806b040 2024-08-17T02:29:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.784+0000 7f221b200640 1 -- 172.21.15.6:0/2942721556 --> [v2:172.21.15.6:6823/36885,v1:172.21.15.6:6825/36885] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f221c0afe10 con 0x7f21f806b040 2024-08-17T02:29:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.785+0000 7f2211600640 1 -- 172.21.15.6:0/2942721556 <== osd.0 v2:172.21.15.6:6823/36885 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f221c0afe10 con 0x7f21f806b040 2024-08-17T02:29:57.786 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-08-17T02:29:57.786 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:57.786 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-08-17T02:29:57.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.785+0000 7f221b200640 1 -- 172.21.15.6:0/2942721556 >> [v2:172.21.15.6:6823/36885,v1:172.21.15.6:6825/36885] conn(0x7f21f806b040 msgr2=0x7f21f806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.785+0000 7f221b200640 1 --2- 172.21.15.6:0/2942721556 >> [v2:172.21.15.6:6823/36885,v1:172.21.15.6:6825/36885] conn(0x7f21f806b040 0x7f21f806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.785+0000 7f221b200640 1 -- 172.21.15.6:0/2942721556 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f21f8065150 msgr2=0x7f21f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.785+0000 7f221b200640 1 --2- 172.21.15.6:0/2942721556 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f21f8065150 0x7f21f8067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f220c003a40 tx=0x7f220c00c040 comp rx=0 tx=0).stop 2024-08-17T02:29:57.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.785+0000 7f221b200640 1 -- 172.21.15.6:0/2942721556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221c15b0f0 msgr2=0x7f221c154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.785+0000 7f221b200640 1 --2- 172.21.15.6:0/2942721556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221c15b0f0 0x7f221c154280 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f221400e3c0 tx=0x7f2214036000 comp rx=0 tx=0).stop 2024-08-17T02:29:57.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.785+0000 7f221a800640 1 -- 172.21.15.6:0/2942721556 reap_dead start 2024-08-17T02:29:57.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.785+0000 7f221b200640 1 -- 172.21.15.6:0/2942721556 shutdown_connections 2024-08-17T02:29:57.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.785+0000 7f221b200640 1 -- 172.21.15.6:0/2942721556 >> 172.21.15.6:0/2942721556 conn(0x7f221c087a80 msgr2=0x7f221c156e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:57.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.786+0000 7f221b200640 1 -- 172.21.15.6:0/2942721556 shutdown_connections 2024-08-17T02:29:57.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.786+0000 7f221b200640 1 -- 172.21.15.6:0/2942721556 wait complete. 2024-08-17T02:29:57.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:29:57.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.952+0000 7ff8d5e00640 1 Processor -- start 2024-08-17T02:29:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.952+0000 7ff8d5e00640 1 -- start start 2024-08-17T02:29:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.953+0000 7ff8d5e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff8d0158dd0 0x7ff8d006e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.953+0000 7ff8d5e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff8d006ead0 0x7ff8d00b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.953+0000 7ff8d5e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d006ef10 con 0x7ff8d0158a00 2024-08-17T02:29:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.953+0000 7ff8d5e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d0159200 con 0x7ff8d006ead0 2024-08-17T02:29:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.953+0000 7ff8d5e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d00cbc50 con 0x7ff8d0158dd0 2024-08-17T02:29:57.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.953+0000 7ff8d5400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff8d006ead0 0x7ff8d00b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.953+0000 7ff8d4a00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7ff8d0158a00 0x7ff8d00cb190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:37716/0 (socket says 172.21.15.6:37716) 2024-08-17T02:29:57.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.953+0000 7ff8d4a00640 1 -- 172.21.15.6:0/678116198 learned_addr learned my addr 172.21.15.6:0/678116198 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:57.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.953+0000 7ff8cfe00640 1 --2- 172.21.15.6:0/678116198 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff8d0158dd0 0x7ff8d006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.954+0000 7ff8cf400640 1 -- 172.21.15.6:0/678116198 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962061910 0 0) 0x7ff8d006ef10 con 0x7ff8d0158a00 2024-08-17T02:29:57.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.954+0000 7ff8cf400640 1 -- 172.21.15.6:0/678116198 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8b80034e0 con 0x7ff8d0158a00 2024-08-17T02:29:57.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.954+0000 7ff8cfe00640 1 -- 172.21.15.6:0/678116198 >> v2:172.21.15.136:3300/0 conn(0x7ff8d006ead0 msgr2=0x7ff8d00b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:57.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.954+0000 7ff8cfe00640 1 --2- 172.21.15.6:0/678116198 >> v2:172.21.15.136:3300/0 conn(0x7ff8d006ead0 0x7ff8d00b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.954+0000 7ff8cfe00640 1 -- 172.21.15.6:0/678116198 >> v1:172.21.15.136:6789/0 conn(0x7ff8d0158a00 legacy=0x7ff8d00cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.954+0000 7ff8cfe00640 1 -- 172.21.15.6:0/678116198 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d00cbf30 con 0x7ff8d0158dd0 2024-08-17T02:29:57.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.954+0000 7ff8d5400640 1 --2- 172.21.15.6:0/678116198 >> v2:172.21.15.136:3300/0 conn(0x7ff8d006ead0 0x7ff8d00b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:57.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.955+0000 7ff8cfe00640 1 --2- 172.21.15.6:0/678116198 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff8d0158dd0 0x7ff8d006e590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0159340 tx=0x7ff8bc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e1c7c3aa7cf2f21 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:57.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.955+0000 7ff8cf400640 1 -- 172.21.15.6:0/678116198 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc02ad80 con 0x7ff8d0158dd0 2024-08-17T02:29:57.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.955+0000 7ff8cf400640 1 -- 172.21.15.6:0/678116198 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc032440 con 0x7ff8d0158dd0 2024-08-17T02:29:57.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.955+0000 7ff8cf400640 1 -- 172.21.15.6:0/678116198 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc032820 con 0x7ff8d0158dd0 2024-08-17T02:29:57.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.956+0000 7ff8d5e00640 1 -- 172.21.15.6:0/678116198 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff8d0158dd0 msgr2=0x7ff8d006e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.956+0000 7ff8d5e00640 1 --2- 172.21.15.6:0/678116198 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff8d0158dd0 0x7ff8d006e590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0159340 tx=0x7ff8bc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.956+0000 7ff8d5e00640 1 -- 172.21.15.6:0/678116198 shutdown_connections 2024-08-17T02:29:57.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.956+0000 7ff8d5e00640 1 --2- 172.21.15.6:0/678116198 >> v2:172.21.15.136:3300/0 conn(0x7ff8d006ead0 0x7ff8d00b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.956+0000 7ff8d5e00640 1 --2- 172.21.15.6:0/678116198 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff8d0158dd0 0x7ff8d006e590 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.956+0000 7ff8d5e00640 1 -- 172.21.15.6:0/678116198 >> 172.21.15.6:0/678116198 conn(0x7ff8d00cfb80 msgr2=0x7ff8d00cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:57.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.956+0000 7ff8d5e00640 1 -- 172.21.15.6:0/678116198 shutdown_connections 2024-08-17T02:29:57.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.956+0000 7ff8d5e00640 1 -- 172.21.15.6:0/678116198 wait complete. 2024-08-17T02:29:57.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.957+0000 7ff8d5e00640 1 Processor -- start 2024-08-17T02:29:57.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.957+0000 7ff8d5e00640 1 -- start start 2024-08-17T02:29:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.958+0000 7ff8d5e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff8d006ead0 0x7ff8d0159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.958+0000 7ff8d5e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0158a00 0x7ff8d0169360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.958+0000 7ff8d5e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8d0158dd0 0x7ff8d0152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.958+0000 7ff8d5e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d00c6b90 con 0x7ff8d0158a00 2024-08-17T02:29:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.958+0000 7ff8d5e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0169bb0 con 0x7ff8d0158dd0 2024-08-17T02:29:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.958+0000 7ff8d5e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0169e90 con 0x7ff8d006ead0 2024-08-17T02:29:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.959+0000 7ff8cfe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0158a00 0x7ff8d0169360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.959+0000 7ff8cfe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0158a00 0x7ff8d0169360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51880/0 (socket says 172.21.15.6:51880) 2024-08-17T02:29:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.959+0000 7ff8cfe00640 1 -- 172.21.15.6:0/1694509270 learned_addr learned my addr 172.21.15.6:0/1694509270 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.959+0000 7ff8d4a00640 1 --2- 172.21.15.6:0/1694509270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff8d006ead0 0x7ff8d0159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.959+0000 7ff8d5400640 1 --2- 172.21.15.6:0/1694509270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8d0158dd0 0x7ff8d0152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.959+0000 7ff8cfe00640 1 -- 172.21.15.6:0/1694509270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff8d006ead0 msgr2=0x7ff8d0159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.959+0000 7ff8cfe00640 1 --2- 172.21.15.6:0/1694509270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff8d006ead0 0x7ff8d0159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.959+0000 7ff8cfe00640 1 -- 172.21.15.6:0/1694509270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8d0158dd0 msgr2=0x7ff8d0152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.959+0000 7ff8cfe00640 1 --2- 172.21.15.6:0/1694509270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8d0158dd0 0x7ff8d0152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.959+0000 7ff8cfe00640 1 -- 172.21.15.6:0/1694509270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c8009a20 con 0x7ff8d0158a00 2024-08-17T02:29:57.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.959+0000 7ff8cfe00640 1 --2- 172.21.15.6:0/1694509270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0158a00 0x7ff8d0169360 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009360 tx=0x7ff8bc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:57.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.960+0000 7ff8c3e00640 1 -- 172.21.15.6:0/1694509270 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc031ca0 con 0x7ff8d0158a00 2024-08-17T02:29:57.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.960+0000 7ff8c3e00640 1 -- 172.21.15.6:0/1694509270 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc031e00 con 0x7ff8d0158a00 2024-08-17T02:29:57.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.960+0000 7ff8c3e00640 1 -- 172.21.15.6:0/1694509270 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc03c650 con 0x7ff8d0158a00 2024-08-17T02:29:57.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.960+0000 7ff8d5e00640 1 -- 172.21.15.6:0/1694509270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8bc009390 con 0x7ff8d0158a00 2024-08-17T02:29:57.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.960+0000 7ff8d5e00640 1 -- 172.21.15.6:0/1694509270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d00c6e50 con 0x7ff8d0158a00 2024-08-17T02:29:57.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.961+0000 7ff8d5e00640 1 -- 172.21.15.6:0/1694509270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d00c7040 con 0x7ff8d0158a00 2024-08-17T02:29:57.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.962+0000 7ff8c3e00640 1 -- 172.21.15.6:0/1694509270 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff8bc03ca80 con 0x7ff8d0158a00 2024-08-17T02:29:57.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.963+0000 7ff8c3e00640 1 --2- 172.21.15.6:0/1694509270 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff8b0065150 0x7ff8b0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.963+0000 7ff8c3e00640 1 -- 172.21.15.6:0/1694509270 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff8bc0a2fe0 con 0x7ff8d0158a00 2024-08-17T02:29:57.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.963+0000 7ff8d4a00640 1 --2- 172.21.15.6:0/1694509270 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff8b0065150 0x7ff8b0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.964+0000 7ff8d4a00640 1 --2- 172.21.15.6:0/1694509270 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff8b0065150 0x7ff8b0067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00cd930 tx=0x7ff8c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:57.967+0000 7ff8c3e00640 1 -- 172.21.15.6:0/1694509270 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff8bc071390 con 0x7ff8d0158a00 2024-08-17T02:29:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.150+0000 7ff8d5e00640 1 -- 172.21.15.6:0/1694509270 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8d016a000 con 0x7ff8b0065150 2024-08-17T02:29:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.150+0000 7ff8c3e00640 1 -- 172.21.15.6:0/1694509270 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff8d016a000 con 0x7ff8b0065150 2024-08-17T02:29:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:29:58.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.152+0000 7ff8d5e00640 1 -- 172.21.15.6:0/1694509270 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff8b0065150 msgr2=0x7ff8b0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.152+0000 7ff8d5e00640 1 --2- 172.21.15.6:0/1694509270 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff8b0065150 0x7ff8b0067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00cd930 tx=0x7ff8c4009040 comp rx=0 tx=0).stop 2024-08-17T02:29:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.152+0000 7ff8d5e00640 1 -- 172.21.15.6:0/1694509270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0158a00 msgr2=0x7ff8d0169360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.152+0000 7ff8d5e00640 1 --2- 172.21.15.6:0/1694509270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0158a00 0x7ff8d0169360 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009360 tx=0x7ff8bc032000 comp rx=0 tx=0).stop 2024-08-17T02:29:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.152+0000 7ff8d5e00640 1 -- 172.21.15.6:0/1694509270 shutdown_connections 2024-08-17T02:29:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.152+0000 7ff8d5e00640 1 --2- 172.21.15.6:0/1694509270 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7ff8b0065150 0x7ff8b0067600 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.152+0000 7ff8d5e00640 1 --2- 172.21.15.6:0/1694509270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8d0158dd0 0x7ff8d0152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.152+0000 7ff8d5e00640 1 --2- 172.21.15.6:0/1694509270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0158a00 0x7ff8d0169360 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.152+0000 7ff8d5e00640 1 --2- 172.21.15.6:0/1694509270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff8d006ead0 0x7ff8d0159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.152+0000 7ff8d5e00640 1 -- 172.21.15.6:0/1694509270 >> 172.21.15.6:0/1694509270 conn(0x7ff8d00cfb80 msgr2=0x7ff8d00cc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:58.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.153+0000 7ff8d5e00640 1 -- 172.21.15.6:0/1694509270 shutdown_connections 2024-08-17T02:29:58.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.153+0000 7ff8d5e00640 1 -- 172.21.15.6:0/1694509270 wait complete. 2024-08-17T02:29:58.168 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:29:58.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.323+0000 7f75a6c00640 1 Processor -- start 2024-08-17T02:29:58.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.323+0000 7f75a6c00640 1 -- start start 2024-08-17T02:29:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.324+0000 7f75a6c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75a00ad020 0x7f75a0159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.324+0000 7f75a6c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f75a00afa00 0x7f75a00afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.324+0000 7f75a6c00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a00b03a0 con 0x7f75a00ac000 2024-08-17T02:29:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.324+0000 7f75a6c00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a0159ad0 con 0x7f75a00afa00 2024-08-17T02:29:58.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.324+0000 7f75a6c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00ad590 con 0x7f75a00ad020 2024-08-17T02:29:58.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.324+0000 7f759fe00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f75a00ac000 0x7f75a0156a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46364/0 (socket says 172.21.15.6:46364) 2024-08-17T02:29:58.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.324+0000 7f759fe00640 1 -- 172.21.15.6:0/2094168303 learned_addr learned my addr 172.21.15.6:0/2094168303 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:58.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.324+0000 7f7597e00640 1 --2- 172.21.15.6:0/2094168303 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75a00ad020 0x7f75a0159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.324+0000 7f75a4c00640 1 --2- 172.21.15.6:0/2094168303 >> v2:172.21.15.136:3300/0 conn(0x7f75a00afa00 0x7f75a00afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f759f400640 1 -- 172.21.15.6:0/2094168303 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980953840 0 0) 0x7f7590001110 con 0x7f75a00ac000 2024-08-17T02:29:58.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f759f400640 1 -- 172.21.15.6:0/2094168303 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75840034e0 con 0x7f75a00ac000 2024-08-17T02:29:58.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f759f400640 1 -- 172.21.15.6:0/2094168303 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1709332224 0 0) 0x7f75840034e0 con 0x7f75a00ac000 2024-08-17T02:29:58.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f759f400640 1 -- 172.21.15.6:0/2094168303 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75a00ad020 msgr2=0x7f75a0159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f759f400640 1 --2- 172.21.15.6:0/2094168303 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75a00ad020 0x7f75a0159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f759f400640 1 -- 172.21.15.6:0/2094168303 >> v2:172.21.15.136:3300/0 conn(0x7f75a00afa00 msgr2=0x7f75a00afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f759f400640 1 --2- 172.21.15.6:0/2094168303 >> v2:172.21.15.136:3300/0 conn(0x7f75a00afa00 0x7f75a00afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f759f400640 1 -- 172.21.15.6:0/2094168303 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a00ad870 con 0x7f75a00ac000 2024-08-17T02:29:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f759f400640 1 -- 172.21.15.6:0/2094168303 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f7590001600 con 0x7f75a00ac000 2024-08-17T02:29:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f759f400640 1 -- 172.21.15.6:0/2094168303 >> v1:172.21.15.6:6789/0 conn(0x7f75a00ac000 legacy=0x7f75a0156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f759f400640 1 --2- 172.21.15.6:0/2094168303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75840039d0 0x7f7584003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f759f400640 1 --2- 172.21.15.6:0/2094168303 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75a00ad020 0x7f7584004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f759f400640 1 --2- 172.21.15.6:0/2094168303 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7584004cc0 0x7f7584005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f759f400640 1 -- 172.21.15.6:0/2094168303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a0159ad0 con 0x7f75840039d0 2024-08-17T02:29:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f759f400640 1 -- 172.21.15.6:0/2094168303 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00ad590 con 0x7f7584004cc0 2024-08-17T02:29:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f759f400640 1 -- 172.21.15.6:0/2094168303 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758400b9d0 con 0x7f75a00ad020 2024-08-17T02:29:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f75a4c00640 1 --2- 172.21.15.6:0/2094168303 >> v2:172.21.15.136:3300/0 conn(0x7f75a00afa00 0x7f75a00afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.325+0000 7f759fe00640 1 --2- 172.21.15.6:0/2094168303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75840039d0 0x7f7584003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.326+0000 7f7597e00640 1 --2- 172.21.15.6:0/2094168303 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75a00ad020 0x7f7584004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.326+0000 7f75a4c00640 1 --2- 172.21.15.6:0/2094168303 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7584004cc0 0x7f7584005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.326+0000 7f759fe00640 1 -- 172.21.15.6:0/2094168303 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75a00ad020 msgr2=0x7f7584004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.326+0000 7f759fe00640 1 --2- 172.21.15.6:0/2094168303 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75a00ad020 0x7f7584004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.326+0000 7f759fe00640 1 -- 172.21.15.6:0/2094168303 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7584004cc0 msgr2=0x7f7584005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.326+0000 7f759fe00640 1 --2- 172.21.15.6:0/2094168303 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7584004cc0 0x7f7584005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.326+0000 7f759fe00640 1 -- 172.21.15.6:0/2094168303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75840034e0 con 0x7f75840039d0 2024-08-17T02:29:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.326+0000 7f75a4c00640 1 --2- 172.21.15.6:0/2094168303 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7584004cc0 0x7f7584005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.327+0000 7f759fe00640 1 --2- 172.21.15.6:0/2094168303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75840039d0 0x7f7584003de0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f759000c440 tx=0x7f75900079f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769372763a337ba1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.327+0000 7f759f400640 1 -- 172.21.15.6:0/2094168303 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590005890 con 0x7f75840039d0 2024-08-17T02:29:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.327+0000 7f759f400640 1 -- 172.21.15.6:0/2094168303 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7590005a10 con 0x7f75840039d0 2024-08-17T02:29:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.327+0000 7f759f400640 1 -- 172.21.15.6:0/2094168303 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590005e10 con 0x7f75840039d0 2024-08-17T02:29:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.328+0000 7f75a6c00640 1 -- 172.21.15.6:0/2094168303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75840039d0 msgr2=0x7f7584003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.328+0000 7f75a6c00640 1 --2- 172.21.15.6:0/2094168303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75840039d0 0x7f7584003de0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f759000c440 tx=0x7f75900079f0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.328+0000 7f75a4c00640 1 -- 172.21.15.6:0/2094168303 reap_dead start 2024-08-17T02:29:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.328+0000 7f75a6c00640 1 -- 172.21.15.6:0/2094168303 shutdown_connections 2024-08-17T02:29:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.328+0000 7f75a6c00640 1 -- 172.21.15.6:0/2094168303 >> 172.21.15.6:0/2094168303 conn(0x7f75a0066e60 msgr2=0x7f75a0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.328+0000 7f75a6c00640 1 -- 172.21.15.6:0/2094168303 shutdown_connections 2024-08-17T02:29:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.328+0000 7f75a6c00640 1 -- 172.21.15.6:0/2094168303 wait complete. 2024-08-17T02:29:58.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.329+0000 7f75a6c00640 1 Processor -- start 2024-08-17T02:29:58.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.329+0000 7f75a6c00640 1 -- start start 2024-08-17T02:29:58.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.330+0000 7f75a6c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75840039d0 0x7f75a0167750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.330+0000 7f75a6c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a016a2d0 0x7f75a01587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.330+0000 7f75a6c00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75a0158cf0 0x7f75a01520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.330+0000 7f75a6c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00a4700 con 0x7f75a016a2d0 2024-08-17T02:29:58.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.330+0000 7f75a6c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a016a700 con 0x7f75840039d0 2024-08-17T02:29:58.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.330+0000 7f75a6c00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a016a9b0 con 0x7f75a0158cf0 2024-08-17T02:29:58.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.330+0000 7f7597e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a016a2d0 0x7f75a01587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.330+0000 7f7597e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a016a2d0 0x7f75a01587b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51896/0 (socket says 172.21.15.6:51896) 2024-08-17T02:29:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.330+0000 7f7597e00640 1 -- 172.21.15.6:0/3006275360 learned_addr learned my addr 172.21.15.6:0/3006275360 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.331+0000 7f75a4c00640 1 --2- 172.21.15.6:0/3006275360 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75a0158cf0 0x7f75a01520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.331+0000 7f759fe00640 1 --2- 172.21.15.6:0/3006275360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75840039d0 0x7f75a0167750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.331+0000 7f7597e00640 1 -- 172.21.15.6:0/3006275360 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75a0158cf0 msgr2=0x7f75a01520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.331+0000 7f7597e00640 1 --2- 172.21.15.6:0/3006275360 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75a0158cf0 0x7f75a01520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.331+0000 7f7597e00640 1 -- 172.21.15.6:0/3006275360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75840039d0 msgr2=0x7f75a0167750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.331+0000 7f7597e00640 1 --2- 172.21.15.6:0/3006275360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75840039d0 0x7f75a0167750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.331+0000 7f7597e00640 1 -- 172.21.15.6:0/3006275360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a016ac90 con 0x7f75a016a2d0 2024-08-17T02:29:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.331+0000 7f759fe00640 1 --2- 172.21.15.6:0/3006275360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75840039d0 0x7f75a0167750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.331+0000 7f7597e00640 1 --2- 172.21.15.6:0/3006275360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a016a2d0 0x7f75a01587b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7588011b40 tx=0x7f75880090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.331+0000 7f7597400640 1 -- 172.21.15.6:0/3006275360 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758800fa80 con 0x7f75a016a2d0 2024-08-17T02:29:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.331+0000 7f7597400640 1 -- 172.21.15.6:0/3006275360 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758800fbe0 con 0x7f75a016a2d0 2024-08-17T02:29:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.331+0000 7f75a6c00640 1 -- 172.21.15.6:0/3006275360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a016af70 con 0x7f75a016a2d0 2024-08-17T02:29:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.331+0000 7f7597400640 1 -- 172.21.15.6:0/3006275360 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7588014440 con 0x7f75a016a2d0 2024-08-17T02:29:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.332+0000 7f75a6c00640 1 -- 172.21.15.6:0/3006275360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a0152810 con 0x7f75a016a2d0 2024-08-17T02:29:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.332+0000 7f75a6c00640 1 -- 172.21.15.6:0/3006275360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f75a0152a90 con 0x7f75a016a2d0 2024-08-17T02:29:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.333+0000 7f7597400640 1 -- 172.21.15.6:0/3006275360 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f75880147f0 con 0x7f75a016a2d0 2024-08-17T02:29:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.334+0000 7f7597400640 1 --2- 172.21.15.6:0/3006275360 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f757c065150 0x7f757c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.334+0000 7f7597400640 1 -- 172.21.15.6:0/3006275360 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7588018030 con 0x7f75a016a2d0 2024-08-17T02:29:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.334+0000 7f7597400640 1 --2- 172.21.15.6:0/3006275360 >> [v2:172.21.15.6:6808/36882,v1:172.21.15.6:6809/36882] conn(0x7f757c06b040 0x7f757c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.334+0000 7f7597400640 1 -- 172.21.15.6:0/3006275360 --> [v2:172.21.15.6:6808/36882,v1:172.21.15.6:6809/36882] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f757c06db00 con 0x7f757c06b040 2024-08-17T02:29:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.334+0000 7f7597400640 1 -- 172.21.15.6:0/3006275360 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7588087220 con 0x7f75a016a2d0 2024-08-17T02:29:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.335+0000 7f759fe00640 1 --2- 172.21.15.6:0/3006275360 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f757c065150 0x7f757c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.335+0000 7f75a4c00640 1 --2- 172.21.15.6:0/3006275360 >> [v2:172.21.15.6:6808/36882,v1:172.21.15.6:6809/36882] conn(0x7f757c06b040 0x7f757c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.335+0000 7f75a4c00640 1 --2- 172.21.15.6:0/3006275360 >> [v2:172.21.15.6:6808/36882,v1:172.21.15.6:6809/36882] conn(0x7f757c06b040 0x7f757c06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:58.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.335+0000 7f759fe00640 1 --2- 172.21.15.6:0/3006275360 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f757c065150 0x7f757c067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7590033000 tx=0x7f7590034000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:58.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.336+0000 7f7597400640 1 -- 172.21.15.6:0/3006275360 <== osd.1 v2:172.21.15.6:6808/36882 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f757c06db00 con 0x7f757c06b040 2024-08-17T02:29:58.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.349+0000 7f75a6c00640 1 -- 172.21.15.6:0/3006275360 --> [v2:172.21.15.6:6808/36882,v1:172.21.15.6:6809/36882] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f75a006a5e0 con 0x7f757c06b040 2024-08-17T02:29:58.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.349+0000 7f7597400640 1 -- 172.21.15.6:0/3006275360 <== osd.1 v2:172.21.15.6:6808/36882 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f75a006a5e0 con 0x7f757c06b040 2024-08-17T02:29:58.351 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-08-17T02:29:58.351 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:58.351 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-08-17T02:29:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.350+0000 7f75a6c00640 1 -- 172.21.15.6:0/3006275360 >> [v2:172.21.15.6:6808/36882,v1:172.21.15.6:6809/36882] conn(0x7f757c06b040 msgr2=0x7f757c06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.350+0000 7f75a6c00640 1 --2- 172.21.15.6:0/3006275360 >> [v2:172.21.15.6:6808/36882,v1:172.21.15.6:6809/36882] conn(0x7f757c06b040 0x7f757c06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.350+0000 7f75a6c00640 1 -- 172.21.15.6:0/3006275360 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f757c065150 msgr2=0x7f757c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.350+0000 7f75a6c00640 1 --2- 172.21.15.6:0/3006275360 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f757c065150 0x7f757c067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7590033000 tx=0x7f7590034000 comp rx=0 tx=0).stop 2024-08-17T02:29:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.350+0000 7f75a6c00640 1 -- 172.21.15.6:0/3006275360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a016a2d0 msgr2=0x7f75a01587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.350+0000 7f75a6c00640 1 --2- 172.21.15.6:0/3006275360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a016a2d0 0x7f75a01587b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7588011b40 tx=0x7f75880090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.350+0000 7f75a4c00640 1 -- 172.21.15.6:0/3006275360 reap_dead start 2024-08-17T02:29:58.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.350+0000 7f75a6c00640 1 -- 172.21.15.6:0/3006275360 shutdown_connections 2024-08-17T02:29:58.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.350+0000 7f75a6c00640 1 -- 172.21.15.6:0/3006275360 >> 172.21.15.6:0/3006275360 conn(0x7f75a0066e60 msgr2=0x7f75a0156050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:58.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.350+0000 7f75a6c00640 1 -- 172.21.15.6:0/3006275360 shutdown_connections 2024-08-17T02:29:58.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.350+0000 7f75a6c00640 1 -- 172.21.15.6:0/3006275360 wait complete. 2024-08-17T02:29:58.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:29:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.517+0000 7f49f6200640 1 Processor -- start 2024-08-17T02:29:58.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.517+0000 7f49f6200640 1 -- start start 2024-08-17T02:29:58.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.518+0000 7f49f6200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49f00aea20 0x7f49f00aee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.518+0000 7f49f6200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49f00ca8e0 0x7f49f00cad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.518+0000 7f49f6200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f00af370 con 0x7f49f0158b90 2024-08-17T02:29:58.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.518+0000 7f49f6200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f00afd20 con 0x7f49f00ca8e0 2024-08-17T02:29:58.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.518+0000 7f49f6200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00affe0 con 0x7f49f00aea20 2024-08-17T02:29:58.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.518+0000 7f49efe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49f00ca8e0 0x7f49f00cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.518+0000 7f49efe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49f00ca8e0 0x7f49f00cad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51908/0 (socket says 172.21.15.6:51908) 2024-08-17T02:29:58.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.518+0000 7f49efe00640 1 -- 172.21.15.6:0/1360866857 learned_addr learned my addr 172.21.15.6:0/1360866857 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:58.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.519+0000 7f49eea00640 1 --2- 172.21.15.6:0/1360866857 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49f00aea20 0x7f49f00aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.519+0000 7f49efe00640 1 -- 172.21.15.6:0/1360866857 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49f00aea20 msgr2=0x7f49f00aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:58.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.519+0000 7f49efe00640 1 --2- 172.21.15.6:0/1360866857 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49f00aea20 0x7f49f00aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.519+0000 7f49efe00640 1 -- 172.21.15.6:0/1360866857 >> v1:172.21.15.136:6789/0 conn(0x7f49f0158b90 legacy=0x7f49f00b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:58.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.519+0000 7f49efe00640 1 -- 172.21.15.6:0/1360866857 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f00b02c0 con 0x7f49f00ca8e0 2024-08-17T02:29:58.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.520+0000 7f49efe00640 1 --2- 172.21.15.6:0/1360866857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00ca8e0 0x7f49f00cad00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009f20 tx=0x7f49e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf90ab5a87843d0f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:58.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.520+0000 7f49ee000640 1 -- 172.21.15.6:0/1360866857 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8031400 con 0x7f49f00ca8e0 2024-08-17T02:29:58.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.520+0000 7f49ee000640 1 -- 172.21.15.6:0/1360866857 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e802d050 con 0x7f49f00ca8e0 2024-08-17T02:29:58.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.520+0000 7f49ee000640 1 -- 172.21.15.6:0/1360866857 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e80317d0 con 0x7f49f00ca8e0 2024-08-17T02:29:58.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.521+0000 7f49f6200640 1 -- 172.21.15.6:0/1360866857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00ca8e0 msgr2=0x7f49f00cad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.521+0000 7f49f6200640 1 --2- 172.21.15.6:0/1360866857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00ca8e0 0x7f49f00cad00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009f20 tx=0x7f49e8009840 comp rx=0 tx=0).stop 2024-08-17T02:29:58.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.521+0000 7f49f6200640 1 -- 172.21.15.6:0/1360866857 shutdown_connections 2024-08-17T02:29:58.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.521+0000 7f49f6200640 1 --2- 172.21.15.6:0/1360866857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00ca8e0 0x7f49f00cad00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.521+0000 7f49f6200640 1 --2- 172.21.15.6:0/1360866857 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49f00aea20 0x7f49f00aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.521+0000 7f49f6200640 1 -- 172.21.15.6:0/1360866857 >> 172.21.15.6:0/1360866857 conn(0x7f49f006e590 msgr2=0x7f49f006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:58.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.521+0000 7f49f6200640 1 -- 172.21.15.6:0/1360866857 shutdown_connections 2024-08-17T02:29:58.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.521+0000 7f49f6200640 1 -- 172.21.15.6:0/1360866857 wait complete. 2024-08-17T02:29:58.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.522+0000 7f49f6200640 1 Processor -- start 2024-08-17T02:29:58.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.522+0000 7f49f6200640 1 -- start start 2024-08-17T02:29:58.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.523+0000 7f49f6200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49f00aea20 0x7f49f00c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.523+0000 7f49f6200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00ca8e0 0x7f49f015bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.523+0000 7f49f6200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49f0158b90 0x7f49f015c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.523+0000 7f49f6200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f01595c0 con 0x7f49f00ca8e0 2024-08-17T02:29:58.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.523+0000 7f49f6200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00c8aa0 con 0x7f49f00aea20 2024-08-17T02:29:58.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.523+0000 7f49f6200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00c7e90 con 0x7f49f0158b90 2024-08-17T02:29:58.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.523+0000 7f49eea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00ca8e0 0x7f49f015bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.524+0000 7f49eea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00ca8e0 0x7f49f015bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51924/0 (socket says 172.21.15.6:51924) 2024-08-17T02:29:58.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.524+0000 7f49eea00640 1 -- 172.21.15.6:0/841757733 learned_addr learned my addr 172.21.15.6:0/841757733 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:58.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.524+0000 7f49ef400640 1 --2- 172.21.15.6:0/841757733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49f00aea20 0x7f49f00c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.524+0000 7f49efe00640 1 --2- 172.21.15.6:0/841757733 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49f0158b90 0x7f49f015c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.524+0000 7f49eea00640 1 -- 172.21.15.6:0/841757733 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49f0158b90 msgr2=0x7f49f015c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.524+0000 7f49eea00640 1 --2- 172.21.15.6:0/841757733 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49f0158b90 0x7f49f015c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.524+0000 7f49eea00640 1 -- 172.21.15.6:0/841757733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49f00aea20 msgr2=0x7f49f00c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.524+0000 7f49eea00640 1 --2- 172.21.15.6:0/841757733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49f00aea20 0x7f49f00c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.524+0000 7f49eea00640 1 -- 172.21.15.6:0/841757733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e8009ae0 con 0x7f49f00ca8e0 2024-08-17T02:29:58.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.524+0000 7f49efe00640 1 --2- 172.21.15.6:0/841757733 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49f0158b90 0x7f49f015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:58.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.524+0000 7f49eea00640 1 --2- 172.21.15.6:0/841757733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00ca8e0 0x7f49f015bc30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00d890 tx=0x7f49dc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:58.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.524+0000 7f49e6a00640 1 -- 172.21.15.6:0/841757733 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc00de20 con 0x7f49f00ca8e0 2024-08-17T02:29:58.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.525+0000 7f49e6a00640 1 -- 172.21.15.6:0/841757733 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc0098b0 con 0x7f49f00ca8e0 2024-08-17T02:29:58.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.525+0000 7f49e6a00640 1 -- 172.21.15.6:0/841757733 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc009c50 con 0x7f49f00ca8e0 2024-08-17T02:29:58.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.525+0000 7f49f6200640 1 -- 172.21.15.6:0/841757733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f00c8170 con 0x7f49f00ca8e0 2024-08-17T02:29:58.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.525+0000 7f49f6200640 1 -- 172.21.15.6:0/841757733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f00c8730 con 0x7f49f00ca8e0 2024-08-17T02:29:58.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.526+0000 7f49f6200640 1 -- 172.21.15.6:0/841757733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f0063fb0 con 0x7f49f00ca8e0 2024-08-17T02:29:58.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.527+0000 7f49e6a00640 1 -- 172.21.15.6:0/841757733 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f49dc014620 con 0x7f49f00ca8e0 2024-08-17T02:29:58.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.527+0000 7f49e6a00640 1 --2- 172.21.15.6:0/841757733 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f49d0065150 0x7f49d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.527+0000 7f49e6a00640 1 -- 172.21.15.6:0/841757733 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f49dc0829f0 con 0x7f49f00ca8e0 2024-08-17T02:29:58.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.528+0000 7f49ef400640 1 --2- 172.21.15.6:0/841757733 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f49d0065150 0x7f49d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.529+0000 7f49ef400640 1 --2- 172.21.15.6:0/841757733 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f49d0065150 0x7f49d0067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f49e0007fd0 tx=0x7f49e0007e10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:58.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.531+0000 7f49e6a00640 1 -- 172.21.15.6:0/841757733 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f49dc050cb0 con 0x7f49f00ca8e0 2024-08-17T02:29:58.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.712+0000 7f49f6200640 1 -- 172.21.15.6:0/841757733 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f49f00cc040 con 0x7f49d0065150 2024-08-17T02:29:58.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.713+0000 7f49e6a00640 1 -- 172.21.15.6:0/841757733 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f49f00cc040 con 0x7f49d0065150 2024-08-17T02:29:58.714 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:29:58.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.715+0000 7f49f6200640 1 -- 172.21.15.6:0/841757733 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f49d0065150 msgr2=0x7f49d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.715+0000 7f49f6200640 1 --2- 172.21.15.6:0/841757733 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f49d0065150 0x7f49d0067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f49e0007fd0 tx=0x7f49e0007e10 comp rx=0 tx=0).stop 2024-08-17T02:29:58.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.715+0000 7f49f6200640 1 -- 172.21.15.6:0/841757733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00ca8e0 msgr2=0x7f49f015bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.715+0000 7f49f6200640 1 --2- 172.21.15.6:0/841757733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00ca8e0 0x7f49f015bc30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00d890 tx=0x7f49dc008040 comp rx=0 tx=0).stop 2024-08-17T02:29:58.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.715+0000 7f49f6200640 1 -- 172.21.15.6:0/841757733 shutdown_connections 2024-08-17T02:29:58.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.716+0000 7f49f6200640 1 --2- 172.21.15.6:0/841757733 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f49d0065150 0x7f49d0067600 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.716+0000 7f49f6200640 1 --2- 172.21.15.6:0/841757733 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49f0158b90 0x7f49f015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.716+0000 7f49f6200640 1 --2- 172.21.15.6:0/841757733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00ca8e0 0x7f49f015bc30 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.716+0000 7f49f6200640 1 --2- 172.21.15.6:0/841757733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49f00aea20 0x7f49f00c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.716+0000 7f49f6200640 1 -- 172.21.15.6:0/841757733 >> 172.21.15.6:0/841757733 conn(0x7f49f006e590 msgr2=0x7f49f00cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:58.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.716+0000 7f49f6200640 1 -- 172.21.15.6:0/841757733 shutdown_connections 2024-08-17T02:29:58.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.716+0000 7f49f6200640 1 -- 172.21.15.6:0/841757733 wait complete. 2024-08-17T02:29:58.731 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:29:58.731 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:58.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.887+0000 7fbf97200640 1 Processor -- start 2024-08-17T02:29:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.887+0000 7fbf97200640 1 -- start start 2024-08-17T02:29:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.888+0000 7fbf97200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbf980af460 0x7fbf980af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.888+0000 7fbf97200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbf980afde0 0x7fbf980a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.888+0000 7fbf97200640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf980ad560 con 0x7fbf980cb680 2024-08-17T02:29:58.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.888+0000 7fbf97200640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf980ad820 con 0x7fbf980afde0 2024-08-17T02:29:58.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.888+0000 7fbf97200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf980adb00 con 0x7fbf980af460 2024-08-17T02:29:58.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.888+0000 7fbf96800640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbf980cb680 0x7fbf98159b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46368/0 (socket says 172.21.15.6:46368) 2024-08-17T02:29:58.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.888+0000 7fbf96800640 1 -- 172.21.15.6:0/1233180171 learned_addr learned my addr 172.21.15.6:0/1233180171 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:58.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.888+0000 7fbf8fe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbf980afde0 0x7fbf980a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.888+0000 7fbf95e00640 1 --2- 172.21.15.6:0/1233180171 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbf980af460 0x7fbf980af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.889+0000 7fbf8fe00640 1 -- 172.21.15.6:0/1233180171 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbf980af460 msgr2=0x7fbf980af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.889+0000 7fbf8fe00640 1 --2- 172.21.15.6:0/1233180171 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbf980af460 0x7fbf980af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.889+0000 7fbf8fe00640 1 -- 172.21.15.6:0/1233180171 >> v1:172.21.15.6:6789/0 conn(0x7fbf980cb680 legacy=0x7fbf98159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.889+0000 7fbf8fe00640 1 -- 172.21.15.6:0/1233180171 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf980adde0 con 0x7fbf980afde0 2024-08-17T02:29:58.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.889+0000 7fbf95400640 1 -- 172.21.15.6:0/1233180171 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242857842 0 0) 0x7fbf980ad560 con 0x7fbf980cb680 2024-08-17T02:29:58.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.890+0000 7fbf8fe00640 1 --2- 172.21.15.6:0/1233180171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf980afde0 0x7fbf980a7c20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009850 tx=0x7fbf800090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521be31981470cb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:58.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.890+0000 7fbf95400640 1 -- 172.21.15.6:0/1233180171 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8002ad00 con 0x7fbf980afde0 2024-08-17T02:29:58.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.890+0000 7fbf95400640 1 -- 172.21.15.6:0/1233180171 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8002ae60 con 0x7fbf980afde0 2024-08-17T02:29:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.890+0000 7fbf95400640 1 -- 172.21.15.6:0/1233180171 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80032670 con 0x7fbf980afde0 2024-08-17T02:29:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.890+0000 7fbf97200640 1 -- 172.21.15.6:0/1233180171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf980afde0 msgr2=0x7fbf980a7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.890+0000 7fbf97200640 1 --2- 172.21.15.6:0/1233180171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf980afde0 0x7fbf980a7c20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009850 tx=0x7fbf800090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.891+0000 7fbf97200640 1 -- 172.21.15.6:0/1233180171 shutdown_connections 2024-08-17T02:29:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.891+0000 7fbf97200640 1 --2- 172.21.15.6:0/1233180171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf980afde0 0x7fbf980a7c20 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.891+0000 7fbf97200640 1 --2- 172.21.15.6:0/1233180171 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbf980af460 0x7fbf980af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.891+0000 7fbf97200640 1 -- 172.21.15.6:0/1233180171 >> 172.21.15.6:0/1233180171 conn(0x7fbf98066e60 msgr2=0x7fbf98067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.891+0000 7fbf97200640 1 -- 172.21.15.6:0/1233180171 shutdown_connections 2024-08-17T02:29:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.891+0000 7fbf97200640 1 -- 172.21.15.6:0/1233180171 wait complete. 2024-08-17T02:29:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.892+0000 7fbf97200640 1 Processor -- start 2024-08-17T02:29:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.892+0000 7fbf97200640 1 -- start start 2024-08-17T02:29:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.893+0000 7fbf97200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf980af460 0x7fbf9816a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.893+0000 7fbf97200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbf980afde0 0x7fbf981440a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.893+0000 7fbf97200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf980cb680 0x7fbf9816bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.893+0000 7fbf97200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9816b6c0 con 0x7fbf980cb680 2024-08-17T02:29:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.893+0000 7fbf97200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9816a850 con 0x7fbf980af460 2024-08-17T02:29:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.893+0000 7fbf97200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf981445e0 con 0x7fbf980afde0 2024-08-17T02:29:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.893+0000 7fbf96800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf980cb680 0x7fbf9816bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.893+0000 7fbf96800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf980cb680 0x7fbf9816bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51940/0 (socket says 172.21.15.6:51940) 2024-08-17T02:29:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.893+0000 7fbf96800640 1 -- 172.21.15.6:0/2408022017 learned_addr learned my addr 172.21.15.6:0/2408022017 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.893+0000 7fbf8fe00640 1 --2- 172.21.15.6:0/2408022017 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbf980afde0 0x7fbf981440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.893+0000 7fbf95e00640 1 --2- 172.21.15.6:0/2408022017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf980af460 0x7fbf9816a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.894+0000 7fbf96800640 1 -- 172.21.15.6:0/2408022017 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbf980afde0 msgr2=0x7fbf981440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.894+0000 7fbf96800640 1 --2- 172.21.15.6:0/2408022017 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbf980afde0 0x7fbf981440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.894+0000 7fbf96800640 1 -- 172.21.15.6:0/2408022017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf980af460 msgr2=0x7fbf9816a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.894+0000 7fbf96800640 1 --2- 172.21.15.6:0/2408022017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf980af460 0x7fbf9816a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.894+0000 7fbf96800640 1 -- 172.21.15.6:0/2408022017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf80009390 con 0x7fbf980cb680 2024-08-17T02:29:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.894+0000 7fbf96800640 1 --2- 172.21.15.6:0/2408022017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf980cb680 0x7fbf9816bb50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000cc90 tx=0x7fbf90001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.894+0000 7fbf8d600640 1 -- 172.21.15.6:0/2408022017 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9000a850 con 0x7fbf980cb680 2024-08-17T02:29:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.894+0000 7fbf8d600640 1 -- 172.21.15.6:0/2408022017 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9000a9b0 con 0x7fbf980cb680 2024-08-17T02:29:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.894+0000 7fbf8d600640 1 -- 172.21.15.6:0/2408022017 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9000ad70 con 0x7fbf980cb680 2024-08-17T02:29:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.894+0000 7fbf97200640 1 -- 172.21.15.6:0/2408022017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9816aab0 con 0x7fbf980cb680 2024-08-17T02:29:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.894+0000 7fbf97200640 1 -- 172.21.15.6:0/2408022017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9816b070 con 0x7fbf980cb680 2024-08-17T02:29:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.895+0000 7fbf97200640 1 -- 172.21.15.6:0/2408022017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbf98063f10 con 0x7fbf980cb680 2024-08-17T02:29:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.896+0000 7fbf8d600640 1 -- 172.21.15.6:0/2408022017 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbf90007300 con 0x7fbf980cb680 2024-08-17T02:29:58.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.897+0000 7fbf8d600640 1 --2- 172.21.15.6:0/2408022017 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbf74065150 0x7fbf74067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.897+0000 7fbf8d600640 1 -- 172.21.15.6:0/2408022017 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fbf90082290 con 0x7fbf980cb680 2024-08-17T02:29:58.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.897+0000 7fbf8d600640 1 --2- 172.21.15.6:0/2408022017 >> [v2:172.21.15.6:6816/36884,v1:172.21.15.6:6817/36884] conn(0x7fbf7406b040 0x7fbf7406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.897+0000 7fbf8d600640 1 -- 172.21.15.6:0/2408022017 --> [v2:172.21.15.6:6816/36884,v1:172.21.15.6:6817/36884] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf7406db00 con 0x7fbf7406b040 2024-08-17T02:29:58.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.897+0000 7fbf8d600640 1 -- 172.21.15.6:0/2408022017 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf90084790 con 0x7fbf980cb680 2024-08-17T02:29:58.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.898+0000 7fbf8fe00640 1 --2- 172.21.15.6:0/2408022017 >> [v2:172.21.15.6:6816/36884,v1:172.21.15.6:6817/36884] conn(0x7fbf7406b040 0x7fbf7406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.898+0000 7fbf95e00640 1 --2- 172.21.15.6:0/2408022017 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbf74065150 0x7fbf74067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.898+0000 7fbf8fe00640 1 --2- 172.21.15.6:0/2408022017 >> [v2:172.21.15.6:6816/36884,v1:172.21.15.6:6817/36884] conn(0x7fbf7406b040 0x7fbf7406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:58.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.898+0000 7fbf95e00640 1 --2- 172.21.15.6:0/2408022017 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbf74065150 0x7fbf74067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbf981556b0 tx=0x7fbf88008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:58.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.899+0000 7fbf8d600640 1 -- 172.21.15.6:0/2408022017 <== osd.2 v2:172.21.15.6:6816/36884 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fbf7406db00 con 0x7fbf7406b040 2024-08-17T02:29:58.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.912+0000 7fbf97200640 1 -- 172.21.15.6:0/2408022017 --> [v2:172.21.15.6:6816/36884,v1:172.21.15.6:6817/36884] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbf9816c090 con 0x7fbf7406b040 2024-08-17T02:29:58.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.912+0000 7fbf8d600640 1 -- 172.21.15.6:0/2408022017 <== osd.2 v2:172.21.15.6:6816/36884 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbf9816c090 con 0x7fbf7406b040 2024-08-17T02:29:58.913 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-08-17T02:29:58.913 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:58.914 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-08-17T02:29:58.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.913+0000 7fbf97200640 1 -- 172.21.15.6:0/2408022017 >> [v2:172.21.15.6:6816/36884,v1:172.21.15.6:6817/36884] conn(0x7fbf7406b040 msgr2=0x7fbf7406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.913+0000 7fbf97200640 1 --2- 172.21.15.6:0/2408022017 >> [v2:172.21.15.6:6816/36884,v1:172.21.15.6:6817/36884] conn(0x7fbf7406b040 0x7fbf7406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.913+0000 7fbf97200640 1 -- 172.21.15.6:0/2408022017 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbf74065150 msgr2=0x7fbf74067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.913+0000 7fbf97200640 1 --2- 172.21.15.6:0/2408022017 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fbf74065150 0x7fbf74067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbf981556b0 tx=0x7fbf88008040 comp rx=0 tx=0).stop 2024-08-17T02:29:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.913+0000 7fbf97200640 1 -- 172.21.15.6:0/2408022017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf980cb680 msgr2=0x7fbf9816bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.913+0000 7fbf97200640 1 --2- 172.21.15.6:0/2408022017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf980cb680 0x7fbf9816bb50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000cc90 tx=0x7fbf90001a80 comp rx=0 tx=0).stop 2024-08-17T02:29:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.913+0000 7fbf96800640 1 -- 172.21.15.6:0/2408022017 reap_dead start 2024-08-17T02:29:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.913+0000 7fbf97200640 1 -- 172.21.15.6:0/2408022017 shutdown_connections 2024-08-17T02:29:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.913+0000 7fbf97200640 1 -- 172.21.15.6:0/2408022017 >> 172.21.15.6:0/2408022017 conn(0x7fbf98066e60 msgr2=0x7fbf980cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.913+0000 7fbf97200640 1 -- 172.21.15.6:0/2408022017 shutdown_connections 2024-08-17T02:29:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:58.913+0000 7fbf97200640 1 -- 172.21.15.6:0/2408022017 wait complete. 2024-08-17T02:29:58.928 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:29:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.079+0000 7f7ce7600640 1 Processor -- start 2024-08-17T02:29:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.079+0000 7f7ce7600640 1 -- start start 2024-08-17T02:29:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.080+0000 7f7ce7600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ce00ac000 0x7f7ce0163ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.080+0000 7f7ce7600640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce00a96c0 con 0x7f7ce0159120 2024-08-17T02:29:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.080+0000 7f7ce7600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce00acf00 con 0x7f7ce0158d50 2024-08-17T02:29:59.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.080+0000 7f7ce7600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce00af7d0 con 0x7f7ce00ac000 2024-08-17T02:29:59.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.081+0000 7f7cdfe00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7ce0159120 0x7f7ce00ab8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46370/0 (socket says 172.21.15.6:46370) 2024-08-17T02:29:59.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.081+0000 7f7cdfe00640 1 -- 172.21.15.6:0/2776216098 learned_addr learned my addr 172.21.15.6:0/2776216098 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:59.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.081+0000 7f7ce5600640 1 --2- 172.21.15.6:0/2776216098 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ce00ac000 0x7f7ce0163ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.081+0000 7f7cdf400640 1 -- 172.21.15.6:0/2776216098 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443560069 0 0) 0x7f7ce00a96c0 con 0x7f7ce0159120 2024-08-17T02:29:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.081+0000 7f7cdf400640 1 -- 172.21.15.6:0/2776216098 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cc80034e0 con 0x7f7ce0159120 2024-08-17T02:29:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.081+0000 7f7ce5600640 1 -- 172.21.15.6:0/2776216098 >> v1:172.21.15.136:6789/0 conn(0x7f7ce0158d50 legacy=0x7f7ce00ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.081+0000 7f7ce5600640 1 -- 172.21.15.6:0/2776216098 >> v1:172.21.15.6:6789/0 conn(0x7f7ce0159120 legacy=0x7f7ce00ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.081+0000 7f7ce5600640 1 -- 172.21.15.6:0/2776216098 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce00a98f0 con 0x7f7ce00ac000 2024-08-17T02:29:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.082+0000 7f7ce5600640 1 --2- 172.21.15.6:0/2776216098 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ce00ac000 0x7f7ce0163ab0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009e90 tx=0x7f7cd8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd96d131baa8823d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.083+0000 7f7cdf400640 1 -- 172.21.15.6:0/2776216098 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8007550 con 0x7f7ce00ac000 2024-08-17T02:29:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.083+0000 7f7cdf400640 1 -- 172.21.15.6:0/2776216098 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd802d050 con 0x7f7ce00ac000 2024-08-17T02:29:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.083+0000 7f7cdf400640 1 -- 172.21.15.6:0/2776216098 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd80078e0 con 0x7f7ce00ac000 2024-08-17T02:29:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.083+0000 7f7ce7600640 1 -- 172.21.15.6:0/2776216098 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ce00ac000 msgr2=0x7f7ce0163ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.083+0000 7f7ce7600640 1 --2- 172.21.15.6:0/2776216098 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ce00ac000 0x7f7ce0163ab0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009e90 tx=0x7f7cd8009780 comp rx=0 tx=0).stop 2024-08-17T02:29:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.083+0000 7f7ce7600640 1 -- 172.21.15.6:0/2776216098 shutdown_connections 2024-08-17T02:29:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.083+0000 7f7ce7600640 1 --2- 172.21.15.6:0/2776216098 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ce00ac000 0x7f7ce0163ab0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.083+0000 7f7ce7600640 1 -- 172.21.15.6:0/2776216098 >> 172.21.15.6:0/2776216098 conn(0x7f7ce0095a70 msgr2=0x7f7ce0095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.083+0000 7f7ce7600640 1 -- 172.21.15.6:0/2776216098 shutdown_connections 2024-08-17T02:29:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.083+0000 7f7ce7600640 1 -- 172.21.15.6:0/2776216098 wait complete. 2024-08-17T02:29:59.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.085+0000 7f7ce7600640 1 Processor -- start 2024-08-17T02:29:59.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.085+0000 7f7ce7600640 1 -- start start 2024-08-17T02:29:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.086+0000 7f7ce7600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ce00ac000 0x7f7ce0152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.086+0000 7f7ce7600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ce0158d50 0x7f7ce0156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.086+0000 7f7ce7600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ce0159120 0x7f7ce0096bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.086+0000 7f7ce7600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce0156440 con 0x7f7ce0159120 2024-08-17T02:29:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.086+0000 7f7ce7600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce0155ba0 con 0x7f7ce0158d50 2024-08-17T02:29:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.086+0000 7f7ce7600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce0155e80 con 0x7f7ce00ac000 2024-08-17T02:29:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.086+0000 7f7ce5600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ce0159120 0x7f7ce0096bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.086+0000 7f7ce5600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ce0159120 0x7f7ce0096bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51950/0 (socket says 172.21.15.6:51950) 2024-08-17T02:29:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.086+0000 7f7ce5600640 1 -- 172.21.15.6:0/4081656452 learned_addr learned my addr 172.21.15.6:0/4081656452 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.086+0000 7f7ce4c00640 1 --2- 172.21.15.6:0/4081656452 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ce00ac000 0x7f7ce0152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.086+0000 7f7cdfe00640 1 --2- 172.21.15.6:0/4081656452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ce0158d50 0x7f7ce0156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.086+0000 7f7ce5600640 1 -- 172.21.15.6:0/4081656452 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ce00ac000 msgr2=0x7f7ce0152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.086+0000 7f7ce5600640 1 --2- 172.21.15.6:0/4081656452 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ce00ac000 0x7f7ce0152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.087+0000 7f7ce5600640 1 -- 172.21.15.6:0/4081656452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ce0158d50 msgr2=0x7f7ce0156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.087+0000 7f7ce5600640 1 --2- 172.21.15.6:0/4081656452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ce0158d50 0x7f7ce0156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.087+0000 7f7ce5600640 1 -- 172.21.15.6:0/4081656452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd8009a20 con 0x7f7ce0159120 2024-08-17T02:29:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.087+0000 7f7ce5600640 1 --2- 172.21.15.6:0/4081656452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ce0159120 0x7f7ce0096bf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009de0 tx=0x7f7cd8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:59.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.087+0000 7f7cd3e00640 1 -- 172.21.15.6:0/4081656452 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8031890 con 0x7f7ce0159120 2024-08-17T02:29:59.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.087+0000 7f7cd3e00640 1 -- 172.21.15.6:0/4081656452 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd8040070 con 0x7f7ce0159120 2024-08-17T02:29:59.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.087+0000 7f7cd3e00640 1 -- 172.21.15.6:0/4081656452 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8031c40 con 0x7f7ce0159120 2024-08-17T02:29:59.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.087+0000 7f7ce7600640 1 -- 172.21.15.6:0/4081656452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce0156160 con 0x7f7ce0159120 2024-08-17T02:29:59.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.087+0000 7f7ce7600640 1 -- 172.21.15.6:0/4081656452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce0157050 con 0x7f7ce0159120 2024-08-17T02:29:59.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.088+0000 7f7ce7600640 1 -- 172.21.15.6:0/4081656452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce015a710 con 0x7f7ce0159120 2024-08-17T02:29:59.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.089+0000 7f7cd3e00640 1 -- 172.21.15.6:0/4081656452 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7cd8042030 con 0x7f7ce0159120 2024-08-17T02:29:59.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.090+0000 7f7cd3e00640 1 --2- 172.21.15.6:0/4081656452 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7cc0065150 0x7f7cc0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.090+0000 7f7cd3e00640 1 -- 172.21.15.6:0/4081656452 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7cd80a3ab0 con 0x7f7ce0159120 2024-08-17T02:29:59.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.090+0000 7f7ce4c00640 1 --2- 172.21.15.6:0/4081656452 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7cc0065150 0x7f7cc0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.091+0000 7f7ce4c00640 1 --2- 172.21.15.6:0/4081656452 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7cc0065150 0x7f7cc0067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40037c0 tx=0x7f7cd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:59.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.094+0000 7f7cd3e00640 1 -- 172.21.15.6:0/4081656452 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7ce015a710 con 0x7f7ce0159120 2024-08-17T02:29:59.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.275+0000 7f7ce7600640 1 -- 172.21.15.6:0/4081656452 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ce015a710 con 0x7f7cc0065150 2024-08-17T02:29:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.275+0000 7f7cd3e00640 1 -- 172.21.15.6:0/4081656452 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7ce015a710 con 0x7f7cc0065150 2024-08-17T02:29:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:29:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.277+0000 7f7ce7600640 1 -- 172.21.15.6:0/4081656452 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7cc0065150 msgr2=0x7f7cc0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.277+0000 7f7ce7600640 1 --2- 172.21.15.6:0/4081656452 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7cc0065150 0x7f7cc0067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40037c0 tx=0x7f7cd4009040 comp rx=0 tx=0).stop 2024-08-17T02:29:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.277+0000 7f7ce7600640 1 -- 172.21.15.6:0/4081656452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ce0159120 msgr2=0x7f7ce0096bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.277+0000 7f7ce7600640 1 --2- 172.21.15.6:0/4081656452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ce0159120 0x7f7ce0096bf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009de0 tx=0x7f7cd8037000 comp rx=0 tx=0).stop 2024-08-17T02:29:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.277+0000 7f7ce7600640 1 -- 172.21.15.6:0/4081656452 shutdown_connections 2024-08-17T02:29:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.277+0000 7f7ce7600640 1 --2- 172.21.15.6:0/4081656452 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f7cc0065150 0x7f7cc0067600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.277+0000 7f7ce7600640 1 --2- 172.21.15.6:0/4081656452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ce0159120 0x7f7ce0096bf0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.277+0000 7f7ce7600640 1 --2- 172.21.15.6:0/4081656452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ce0158d50 0x7f7ce0156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.277+0000 7f7ce7600640 1 --2- 172.21.15.6:0/4081656452 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ce00ac000 0x7f7ce0152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.277+0000 7f7ce7600640 1 -- 172.21.15.6:0/4081656452 >> 172.21.15.6:0/4081656452 conn(0x7f7ce0095a70 msgr2=0x7f7ce0153340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:59.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.278+0000 7f7ce7600640 1 -- 172.21.15.6:0/4081656452 shutdown_connections 2024-08-17T02:29:59.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.278+0000 7f7ce7600640 1 -- 172.21.15.6:0/4081656452 wait complete. 2024-08-17T02:29:59.293 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:29:59.293 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:59.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.449+0000 7f67c7e00640 1 Processor -- start 2024-08-17T02:29:59.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.450+0000 7f67c7e00640 1 -- start start 2024-08-17T02:29:59.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.451+0000 7f67c7e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f67c8068590 0x7f67c8068a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.451+0000 7f67c7e00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c80b5b20 con 0x7f67c81588d0 2024-08-17T02:29:59.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.451+0000 7f67c7e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c815b400 con 0x7f67c815a2e0 2024-08-17T02:29:59.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.451+0000 7f67c7e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c8068f70 con 0x7f67c8068590 2024-08-17T02:29:59.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.451+0000 7f67c6a00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f67c81588d0 0x7f67c8156d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46372/0 (socket says 172.21.15.6:46372) 2024-08-17T02:29:59.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.451+0000 7f67c6a00640 1 -- 172.21.15.6:0/1453235063 learned_addr learned my addr 172.21.15.6:0/1453235063 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:59.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.451+0000 7f67c7400640 1 --2- 172.21.15.6:0/1453235063 >> v2:172.21.15.136:3300/0 conn(0x7f67c8068590 0x7f67c8068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.452+0000 7f67c6000640 1 -- 172.21.15.6:0/1453235063 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368626579 0 0) 0x7f67c80b5b20 con 0x7f67c81588d0 2024-08-17T02:29:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.452+0000 7f67c6000640 1 -- 172.21.15.6:0/1453235063 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67ac0034e0 con 0x7f67c81588d0 2024-08-17T02:29:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.452+0000 7f67c7400640 1 -- 172.21.15.6:0/1453235063 >> v1:172.21.15.136:6789/0 conn(0x7f67c815a2e0 legacy=0x7f67c8158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.452+0000 7f67c6000640 1 -- 172.21.15.6:0/1453235063 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282280574 0 0) 0x7f67c815b400 con 0x7f67c815a2e0 2024-08-17T02:29:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.452+0000 7f67c7400640 1 -- 172.21.15.6:0/1453235063 >> v1:172.21.15.6:6789/0 conn(0x7f67c81588d0 legacy=0x7f67c8156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.452+0000 7f67c7400640 1 -- 172.21.15.6:0/1453235063 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c815a7f0 con 0x7f67c8068590 2024-08-17T02:29:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.453+0000 7f67c7400640 1 --2- 172.21.15.6:0/1453235063 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67c8068590 0x7f67c8068a30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f67c0009e60 tx=0x7f67c0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=696f27705b51ac6a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.453+0000 7f67c6000640 1 -- 172.21.15.6:0/1453235063 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c0007550 con 0x7f67c8068590 2024-08-17T02:29:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.453+0000 7f67c6000640 1 -- 172.21.15.6:0/1453235063 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c002d050 con 0x7f67c8068590 2024-08-17T02:29:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.453+0000 7f67c6000640 1 -- 172.21.15.6:0/1453235063 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c0007900 con 0x7f67c8068590 2024-08-17T02:29:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.454+0000 7f67c7e00640 1 -- 172.21.15.6:0/1453235063 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67c8068590 msgr2=0x7f67c8068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.454+0000 7f67c7e00640 1 --2- 172.21.15.6:0/1453235063 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67c8068590 0x7f67c8068a30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f67c0009e60 tx=0x7f67c0009780 comp rx=0 tx=0).stop 2024-08-17T02:29:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.454+0000 7f67c7e00640 1 -- 172.21.15.6:0/1453235063 shutdown_connections 2024-08-17T02:29:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.454+0000 7f67c7e00640 1 --2- 172.21.15.6:0/1453235063 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67c8068590 0x7f67c8068a30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.454+0000 7f67c7e00640 1 -- 172.21.15.6:0/1453235063 >> 172.21.15.6:0/1453235063 conn(0x7f67c8087a70 msgr2=0x7f67c806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.454+0000 7f67c7e00640 1 -- 172.21.15.6:0/1453235063 shutdown_connections 2024-08-17T02:29:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.454+0000 7f67c7e00640 1 -- 172.21.15.6:0/1453235063 wait complete. 2024-08-17T02:29:59.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.455+0000 7f67c7e00640 1 Processor -- start 2024-08-17T02:29:59.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.456+0000 7f67c7e00640 1 -- start start 2024-08-17T02:29:59.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.456+0000 7f67c7e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f67c8068590 0x7f67c81464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.456+0000 7f67c7e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67c81588d0 0x7f67c80c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.456+0000 7f67c7e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c815a2e0 0x7f67c80c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.456+0000 7f67c7e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c80ca070 con 0x7f67c815a2e0 2024-08-17T02:29:59.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.456+0000 7f67c7e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c80ca350 con 0x7f67c81588d0 2024-08-17T02:29:59.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.456+0000 7f67c7e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c80ca630 con 0x7f67c8068590 2024-08-17T02:29:59.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.457+0000 7f67c7400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c815a2e0 0x7f67c80c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.457+0000 7f67c7400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c815a2e0 0x7f67c80c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51966/0 (socket says 172.21.15.6:51966) 2024-08-17T02:29:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.457+0000 7f67c7400640 1 -- 172.21.15.6:0/3107797939 learned_addr learned my addr 172.21.15.6:0/3107797939 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.457+0000 7f67bfe00640 1 --2- 172.21.15.6:0/3107797939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67c81588d0 0x7f67c80c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.457+0000 7f67c6a00640 1 --2- 172.21.15.6:0/3107797939 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f67c8068590 0x7f67c81464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.457+0000 7f67c7400640 1 -- 172.21.15.6:0/3107797939 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f67c8068590 msgr2=0x7f67c81464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.457+0000 7f67c7400640 1 --2- 172.21.15.6:0/3107797939 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f67c8068590 0x7f67c81464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.457+0000 7f67c7400640 1 -- 172.21.15.6:0/3107797939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67c81588d0 msgr2=0x7f67c80c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.457+0000 7f67c7400640 1 --2- 172.21.15.6:0/3107797939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67c81588d0 0x7f67c80c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.457+0000 7f67c7400640 1 -- 172.21.15.6:0/3107797939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c0009a20 con 0x7f67c815a2e0 2024-08-17T02:29:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.457+0000 7f67c7400640 1 --2- 172.21.15.6:0/3107797939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c815a2e0 0x7f67c80c75e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f67c0009e60 tx=0x7f67c0037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.458+0000 7f67be000640 1 -- 172.21.15.6:0/3107797939 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c0031b90 con 0x7f67c815a2e0 2024-08-17T02:29:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.458+0000 7f67be000640 1 -- 172.21.15.6:0/3107797939 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c0031cf0 con 0x7f67c815a2e0 2024-08-17T02:29:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.458+0000 7f67c7e00640 1 -- 172.21.15.6:0/3107797939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c80ca910 con 0x7f67c815a2e0 2024-08-17T02:29:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.458+0000 7f67be000640 1 -- 172.21.15.6:0/3107797939 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c003d640 con 0x7f67c815a2e0 2024-08-17T02:29:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.458+0000 7f67c7e00640 1 -- 172.21.15.6:0/3107797939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c80cb110 con 0x7f67c815a2e0 2024-08-17T02:29:59.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.459+0000 7f67c7e00640 1 -- 172.21.15.6:0/3107797939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f67c8063f10 con 0x7f67c815a2e0 2024-08-17T02:29:59.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.460+0000 7f67be000640 1 -- 172.21.15.6:0/3107797939 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f67c0003040 con 0x7f67c815a2e0 2024-08-17T02:29:59.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.461+0000 7f67be000640 1 --2- 172.21.15.6:0/3107797939 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f67a4065150 0x7f67a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.461+0000 7f67be000640 1 -- 172.21.15.6:0/3107797939 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f67c00a3d50 con 0x7f67c815a2e0 2024-08-17T02:29:59.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.461+0000 7f67be000640 1 --2- 172.21.15.6:0/3107797939 >> [v2:172.21.15.6:6800/36883,v1:172.21.15.6:6801/36883] conn(0x7f67a406b040 0x7f67a406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.461+0000 7f67be000640 1 -- 172.21.15.6:0/3107797939 --> [v2:172.21.15.6:6800/36883,v1:172.21.15.6:6801/36883] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f67a406db00 con 0x7f67a406b040 2024-08-17T02:29:59.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.461+0000 7f67be000640 1 -- 172.21.15.6:0/3107797939 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67c00a62b0 con 0x7f67c815a2e0 2024-08-17T02:29:59.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.461+0000 7f67c6a00640 1 --2- 172.21.15.6:0/3107797939 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f67a4065150 0x7f67a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.461+0000 7f67bfe00640 1 --2- 172.21.15.6:0/3107797939 >> [v2:172.21.15.6:6800/36883,v1:172.21.15.6:6801/36883] conn(0x7f67a406b040 0x7f67a406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.462+0000 7f67bfe00640 1 --2- 172.21.15.6:0/3107797939 >> [v2:172.21.15.6:6800/36883,v1:172.21.15.6:6801/36883] conn(0x7f67a406b040 0x7f67a406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:59.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.462+0000 7f67c6a00640 1 --2- 172.21.15.6:0/3107797939 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f67a4065150 0x7f67a4067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f67b8005840 tx=0x7f67b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:59.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.462+0000 7f67be000640 1 -- 172.21.15.6:0/3107797939 <== osd.3 v2:172.21.15.6:6800/36883 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f67a406db00 con 0x7f67a406b040 2024-08-17T02:29:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.475+0000 7f67c7e00640 1 -- 172.21.15.6:0/3107797939 --> [v2:172.21.15.6:6800/36883,v1:172.21.15.6:6801/36883] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f67c8088740 con 0x7f67a406b040 2024-08-17T02:29:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.475+0000 7f67be000640 1 -- 172.21.15.6:0/3107797939 <== osd.3 v2:172.21.15.6:6800/36883 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f67c8088740 con 0x7f67a406b040 2024-08-17T02:29:59.476 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-08-17T02:29:59.477 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:59.477 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-08-17T02:29:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.476+0000 7f67c7e00640 1 -- 172.21.15.6:0/3107797939 >> [v2:172.21.15.6:6800/36883,v1:172.21.15.6:6801/36883] conn(0x7f67a406b040 msgr2=0x7f67a406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.476+0000 7f67c7e00640 1 --2- 172.21.15.6:0/3107797939 >> [v2:172.21.15.6:6800/36883,v1:172.21.15.6:6801/36883] conn(0x7f67a406b040 0x7f67a406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.476+0000 7f67c7e00640 1 -- 172.21.15.6:0/3107797939 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f67a4065150 msgr2=0x7f67a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.476+0000 7f67c7e00640 1 --2- 172.21.15.6:0/3107797939 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f67a4065150 0x7f67a4067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f67b8005840 tx=0x7f67b8009040 comp rx=0 tx=0).stop 2024-08-17T02:29:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.476+0000 7f67c7e00640 1 -- 172.21.15.6:0/3107797939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c815a2e0 msgr2=0x7f67c80c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.476+0000 7f67c7e00640 1 --2- 172.21.15.6:0/3107797939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c815a2e0 0x7f67c80c75e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f67c0009e60 tx=0x7f67c0037000 comp rx=0 tx=0).stop 2024-08-17T02:29:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.476+0000 7f67c7400640 1 -- 172.21.15.6:0/3107797939 reap_dead start 2024-08-17T02:29:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.476+0000 7f67c7e00640 1 -- 172.21.15.6:0/3107797939 shutdown_connections 2024-08-17T02:29:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.476+0000 7f67c7e00640 1 -- 172.21.15.6:0/3107797939 >> 172.21.15.6:0/3107797939 conn(0x7f67c8087a70 msgr2=0x7f67c806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.476+0000 7f67c7e00640 1 -- 172.21.15.6:0/3107797939 shutdown_connections 2024-08-17T02:29:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.476+0000 7f67c7e00640 1 -- 172.21.15.6:0/3107797939 wait complete. 2024-08-17T02:29:59.491 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:29:59.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.643+0000 7f55fde00640 1 Processor -- start 2024-08-17T02:29:59.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.643+0000 7f55fde00640 1 -- start start 2024-08-17T02:29:59.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.644+0000 7f55fde00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55f80ad960 0x7f55f815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.645+0000 7f55fde00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f55f80add30 0x7f55f8156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.645+0000 7f55fde00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f815b5e0 con 0x7f55f80ca050 2024-08-17T02:29:59.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.645+0000 7f55fde00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f80cb160 con 0x7f55f80add30 2024-08-17T02:29:59.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.645+0000 7f55fde00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f80b0d10 con 0x7f55f80ad960 2024-08-17T02:29:59.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.645+0000 7f55f6a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55f80ad960 0x7f55f815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.645+0000 7f55f7400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f55f80add30 0x7f55f8156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.645+0000 7f55efe00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f55f80ca050 0x7f55f8156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:37748/0 (socket says 172.21.15.6:37748) 2024-08-17T02:29:59.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.645+0000 7f55f6a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55f80ad960 0x7f55f815b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:39570/0 (socket says 172.21.15.6:39570) 2024-08-17T02:29:59.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.645+0000 7f55efe00640 1 -- 172.21.15.6:0/1034232559 learned_addr learned my addr 172.21.15.6:0/1034232559 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:29:59.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.646+0000 7f55f6a00640 1 -- 172.21.15.6:0/1034232559 >> v2:172.21.15.136:3300/0 conn(0x7f55f80add30 msgr2=0x7f55f8156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.646+0000 7f55f6a00640 1 --2- 172.21.15.6:0/1034232559 >> v2:172.21.15.136:3300/0 conn(0x7f55f80add30 0x7f55f8156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.646+0000 7f55f6a00640 1 -- 172.21.15.6:0/1034232559 >> v1:172.21.15.136:6789/0 conn(0x7f55f80ca050 legacy=0x7f55f8156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.646+0000 7f55f6000640 1 -- 172.21.15.6:0/1034232559 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995191053 0 0) 0x7f55e0001110 con 0x7f55f80ca050 2024-08-17T02:29:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.646+0000 7f55f6a00640 1 -- 172.21.15.6:0/1034232559 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f80ca550 con 0x7f55f80ad960 2024-08-17T02:29:59.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.647+0000 7f55f6a00640 1 --2- 172.21.15.6:0/1034232559 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55f80ad960 0x7f55f815b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009850 tx=0x7f55e80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e401a10f3de6f759 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:59.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.647+0000 7f55f6000640 1 -- 172.21.15.6:0/1034232559 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e802ae20 con 0x7f55f80ad960 2024-08-17T02:29:59.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.647+0000 7f55f6000640 1 -- 172.21.15.6:0/1034232559 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e8032440 con 0x7f55f80ad960 2024-08-17T02:29:59.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.647+0000 7f55f6000640 1 -- 172.21.15.6:0/1034232559 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e80327e0 con 0x7f55f80ad960 2024-08-17T02:29:59.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.648+0000 7f55fde00640 1 -- 172.21.15.6:0/1034232559 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55f80ad960 msgr2=0x7f55f815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.648+0000 7f55fde00640 1 --2- 172.21.15.6:0/1034232559 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55f80ad960 0x7f55f815b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009850 tx=0x7f55e80090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.648+0000 7f55fde00640 1 -- 172.21.15.6:0/1034232559 shutdown_connections 2024-08-17T02:29:59.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.648+0000 7f55fde00640 1 --2- 172.21.15.6:0/1034232559 >> v2:172.21.15.136:3300/0 conn(0x7f55f80add30 0x7f55f8156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.648+0000 7f55fde00640 1 --2- 172.21.15.6:0/1034232559 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55f80ad960 0x7f55f815b0a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.648+0000 7f55fde00640 1 -- 172.21.15.6:0/1034232559 >> 172.21.15.6:0/1034232559 conn(0x7f55f8066e60 msgr2=0x7f55f8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:59.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.648+0000 7f55fde00640 1 -- 172.21.15.6:0/1034232559 shutdown_connections 2024-08-17T02:29:59.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.648+0000 7f55fde00640 1 -- 172.21.15.6:0/1034232559 wait complete. 2024-08-17T02:29:59.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.650+0000 7f55fde00640 1 Processor -- start 2024-08-17T02:29:59.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.650+0000 7f55fde00640 1 -- start start 2024-08-17T02:29:59.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.651+0000 7f55fde00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55f80ad960 0x7f55f81586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.651+0000 7f55fde00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55f80add30 0x7f55f814b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.651+0000 7f55fde00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55f80ca050 0x7f55f80ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.651+0000 7f55fde00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f8158be0 con 0x7f55f80ad960 2024-08-17T02:29:59.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.651+0000 7f55fde00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f80ab4c0 con 0x7f55f80add30 2024-08-17T02:29:59.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.651+0000 7f55fde00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f80ac320 con 0x7f55f80ca050 2024-08-17T02:29:59.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.651+0000 7f55f6a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55f80ad960 0x7f55f81586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.651+0000 7f55f6a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55f80ad960 0x7f55f81586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51980/0 (socket says 172.21.15.6:51980) 2024-08-17T02:29:59.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.651+0000 7f55f6a00640 1 -- 172.21.15.6:0/884195245 learned_addr learned my addr 172.21.15.6:0/884195245 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:29:59.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.651+0000 7f55efe00640 1 --2- 172.21.15.6:0/884195245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55f80add30 0x7f55f814b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.651+0000 7f55f7400640 1 --2- 172.21.15.6:0/884195245 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55f80ca050 0x7f55f80ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.651+0000 7f55f6a00640 1 -- 172.21.15.6:0/884195245 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55f80ca050 msgr2=0x7f55f80ac7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.651+0000 7f55f6a00640 1 --2- 172.21.15.6:0/884195245 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55f80ca050 0x7f55f80ac7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.651+0000 7f55f6a00640 1 -- 172.21.15.6:0/884195245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55f80add30 msgr2=0x7f55f814b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.651+0000 7f55f6a00640 1 --2- 172.21.15.6:0/884195245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55f80add30 0x7f55f814b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.651+0000 7f55f6a00640 1 -- 172.21.15.6:0/884195245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e8009390 con 0x7f55f80ad960 2024-08-17T02:29:59.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.652+0000 7f55f6a00640 1 --2- 172.21.15.6:0/884195245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55f80ad960 0x7f55f81586a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009850 tx=0x7f55e8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:59.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.652+0000 7f55ee000640 1 -- 172.21.15.6:0/884195245 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e8031de0 con 0x7f55f80ad960 2024-08-17T02:29:59.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.652+0000 7f55ee000640 1 -- 172.21.15.6:0/884195245 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e803d420 con 0x7f55f80ad960 2024-08-17T02:29:59.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.652+0000 7f55ee000640 1 -- 172.21.15.6:0/884195245 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e803d800 con 0x7f55f80ad960 2024-08-17T02:29:59.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.652+0000 7f55fde00640 1 -- 172.21.15.6:0/884195245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f80ab710 con 0x7f55f80ad960 2024-08-17T02:29:59.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.652+0000 7f55fde00640 1 -- 172.21.15.6:0/884195245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f80abd50 con 0x7f55f80ad960 2024-08-17T02:29:59.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.653+0000 7f55fde00640 1 -- 172.21.15.6:0/884195245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f80ac0d0 con 0x7f55f80ad960 2024-08-17T02:29:59.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.654+0000 7f55ee000640 1 -- 172.21.15.6:0/884195245 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f55e8039040 con 0x7f55f80ad960 2024-08-17T02:29:59.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.655+0000 7f55ee000640 1 --2- 172.21.15.6:0/884195245 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f55d4065150 0x7f55d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.655+0000 7f55ee000640 1 -- 172.21.15.6:0/884195245 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f55e80a2530 con 0x7f55f80ad960 2024-08-17T02:29:59.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.655+0000 7f55efe00640 1 --2- 172.21.15.6:0/884195245 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f55d4065150 0x7f55d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.656+0000 7f55efe00640 1 --2- 172.21.15.6:0/884195245 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f55d4065150 0x7f55d4067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f55f8158490 tx=0x7f55e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:59.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.659+0000 7f55ee000640 1 -- 172.21.15.6:0/884195245 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f55e80708b0 con 0x7f55f80ad960 2024-08-17T02:29:59.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.842+0000 7f55fde00640 1 -- 172.21.15.6:0/884195245 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f55f8063fb0 con 0x7f55d4065150 2024-08-17T02:29:59.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.842+0000 7f55ee000640 1 -- 172.21.15.6:0/884195245 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f55f8063fb0 con 0x7f55d4065150 2024-08-17T02:29:59.843 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:29:59.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.844+0000 7f55fde00640 1 -- 172.21.15.6:0/884195245 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f55d4065150 msgr2=0x7f55d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.844+0000 7f55fde00640 1 --2- 172.21.15.6:0/884195245 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f55d4065150 0x7f55d4067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f55f8158490 tx=0x7f55e0009040 comp rx=0 tx=0).stop 2024-08-17T02:29:59.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.844+0000 7f55fde00640 1 -- 172.21.15.6:0/884195245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55f80ad960 msgr2=0x7f55f81586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.844+0000 7f55fde00640 1 --2- 172.21.15.6:0/884195245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55f80ad960 0x7f55f81586a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009850 tx=0x7f55e8032000 comp rx=0 tx=0).stop 2024-08-17T02:29:59.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.844+0000 7f55fde00640 1 -- 172.21.15.6:0/884195245 shutdown_connections 2024-08-17T02:29:59.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.844+0000 7f55fde00640 1 --2- 172.21.15.6:0/884195245 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f55d4065150 0x7f55d4067600 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.844+0000 7f55fde00640 1 --2- 172.21.15.6:0/884195245 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55f80ca050 0x7f55f80ac7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.844+0000 7f55fde00640 1 --2- 172.21.15.6:0/884195245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55f80add30 0x7f55f814b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.844+0000 7f55fde00640 1 --2- 172.21.15.6:0/884195245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55f80ad960 0x7f55f81586a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.844+0000 7f55fde00640 1 -- 172.21.15.6:0/884195245 >> 172.21.15.6:0/884195245 conn(0x7f55f8066e60 msgr2=0x7f55f80aad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:59.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.845+0000 7f55fde00640 1 -- 172.21.15.6:0/884195245 shutdown_connections 2024-08-17T02:29:59.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:29:59.845+0000 7f55fde00640 1 -- 172.21.15.6:0/884195245 wait complete. 2024-08-17T02:29:59.861 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:29:59.861 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:00.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.015+0000 7f8225600640 1 Processor -- start 2024-08-17T02:30:00.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.015+0000 7f8225600640 1 -- start start 2024-08-17T02:30:00.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.016+0000 7f8225600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f82200ad020 0x7f8220159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.017+0000 7f8225600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f82200afa00 0x7f82200afe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.017+0000 7f8225600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8220159ad0 con 0x7f82200ac000 2024-08-17T02:30:00.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.017+0000 7f8225600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82200b0340 con 0x7f82200ad020 2024-08-17T02:30:00.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.017+0000 7f8225600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82200ad590 con 0x7f82200afa00 2024-08-17T02:30:00.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.017+0000 7f8217e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f82200ad020 0x7f8220159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.017+0000 7f8217e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f82200ad020 0x7f8220159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51990/0 (socket says 172.21.15.6:51990) 2024-08-17T02:30:00.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.017+0000 7f8217e00640 1 -- 172.21.15.6:0/2559145743 learned_addr learned my addr 172.21.15.6:0/2559145743 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:30:00.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.017+0000 7f821f400640 1 --2- 172.21.15.6:0/2559145743 >> v2:172.21.15.136:3300/0 conn(0x7f82200afa00 0x7f82200afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.017+0000 7f8217e00640 1 -- 172.21.15.6:0/2559145743 >> v2:172.21.15.136:3300/0 conn(0x7f82200afa00 msgr2=0x7f82200afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:00.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.017+0000 7f8217e00640 1 --2- 172.21.15.6:0/2559145743 >> v2:172.21.15.136:3300/0 conn(0x7f82200afa00 0x7f82200afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.017+0000 7f8217e00640 1 -- 172.21.15.6:0/2559145743 >> v1:172.21.15.136:6789/0 conn(0x7f82200ac000 legacy=0x7f8220156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:00.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.017+0000 7f8217e00640 1 -- 172.21.15.6:0/2559145743 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82200ad870 con 0x7f82200ad020 2024-08-17T02:30:00.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.017+0000 7f821f400640 1 --2- 172.21.15.6:0/2559145743 >> v2:172.21.15.136:3300/0 conn(0x7f82200afa00 0x7f82200afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:00.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.018+0000 7f8217e00640 1 --2- 172.21.15.6:0/2559145743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82200ad020 0x7f8220159f60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f82200b09a0 tx=0x7f82080091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8acf77604a44871 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:00.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.018+0000 7f821e000640 1 -- 172.21.15.6:0/2559145743 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820802ad50 con 0x7f82200ad020 2024-08-17T02:30:00.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.019+0000 7f821e000640 1 -- 172.21.15.6:0/2559145743 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8208032440 con 0x7f82200ad020 2024-08-17T02:30:00.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.019+0000 7f821e000640 1 -- 172.21.15.6:0/2559145743 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208032820 con 0x7f82200ad020 2024-08-17T02:30:00.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.019+0000 7f8225600640 1 -- 172.21.15.6:0/2559145743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82200ad020 msgr2=0x7f8220159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.019+0000 7f8225600640 1 --2- 172.21.15.6:0/2559145743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82200ad020 0x7f8220159f60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f82200b09a0 tx=0x7f82080091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.019+0000 7f8225600640 1 -- 172.21.15.6:0/2559145743 shutdown_connections 2024-08-17T02:30:00.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.019+0000 7f8225600640 1 --2- 172.21.15.6:0/2559145743 >> v2:172.21.15.136:3300/0 conn(0x7f82200afa00 0x7f82200afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.019+0000 7f8225600640 1 --2- 172.21.15.6:0/2559145743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82200ad020 0x7f8220159f60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.019+0000 7f8225600640 1 -- 172.21.15.6:0/2559145743 >> 172.21.15.6:0/2559145743 conn(0x7f8220066e60 msgr2=0x7f8220067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.019+0000 7f8225600640 1 -- 172.21.15.6:0/2559145743 shutdown_connections 2024-08-17T02:30:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.019+0000 7f8225600640 1 -- 172.21.15.6:0/2559145743 wait complete. 2024-08-17T02:30:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.021+0000 7f8225600640 1 Processor -- start 2024-08-17T02:30:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.021+0000 7f8225600640 1 -- start start 2024-08-17T02:30:00.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.022+0000 7f8225600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82200ac000 0x7f82200a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.022+0000 7f8225600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82200ad020 0x7f82200a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.022+0000 7f8225600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82200afa00 0x7f82200a90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.022+0000 7f8225600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82200a48b0 con 0x7f82200ac000 2024-08-17T02:30:00.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.022+0000 7f8225600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82200a4b90 con 0x7f82200ad020 2024-08-17T02:30:00.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.022+0000 7f8225600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82200a4e70 con 0x7f82200afa00 2024-08-17T02:30:00.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.022+0000 7f821ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82200ac000 0x7f82200a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.022+0000 7f821ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82200ac000 0x7f82200a5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52002/0 (socket says 172.21.15.6:52002) 2024-08-17T02:30:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.022+0000 7f821ea00640 1 -- 172.21.15.6:0/3042440451 learned_addr learned my addr 172.21.15.6:0/3042440451 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:30:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.022+0000 7f8217e00640 1 --2- 172.21.15.6:0/3042440451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82200ad020 0x7f82200a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.022+0000 7f821f400640 1 --2- 172.21.15.6:0/3042440451 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82200afa00 0x7f82200a90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.022+0000 7f821ea00640 1 -- 172.21.15.6:0/3042440451 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82200afa00 msgr2=0x7f82200a90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.022+0000 7f821ea00640 1 --2- 172.21.15.6:0/3042440451 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82200afa00 0x7f82200a90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.022+0000 7f821ea00640 1 -- 172.21.15.6:0/3042440451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82200ad020 msgr2=0x7f82200a8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.022+0000 7f821ea00640 1 --2- 172.21.15.6:0/3042440451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82200ad020 0x7f82200a8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.022+0000 7f821ea00640 1 -- 172.21.15.6:0/3042440451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8208009450 con 0x7f82200ac000 2024-08-17T02:30:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.023+0000 7f821ea00640 1 --2- 172.21.15.6:0/3042440451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82200ac000 0x7f82200a5950 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f821000b5e0 tx=0x7f8210009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.023+0000 7f8216000640 1 -- 172.21.15.6:0/3042440451 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821000f590 con 0x7f82200ac000 2024-08-17T02:30:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.023+0000 7f8216000640 1 -- 172.21.15.6:0/3042440451 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821000f710 con 0x7f82200ac000 2024-08-17T02:30:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.023+0000 7f8216000640 1 -- 172.21.15.6:0/3042440451 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821000fad0 con 0x7f82200ac000 2024-08-17T02:30:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.023+0000 7f8225600640 1 -- 172.21.15.6:0/3042440451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82200a5150 con 0x7f82200ac000 2024-08-17T02:30:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.023+0000 7f8225600640 1 -- 172.21.15.6:0/3042440451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82200a5e90 con 0x7f82200ac000 2024-08-17T02:30:00.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.024+0000 7f8225600640 1 -- 172.21.15.6:0/3042440451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8220063fb0 con 0x7f82200ac000 2024-08-17T02:30:00.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.025+0000 7f8216000640 1 -- 172.21.15.6:0/3042440451 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f821001a460 con 0x7f82200ac000 2024-08-17T02:30:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.026+0000 7f8216000640 1 --2- 172.21.15.6:0/3042440451 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f81fc065150 0x7f81fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.026+0000 7f8216000640 1 -- 172.21.15.6:0/3042440451 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f8210081ec0 con 0x7f82200ac000 2024-08-17T02:30:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.026+0000 7f8216000640 1 --2- 172.21.15.6:0/3042440451 >> [v2:172.21.15.136:6800/37291,v1:172.21.15.136:6801/37291] conn(0x7f81fc06b040 0x7f81fc06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.026+0000 7f8216000640 1 -- 172.21.15.6:0/3042440451 --> [v2:172.21.15.136:6800/37291,v1:172.21.15.136:6801/37291] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f81fc06db00 con 0x7f81fc06b040 2024-08-17T02:30:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.026+0000 7f8216000640 1 -- 172.21.15.6:0/3042440451 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8210084420 con 0x7f82200ac000 2024-08-17T02:30:00.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.026+0000 7f8217e00640 1 --2- 172.21.15.6:0/3042440451 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f81fc065150 0x7f81fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.026+0000 7f821f400640 1 --2- 172.21.15.6:0/3042440451 >> [v2:172.21.15.136:6800/37291,v1:172.21.15.136:6801/37291] conn(0x7f81fc06b040 0x7f81fc06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.027+0000 7f8217e00640 1 --2- 172.21.15.6:0/3042440451 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f81fc065150 0x7f81fc067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8208034000 tx=0x7f8208032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:00.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.027+0000 7f821f400640 1 --2- 172.21.15.6:0/3042440451 >> [v2:172.21.15.136:6800/37291,v1:172.21.15.136:6801/37291] conn(0x7f81fc06b040 0x7f81fc06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:00.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.028+0000 7f8216000640 1 -- 172.21.15.6:0/3042440451 <== osd.4 v2:172.21.15.136:6800/37291 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f81fc06db00 con 0x7f81fc06b040 2024-08-17T02:30:00.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.041+0000 7f8225600640 1 -- 172.21.15.6:0/3042440451 --> [v2:172.21.15.136:6800/37291,v1:172.21.15.136:6801/37291] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8220067c10 con 0x7f81fc06b040 2024-08-17T02:30:00.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.042+0000 7f8216000640 1 -- 172.21.15.6:0/3042440451 <== osd.4 v2:172.21.15.136:6800/37291 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8220067c10 con 0x7f81fc06b040 2024-08-17T02:30:00.043 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-08-17T02:30:00.043 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:00.043 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-08-17T02:30:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.042+0000 7f8225600640 1 -- 172.21.15.6:0/3042440451 >> [v2:172.21.15.136:6800/37291,v1:172.21.15.136:6801/37291] conn(0x7f81fc06b040 msgr2=0x7f81fc06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.042+0000 7f8225600640 1 --2- 172.21.15.6:0/3042440451 >> [v2:172.21.15.136:6800/37291,v1:172.21.15.136:6801/37291] conn(0x7f81fc06b040 0x7f81fc06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.042+0000 7f8225600640 1 -- 172.21.15.6:0/3042440451 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f81fc065150 msgr2=0x7f81fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.042+0000 7f8225600640 1 --2- 172.21.15.6:0/3042440451 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f81fc065150 0x7f81fc067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8208034000 tx=0x7f8208032000 comp rx=0 tx=0).stop 2024-08-17T02:30:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.042+0000 7f8225600640 1 -- 172.21.15.6:0/3042440451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82200ac000 msgr2=0x7f82200a5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.042+0000 7f8225600640 1 --2- 172.21.15.6:0/3042440451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82200ac000 0x7f82200a5950 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f821000b5e0 tx=0x7f8210009060 comp rx=0 tx=0).stop 2024-08-17T02:30:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.042+0000 7f821f400640 1 -- 172.21.15.6:0/3042440451 reap_dead start 2024-08-17T02:30:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.042+0000 7f8225600640 1 -- 172.21.15.6:0/3042440451 shutdown_connections 2024-08-17T02:30:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.042+0000 7f8225600640 1 -- 172.21.15.6:0/3042440451 >> 172.21.15.6:0/3042440451 conn(0x7f8220066e60 msgr2=0x7f8220069ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.043+0000 7f8225600640 1 -- 172.21.15.6:0/3042440451 shutdown_connections 2024-08-17T02:30:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.043+0000 7f8225600640 1 -- 172.21.15.6:0/3042440451 wait complete. 2024-08-17T02:30:00.057 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:30:00.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.211+0000 7fe664e00640 1 Processor -- start 2024-08-17T02:30:00.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.211+0000 7fe664e00640 1 -- start start 2024-08-17T02:30:00.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.213+0000 7fe664e00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe660159100 0x7fe6600aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.213+0000 7fe664e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe660069d40 0x7fe6600af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.213+0000 7fe664e00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6600b14e0 con 0x7fe660067f70 2024-08-17T02:30:00.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.213+0000 7fe664e00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe660069210 con 0x7fe660159100 2024-08-17T02:30:00.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.213+0000 7fe664e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600694f0 con 0x7fe660069d40 2024-08-17T02:30:00.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.213+0000 7fe65de00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe660159100 0x7fe6600aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.213+0000 7fe65e800640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe660067f70 0x7fe6600ccc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46374/0 (socket says 172.21.15.6:46374) 2024-08-17T02:30:00.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.213+0000 7fe65e800640 1 -- 172.21.15.6:0/1696350927 learned_addr learned my addr 172.21.15.6:0/1696350927 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:30:00.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.213+0000 7fe65d400640 1 --2- 172.21.15.6:0/1696350927 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe660069d40 0x7fe6600af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.214+0000 7fe65de00640 1 -- 172.21.15.6:0/1696350927 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe660069d40 msgr2=0x7fe6600af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:00.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.214+0000 7fe65de00640 1 --2- 172.21.15.6:0/1696350927 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe660069d40 0x7fe6600af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.214+0000 7fe65de00640 1 -- 172.21.15.6:0/1696350927 >> v1:172.21.15.6:6789/0 conn(0x7fe660067f70 legacy=0x7fe6600ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.214+0000 7fe65de00640 1 -- 172.21.15.6:0/1696350927 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6600697d0 con 0x7fe660159100 2024-08-17T02:30:00.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.214+0000 7fe65ca00640 1 -- 172.21.15.6:0/1696350927 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773185260 0 0) 0x7fe6600b14e0 con 0x7fe660067f70 2024-08-17T02:30:00.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.215+0000 7fe65de00640 1 --2- 172.21.15.6:0/1696350927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe660159100 0x7fe6600aeae0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe650009850 tx=0x7fe6500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78997257e1dfd963 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:00.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.215+0000 7fe65ca00640 1 -- 172.21.15.6:0/1696350927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65002ad00 con 0x7fe660159100 2024-08-17T02:30:00.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.215+0000 7fe65ca00640 1 -- 172.21.15.6:0/1696350927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65002ae60 con 0x7fe660159100 2024-08-17T02:30:00.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.215+0000 7fe65ca00640 1 -- 172.21.15.6:0/1696350927 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650032670 con 0x7fe660159100 2024-08-17T02:30:00.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.215+0000 7fe664e00640 1 -- 172.21.15.6:0/1696350927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe660159100 msgr2=0x7fe6600aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.215+0000 7fe664e00640 1 --2- 172.21.15.6:0/1696350927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe660159100 0x7fe6600aeae0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe650009850 tx=0x7fe6500090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.215+0000 7fe664e00640 1 -- 172.21.15.6:0/1696350927 shutdown_connections 2024-08-17T02:30:00.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.216+0000 7fe664e00640 1 --2- 172.21.15.6:0/1696350927 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe660069d40 0x7fe6600af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.216+0000 7fe664e00640 1 --2- 172.21.15.6:0/1696350927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe660159100 0x7fe6600aeae0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.216+0000 7fe664e00640 1 -- 172.21.15.6:0/1696350927 >> 172.21.15.6:0/1696350927 conn(0x7fe6600ce5e0 msgr2=0x7fe660095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:00.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.216+0000 7fe664e00640 1 -- 172.21.15.6:0/1696350927 shutdown_connections 2024-08-17T02:30:00.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.216+0000 7fe664e00640 1 -- 172.21.15.6:0/1696350927 wait complete. 2024-08-17T02:30:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.218+0000 7fe664e00640 1 Processor -- start 2024-08-17T02:30:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.218+0000 7fe664e00640 1 -- start start 2024-08-17T02:30:00.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.219+0000 7fe664e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe660067f70 0x7fe660169700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.219+0000 7fe664e00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe660069d40 0x7fe66009b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.219+0000 7fe664e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe660159100 0x7fe6600990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.219+0000 7fe664e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe660169270 con 0x7fe660159100 2024-08-17T02:30:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.219+0000 7fe664e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe660157b40 con 0x7fe660067f70 2024-08-17T02:30:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.219+0000 7fe664e00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe660157580 con 0x7fe660069d40 2024-08-17T02:30:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.219+0000 7fe65e800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe660159100 0x7fe6600990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.219+0000 7fe65e800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe660159100 0x7fe6600990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52026/0 (socket says 172.21.15.6:52026) 2024-08-17T02:30:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.219+0000 7fe65e800640 1 -- 172.21.15.6:0/2134229088 learned_addr learned my addr 172.21.15.6:0/2134229088 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:30:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.220+0000 7fe65de00640 1 --2- 172.21.15.6:0/2134229088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe660067f70 0x7fe660169700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.220+0000 7fe65d400640 1 --2- 172.21.15.6:0/2134229088 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe660069d40 0x7fe66009b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.220+0000 7fe65e800640 1 -- 172.21.15.6:0/2134229088 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe660069d40 msgr2=0x7fe66009b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.220+0000 7fe65e800640 1 --2- 172.21.15.6:0/2134229088 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe660069d40 0x7fe66009b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.220+0000 7fe65e800640 1 -- 172.21.15.6:0/2134229088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe660067f70 msgr2=0x7fe660169700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.220+0000 7fe65e800640 1 --2- 172.21.15.6:0/2134229088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe660067f70 0x7fe660169700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.220+0000 7fe65e800640 1 -- 172.21.15.6:0/2134229088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe650009390 con 0x7fe660159100 2024-08-17T02:30:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.220+0000 7fe65de00640 1 --2- 172.21.15.6:0/2134229088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe660067f70 0x7fe660169700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.220+0000 7fe65e800640 1 --2- 172.21.15.6:0/2134229088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe660159100 0x7fe6600990c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe65800cc90 tx=0x7fe658001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.220+0000 7fe655600640 1 -- 172.21.15.6:0/2134229088 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65800a850 con 0x7fe660159100 2024-08-17T02:30:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.221+0000 7fe655600640 1 -- 172.21.15.6:0/2134229088 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65800a9b0 con 0x7fe660159100 2024-08-17T02:30:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.221+0000 7fe664e00640 1 -- 172.21.15.6:0/2134229088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe660157860 con 0x7fe660159100 2024-08-17T02:30:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.221+0000 7fe655600640 1 -- 172.21.15.6:0/2134229088 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65800ad70 con 0x7fe660159100 2024-08-17T02:30:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.221+0000 7fe664e00640 1 -- 172.21.15.6:0/2134229088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe660169c40 con 0x7fe660159100 2024-08-17T02:30:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.222+0000 7fe664e00640 1 -- 172.21.15.6:0/2134229088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe660169420 con 0x7fe660159100 2024-08-17T02:30:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.223+0000 7fe655600640 1 -- 172.21.15.6:0/2134229088 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe658007300 con 0x7fe660159100 2024-08-17T02:30:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.224+0000 7fe655600640 1 --2- 172.21.15.6:0/2134229088 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe640065150 0x7fe640067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.224+0000 7fe655600640 1 -- 172.21.15.6:0/2134229088 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe658082390 con 0x7fe660159100 2024-08-17T02:30:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.225+0000 7fe65de00640 1 --2- 172.21.15.6:0/2134229088 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe640065150 0x7fe640067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.225+0000 7fe65de00640 1 --2- 172.21.15.6:0/2134229088 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe640065150 0x7fe640067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe650034000 tx=0x7fe650032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:00.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.227+0000 7fe655600640 1 -- 172.21.15.6:0/2134229088 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe660169420 con 0x7fe660159100 2024-08-17T02:30:00.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.408+0000 7fe664e00640 1 -- 172.21.15.6:0/2134229088 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe660157cb0 con 0x7fe640065150 2024-08-17T02:30:00.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.408+0000 7fe655600640 1 -- 172.21.15.6:0/2134229088 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe660157cb0 con 0x7fe640065150 2024-08-17T02:30:00.409 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:30:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.410+0000 7fe664e00640 1 -- 172.21.15.6:0/2134229088 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe640065150 msgr2=0x7fe640067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.410+0000 7fe664e00640 1 --2- 172.21.15.6:0/2134229088 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe640065150 0x7fe640067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe650034000 tx=0x7fe650032000 comp rx=0 tx=0).stop 2024-08-17T02:30:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.411+0000 7fe664e00640 1 -- 172.21.15.6:0/2134229088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe660159100 msgr2=0x7fe6600990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.411+0000 7fe664e00640 1 --2- 172.21.15.6:0/2134229088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe660159100 0x7fe6600990c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe65800cc90 tx=0x7fe658001a20 comp rx=0 tx=0).stop 2024-08-17T02:30:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.411+0000 7fe664e00640 1 -- 172.21.15.6:0/2134229088 shutdown_connections 2024-08-17T02:30:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.411+0000 7fe664e00640 1 --2- 172.21.15.6:0/2134229088 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fe640065150 0x7fe640067600 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.411+0000 7fe664e00640 1 --2- 172.21.15.6:0/2134229088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe660159100 0x7fe6600990c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.411+0000 7fe664e00640 1 --2- 172.21.15.6:0/2134229088 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe660069d40 0x7fe66009b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.411+0000 7fe664e00640 1 --2- 172.21.15.6:0/2134229088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe660067f70 0x7fe660169700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.411+0000 7fe664e00640 1 -- 172.21.15.6:0/2134229088 >> 172.21.15.6:0/2134229088 conn(0x7fe6600ce5e0 msgr2=0x7fe66006cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:00.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.411+0000 7fe664e00640 1 -- 172.21.15.6:0/2134229088 shutdown_connections 2024-08-17T02:30:00.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.411+0000 7fe664e00640 1 -- 172.21.15.6:0/2134229088 wait complete. 2024-08-17T02:30:00.427 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:30:00.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:00.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.581+0000 7f0d5fe00640 1 Processor -- start 2024-08-17T02:30:00.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.582+0000 7f0d5fe00640 1 -- start start 2024-08-17T02:30:00.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.583+0000 7f0d5fe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0d600cae20 0x7f0d600adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.583+0000 7f0d5fe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d600ae6e0 0x7f0d60157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.583+0000 7f0d5fe00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d600ca060 con 0x7f0d600ad780 2024-08-17T02:30:00.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.583+0000 7f0d5fe00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d600ca340 con 0x7f0d600ae6e0 2024-08-17T02:30:00.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.583+0000 7f0d5fe00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d600ca620 con 0x7f0d600cae20 2024-08-17T02:30:00.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.583+0000 7f0d5f400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d600ae6e0 0x7f0d60157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.583+0000 7f0d5ea00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0d600ad780 0x7f0d600af6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46376/0 (socket says 172.21.15.6:46376) 2024-08-17T02:30:00.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.583+0000 7f0d5ea00640 1 -- 172.21.15.6:0/2104731608 learned_addr learned my addr 172.21.15.6:0/2104731608 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:30:00.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.583+0000 7f0d57e00640 1 --2- 172.21.15.6:0/2104731608 >> v2:172.21.15.136:3300/0 conn(0x7f0d600cae20 0x7f0d600adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.583+0000 7f0d5f400640 1 -- 172.21.15.6:0/2104731608 >> v2:172.21.15.136:3300/0 conn(0x7f0d600cae20 msgr2=0x7f0d600adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:00.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.583+0000 7f0d5f400640 1 --2- 172.21.15.6:0/2104731608 >> v2:172.21.15.136:3300/0 conn(0x7f0d600cae20 0x7f0d600adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.583+0000 7f0d5f400640 1 -- 172.21.15.6:0/2104731608 >> v1:172.21.15.6:6789/0 conn(0x7f0d600ad780 legacy=0x7f0d600af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.583+0000 7f0d5f400640 1 -- 172.21.15.6:0/2104731608 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d600ca900 con 0x7f0d600ae6e0 2024-08-17T02:30:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.583+0000 7f0d57e00640 1 --2- 172.21.15.6:0/2104731608 >> v2:172.21.15.136:3300/0 conn(0x7f0d600cae20 0x7f0d600adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.584+0000 7f0d5f400640 1 --2- 172.21.15.6:0/2104731608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d600ae6e0 0x7f0d60157100 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0d6015a5b0 tx=0x7f0d58009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3a3c26cb9dc644 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.585+0000 7f0d5e000640 1 -- 172.21.15.6:0/2104731608 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58007550 con 0x7f0d600ae6e0 2024-08-17T02:30:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.585+0000 7f0d5e000640 1 -- 172.21.15.6:0/2104731608 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5802d050 con 0x7f0d600ae6e0 2024-08-17T02:30:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.585+0000 7f0d5e000640 1 -- 172.21.15.6:0/2104731608 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58007920 con 0x7f0d600ae6e0 2024-08-17T02:30:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.585+0000 7f0d5fe00640 1 -- 172.21.15.6:0/2104731608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d600ae6e0 msgr2=0x7f0d60157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.585+0000 7f0d5fe00640 1 --2- 172.21.15.6:0/2104731608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d600ae6e0 0x7f0d60157100 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0d6015a5b0 tx=0x7f0d58009780 comp rx=0 tx=0).stop 2024-08-17T02:30:00.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.585+0000 7f0d5fe00640 1 -- 172.21.15.6:0/2104731608 shutdown_connections 2024-08-17T02:30:00.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.585+0000 7f0d5fe00640 1 --2- 172.21.15.6:0/2104731608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d600ae6e0 0x7f0d60157100 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.585+0000 7f0d5fe00640 1 --2- 172.21.15.6:0/2104731608 >> v2:172.21.15.136:3300/0 conn(0x7f0d600cae20 0x7f0d600adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.585+0000 7f0d5fe00640 1 -- 172.21.15.6:0/2104731608 >> 172.21.15.6:0/2104731608 conn(0x7f0d60066e60 msgr2=0x7f0d60067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:00.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.586+0000 7f0d5fe00640 1 -- 172.21.15.6:0/2104731608 shutdown_connections 2024-08-17T02:30:00.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.586+0000 7f0d5fe00640 1 -- 172.21.15.6:0/2104731608 wait complete. 2024-08-17T02:30:00.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.587+0000 7f0d5fe00640 1 Processor -- start 2024-08-17T02:30:00.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.587+0000 7f0d5fe00640 1 -- start start 2024-08-17T02:30:00.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.588+0000 7f0d5fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d600ad780 0x7f0d600a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.588+0000 7f0d5fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d600ae6e0 0x7f0d60140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.588+0000 7f0d5fe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0d600cae20 0x7f0d60141400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.588+0000 7f0d5fe00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d60159ba0 con 0x7f0d600ae6e0 2024-08-17T02:30:00.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.588+0000 7f0d5fe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600ac3c0 con 0x7f0d600ad780 2024-08-17T02:30:00.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.588+0000 7f0d5fe00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600aa320 con 0x7f0d600cae20 2024-08-17T02:30:00.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.588+0000 7f0d57e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d600ae6e0 0x7f0d60140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.588+0000 7f0d57e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d600ae6e0 0x7f0d60140b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52054/0 (socket says 172.21.15.6:52054) 2024-08-17T02:30:00.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.588+0000 7f0d57e00640 1 -- 172.21.15.6:0/3285852732 learned_addr learned my addr 172.21.15.6:0/3285852732 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:30:00.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.588+0000 7f0d5ea00640 1 --2- 172.21.15.6:0/3285852732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d600ad780 0x7f0d600a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.589+0000 7f0d5f400640 1 --2- 172.21.15.6:0/3285852732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0d600cae20 0x7f0d60141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.589+0000 7f0d57e00640 1 -- 172.21.15.6:0/3285852732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0d600cae20 msgr2=0x7f0d60141400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.589+0000 7f0d57e00640 1 --2- 172.21.15.6:0/3285852732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0d600cae20 0x7f0d60141400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.589+0000 7f0d57e00640 1 -- 172.21.15.6:0/3285852732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d600ad780 msgr2=0x7f0d600a9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.589+0000 7f0d57e00640 1 --2- 172.21.15.6:0/3285852732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d600ad780 0x7f0d600a9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.589+0000 7f0d57e00640 1 -- 172.21.15.6:0/3285852732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d58009a20 con 0x7f0d600ae6e0 2024-08-17T02:30:00.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.589+0000 7f0d57e00640 1 --2- 172.21.15.6:0/3285852732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d600ae6e0 0x7f0d60140b50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800d810 tx=0x7f0d48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:00.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.589+0000 7f0d56000640 1 -- 172.21.15.6:0/3285852732 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4800de00 con 0x7f0d600ae6e0 2024-08-17T02:30:00.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.589+0000 7f0d56000640 1 -- 172.21.15.6:0/3285852732 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d480098b0 con 0x7f0d600ae6e0 2024-08-17T02:30:00.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.589+0000 7f0d5fe00640 1 -- 172.21.15.6:0/3285852732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d600ab7b0 con 0x7f0d600ae6e0 2024-08-17T02:30:00.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.589+0000 7f0d56000640 1 -- 172.21.15.6:0/3285852732 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48009c70 con 0x7f0d600ae6e0 2024-08-17T02:30:00.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.590+0000 7f0d5fe00640 1 -- 172.21.15.6:0/3285852732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d600abd70 con 0x7f0d600ae6e0 2024-08-17T02:30:00.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.590+0000 7f0d5fe00640 1 -- 172.21.15.6:0/3285852732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d60063f10 con 0x7f0d600ae6e0 2024-08-17T02:30:00.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.591+0000 7f0d56000640 1 -- 172.21.15.6:0/3285852732 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0d48014640 con 0x7f0d600ae6e0 2024-08-17T02:30:00.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.592+0000 7f0d56000640 1 --2- 172.21.15.6:0/3285852732 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0d3c065180 0x7f0d3c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.592+0000 7f0d56000640 1 -- 172.21.15.6:0/3285852732 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0d48082480 con 0x7f0d600ae6e0 2024-08-17T02:30:00.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.593+0000 7f0d56000640 1 --2- 172.21.15.6:0/3285852732 >> [v2:172.21.15.136:6805/37290,v1:172.21.15.136:6806/37290] conn(0x7f0d3c06b070 0x7f0d3c06d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.593+0000 7f0d56000640 1 -- 172.21.15.6:0/3285852732 --> [v2:172.21.15.136:6805/37290,v1:172.21.15.136:6806/37290] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d3c06db30 con 0x7f0d3c06b070 2024-08-17T02:30:00.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.593+0000 7f0d56000640 1 -- 172.21.15.6:0/3285852732 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d480849e0 con 0x7f0d600ae6e0 2024-08-17T02:30:00.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.593+0000 7f0d5ea00640 1 --2- 172.21.15.6:0/3285852732 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0d3c065180 0x7f0d3c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.593+0000 7f0d5f400640 1 --2- 172.21.15.6:0/3285852732 >> [v2:172.21.15.136:6805/37290,v1:172.21.15.136:6806/37290] conn(0x7f0d3c06b070 0x7f0d3c06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.593+0000 7f0d5ea00640 1 --2- 172.21.15.6:0/3285852732 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0d3c065180 0x7f0d3c067630 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0d50007880 tx=0x7f0d50007e20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:00.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.594+0000 7f0d5f400640 1 --2- 172.21.15.6:0/3285852732 >> [v2:172.21.15.136:6805/37290,v1:172.21.15.136:6806/37290] conn(0x7f0d3c06b070 0x7f0d3c06d480 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:00.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.595+0000 7f0d56000640 1 -- 172.21.15.6:0/3285852732 <== osd.5 v2:172.21.15.136:6805/37290 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f0d3c06db30 con 0x7f0d3c06b070 2024-08-17T02:30:00.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.608+0000 7f0d5fe00640 1 -- 172.21.15.6:0/3285852732 --> [v2:172.21.15.136:6805/37290,v1:172.21.15.136:6806/37290] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0d60141090 con 0x7f0d3c06b070 2024-08-17T02:30:00.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.609+0000 7f0d56000640 1 -- 172.21.15.6:0/3285852732 <== osd.5 v2:172.21.15.136:6805/37290 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0d60141090 con 0x7f0d3c06b070 2024-08-17T02:30:00.610 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-08-17T02:30:00.610 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:00.610 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-08-17T02:30:00.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.609+0000 7f0d5fe00640 1 -- 172.21.15.6:0/3285852732 >> [v2:172.21.15.136:6805/37290,v1:172.21.15.136:6806/37290] conn(0x7f0d3c06b070 msgr2=0x7f0d3c06d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.609+0000 7f0d5fe00640 1 --2- 172.21.15.6:0/3285852732 >> [v2:172.21.15.136:6805/37290,v1:172.21.15.136:6806/37290] conn(0x7f0d3c06b070 0x7f0d3c06d480 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.609+0000 7f0d5fe00640 1 -- 172.21.15.6:0/3285852732 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0d3c065180 msgr2=0x7f0d3c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.609+0000 7f0d5fe00640 1 --2- 172.21.15.6:0/3285852732 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f0d3c065180 0x7f0d3c067630 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0d50007880 tx=0x7f0d50007e20 comp rx=0 tx=0).stop 2024-08-17T02:30:00.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.609+0000 7f0d5fe00640 1 -- 172.21.15.6:0/3285852732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d600ae6e0 msgr2=0x7f0d60140b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.609+0000 7f0d5fe00640 1 --2- 172.21.15.6:0/3285852732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d600ae6e0 0x7f0d60140b50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800d810 tx=0x7f0d48008040 comp rx=0 tx=0).stop 2024-08-17T02:30:00.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.609+0000 7f0d5f400640 1 -- 172.21.15.6:0/3285852732 reap_dead start 2024-08-17T02:30:00.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.609+0000 7f0d5fe00640 1 -- 172.21.15.6:0/3285852732 shutdown_connections 2024-08-17T02:30:00.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.609+0000 7f0d5fe00640 1 -- 172.21.15.6:0/3285852732 >> 172.21.15.6:0/3285852732 conn(0x7f0d60066e60 msgr2=0x7f0d600af410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:00.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.609+0000 7f0d5fe00640 1 -- 172.21.15.6:0/3285852732 shutdown_connections 2024-08-17T02:30:00.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.609+0000 7f0d5fe00640 1 -- 172.21.15.6:0/3285852732 wait complete. 2024-08-17T02:30:00.624 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:30:00.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.776+0000 7f4864600640 1 Processor -- start 2024-08-17T02:30:00.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.776+0000 7f4864600640 1 -- start start 2024-08-17T02:30:00.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.777+0000 7f4864600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f485c0ad960 0x7f485c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.777+0000 7f4864600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f485c0ca050 0x7f485c156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.778+0000 7f4864600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c15b5e0 con 0x7f485c0add30 2024-08-17T02:30:00.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.778+0000 7f4864600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c0cb160 con 0x7f485c0ca050 2024-08-17T02:30:00.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.778+0000 7f4864600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c0b0d10 con 0x7f485c0ad960 2024-08-17T02:30:00.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.778+0000 7f4861200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f485c0ca050 0x7f485c156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.778+0000 7f4861200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f485c0ca050 0x7f485c156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52066/0 (socket says 172.21.15.6:52066) 2024-08-17T02:30:00.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.778+0000 7f4861200640 1 -- 172.21.15.6:0/882659274 learned_addr learned my addr 172.21.15.6:0/882659274 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:30:00.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.778+0000 7f4861c00640 1 --2- 172.21.15.6:0/882659274 >> v2:172.21.15.136:3300/0 conn(0x7f485c0ad960 0x7f485c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.778+0000 7f4861200640 1 -- 172.21.15.6:0/882659274 >> v2:172.21.15.136:3300/0 conn(0x7f485c0ad960 msgr2=0x7f485c15b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:00.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.778+0000 7f4861200640 1 --2- 172.21.15.6:0/882659274 >> v2:172.21.15.136:3300/0 conn(0x7f485c0ad960 0x7f485c15b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.778+0000 7f4861200640 1 -- 172.21.15.6:0/882659274 >> v1:172.21.15.136:6789/0 conn(0x7f485c0add30 legacy=0x7f485c156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.778+0000 7f4861200640 1 -- 172.21.15.6:0/882659274 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c0ca550 con 0x7f485c0ca050 2024-08-17T02:30:00.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.778+0000 7f4861c00640 1 --2- 172.21.15.6:0/882659274 >> v2:172.21.15.136:3300/0 conn(0x7f485c0ad960 0x7f485c15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:00.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.779+0000 7f4861200640 1 --2- 172.21.15.6:0/882659274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c0ca050 0x7f485c156420 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f485c0cc910 tx=0x7f48480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec0717d5db56e91 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:00.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.780+0000 7f485be00640 1 -- 172.21.15.6:0/882659274 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848032440 con 0x7f485c0ca050 2024-08-17T02:30:00.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.780+0000 7f485be00640 1 -- 172.21.15.6:0/882659274 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48480325a0 con 0x7f485c0ca050 2024-08-17T02:30:00.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.780+0000 7f485be00640 1 -- 172.21.15.6:0/882659274 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848032980 con 0x7f485c0ca050 2024-08-17T02:30:00.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.780+0000 7f4864600640 1 -- 172.21.15.6:0/882659274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c0ca050 msgr2=0x7f485c156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.780+0000 7f4864600640 1 --2- 172.21.15.6:0/882659274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c0ca050 0x7f485c156420 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f485c0cc910 tx=0x7f48480091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.780+0000 7f4864600640 1 -- 172.21.15.6:0/882659274 shutdown_connections 2024-08-17T02:30:00.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.780+0000 7f4864600640 1 --2- 172.21.15.6:0/882659274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c0ca050 0x7f485c156420 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.780+0000 7f4864600640 1 --2- 172.21.15.6:0/882659274 >> v2:172.21.15.136:3300/0 conn(0x7f485c0ad960 0x7f485c15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.780+0000 7f4864600640 1 -- 172.21.15.6:0/882659274 >> 172.21.15.6:0/882659274 conn(0x7f485c066e60 msgr2=0x7f485c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:00.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.780+0000 7f4864600640 1 -- 172.21.15.6:0/882659274 shutdown_connections 2024-08-17T02:30:00.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.780+0000 7f4864600640 1 -- 172.21.15.6:0/882659274 wait complete. 2024-08-17T02:30:00.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.782+0000 7f4864600640 1 Processor -- start 2024-08-17T02:30:00.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.782+0000 7f4864600640 1 -- start start 2024-08-17T02:30:00.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.783+0000 7f4864600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f485c0ad960 0x7f485c0aa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.783+0000 7f4864600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f485c0add30 0x7f485c13ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.783+0000 7f4864600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c0ca050 0x7f485c153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.783+0000 7f4864600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c0aa4a0 con 0x7f485c0ca050 2024-08-17T02:30:00.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.783+0000 7f4864600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c0a9890 con 0x7f485c0add30 2024-08-17T02:30:00.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.783+0000 7f4864600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c0a9b70 con 0x7f485c0ad960 2024-08-17T02:30:00.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.783+0000 7f4862600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c0ca050 0x7f485c153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.783+0000 7f4862600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c0ca050 0x7f485c153150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52068/0 (socket says 172.21.15.6:52068) 2024-08-17T02:30:00.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.783+0000 7f4862600640 1 -- 172.21.15.6:0/3356840983 learned_addr learned my addr 172.21.15.6:0/3356840983 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:30:00.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.783+0000 7f4861200640 1 --2- 172.21.15.6:0/3356840983 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f485c0add30 0x7f485c13ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.783+0000 7f4861c00640 1 --2- 172.21.15.6:0/3356840983 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f485c0ad960 0x7f485c0aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.783+0000 7f4862600640 1 -- 172.21.15.6:0/3356840983 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f485c0ad960 msgr2=0x7f485c0aa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.783+0000 7f4862600640 1 --2- 172.21.15.6:0/3356840983 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f485c0ad960 0x7f485c0aa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.783+0000 7f4862600640 1 -- 172.21.15.6:0/3356840983 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f485c0add30 msgr2=0x7f485c13ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.783+0000 7f4862600640 1 --2- 172.21.15.6:0/3356840983 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f485c0add30 0x7f485c13ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.783+0000 7f4862600640 1 -- 172.21.15.6:0/3356840983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4848009450 con 0x7f485c0ca050 2024-08-17T02:30:00.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.784+0000 7f4862600640 1 --2- 172.21.15.6:0/3356840983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c0ca050 0x7f485c153150 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f485400c860 tx=0x7f4854001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:00.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.784+0000 7f4858c00640 1 -- 172.21.15.6:0/3356840983 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485400ce50 con 0x7f485c0ca050 2024-08-17T02:30:00.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.784+0000 7f4858c00640 1 -- 172.21.15.6:0/3356840983 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485400a850 con 0x7f485c0ca050 2024-08-17T02:30:00.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.784+0000 7f4864600640 1 -- 172.21.15.6:0/3356840983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c0a9e50 con 0x7f485c0ca050 2024-08-17T02:30:00.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.784+0000 7f4858c00640 1 -- 172.21.15.6:0/3356840983 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485400ac10 con 0x7f485c0ca050 2024-08-17T02:30:00.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.784+0000 7f4864600640 1 -- 172.21.15.6:0/3356840983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c0aae70 con 0x7f485c0ca050 2024-08-17T02:30:00.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.785+0000 7f4864600640 1 -- 172.21.15.6:0/3356840983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c0aa610 con 0x7f485c0ca050 2024-08-17T02:30:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.786+0000 7f4858c00640 1 -- 172.21.15.6:0/3356840983 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4854012630 con 0x7f485c0ca050 2024-08-17T02:30:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.787+0000 7f4858c00640 1 --2- 172.21.15.6:0/3356840983 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f483c065150 0x7f483c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.787+0000 7f4858c00640 1 -- 172.21.15.6:0/3356840983 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f4854082340 con 0x7f485c0ca050 2024-08-17T02:30:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.787+0000 7f4861c00640 1 --2- 172.21.15.6:0/3356840983 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f483c065150 0x7f483c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.788+0000 7f4861c00640 1 --2- 172.21.15.6:0/3356840983 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f483c065150 0x7f483c067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f485000bbe0 tx=0x7f4850008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:00.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.791+0000 7f4858c00640 1 -- 172.21.15.6:0/3356840983 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4854050600 con 0x7f485c0ca050 2024-08-17T02:30:00.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.973+0000 7f4864600640 1 -- 172.21.15.6:0/3356840983 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f485c15b5e0 con 0x7f483c065150 2024-08-17T02:30:00.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.974+0000 7f4858c00640 1 -- 172.21.15.6:0/3356840983 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f485c15b5e0 con 0x7f483c065150 2024-08-17T02:30:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:30:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.976+0000 7f4864600640 1 -- 172.21.15.6:0/3356840983 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f483c065150 msgr2=0x7f483c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.976+0000 7f4864600640 1 --2- 172.21.15.6:0/3356840983 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f483c065150 0x7f483c067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f485000bbe0 tx=0x7f4850008040 comp rx=0 tx=0).stop 2024-08-17T02:30:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.976+0000 7f4864600640 1 -- 172.21.15.6:0/3356840983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c0ca050 msgr2=0x7f485c153150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.976+0000 7f4864600640 1 --2- 172.21.15.6:0/3356840983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c0ca050 0x7f485c153150 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f485400c860 tx=0x7f4854001690 comp rx=0 tx=0).stop 2024-08-17T02:30:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.976+0000 7f4864600640 1 -- 172.21.15.6:0/3356840983 shutdown_connections 2024-08-17T02:30:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.976+0000 7f4864600640 1 --2- 172.21.15.6:0/3356840983 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f483c065150 0x7f483c067600 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.976+0000 7f4864600640 1 --2- 172.21.15.6:0/3356840983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c0ca050 0x7f485c153150 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.976+0000 7f4864600640 1 --2- 172.21.15.6:0/3356840983 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f485c0add30 0x7f485c13ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.976+0000 7f4864600640 1 --2- 172.21.15.6:0/3356840983 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f485c0ad960 0x7f485c0aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.976+0000 7f4864600640 1 -- 172.21.15.6:0/3356840983 >> 172.21.15.6:0/3356840983 conn(0x7f485c066e60 msgr2=0x7f485c0b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:00.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.976+0000 7f4864600640 1 -- 172.21.15.6:0/3356840983 shutdown_connections 2024-08-17T02:30:00.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:00.976+0000 7f4864600640 1 -- 172.21.15.6:0/3356840983 wait complete. 2024-08-17T02:30:00.992 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:30:00.992 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:01.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.146+0000 7f1a67a00640 1 Processor -- start 2024-08-17T02:30:01.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.146+0000 7f1a67a00640 1 -- start start 2024-08-17T02:30:01.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.147+0000 7f1a67a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1a601585b0 0x7f1a60161ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.147+0000 7f1a67a00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a600aedb0 con 0x7f1a600b1400 2024-08-17T02:30:01.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.147+0000 7f1a67a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a600ae1a0 con 0x7f1a600b3650 2024-08-17T02:30:01.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.147+0000 7f1a67a00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a600ae480 con 0x7f1a601585b0 2024-08-17T02:30:01.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.148+0000 7f1a65000640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1a600b1400 0x7f1a600b17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46392/0 (socket says 172.21.15.6:46392) 2024-08-17T02:30:01.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.148+0000 7f1a65000640 1 -- 172.21.15.6:0/4138904493 learned_addr learned my addr 172.21.15.6:0/4138904493 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:30:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.148+0000 7f1a65a00640 1 --2- 172.21.15.6:0/4138904493 >> v2:172.21.15.136:3300/0 conn(0x7f1a601585b0 0x7f1a60161ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.148+0000 7f1a5f400640 1 -- 172.21.15.6:0/4138904493 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401191032 0 0) 0x7f1a600aedb0 con 0x7f1a600b1400 2024-08-17T02:30:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.148+0000 7f1a5f400640 1 -- 172.21.15.6:0/4138904493 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a480034e0 con 0x7f1a600b1400 2024-08-17T02:30:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.148+0000 7f1a5f400640 1 -- 172.21.15.6:0/4138904493 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436475851 0 0) 0x7f1a600ae1a0 con 0x7f1a600b3650 2024-08-17T02:30:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.148+0000 7f1a5f400640 1 -- 172.21.15.6:0/4138904493 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a600aedb0 con 0x7f1a600b3650 2024-08-17T02:30:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.148+0000 7f1a5f400640 1 -- 172.21.15.6:0/4138904493 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1300226709 0 0) 0x7f1a480034e0 con 0x7f1a600b1400 2024-08-17T02:30:01.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.148+0000 7f1a5f400640 1 -- 172.21.15.6:0/4138904493 >> v2:172.21.15.136:3300/0 conn(0x7f1a601585b0 msgr2=0x7f1a60161ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:01.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.148+0000 7f1a5f400640 1 --2- 172.21.15.6:0/4138904493 >> v2:172.21.15.136:3300/0 conn(0x7f1a601585b0 0x7f1a60161ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.148+0000 7f1a5f400640 1 -- 172.21.15.6:0/4138904493 >> v1:172.21.15.136:6789/0 conn(0x7f1a600b3650 legacy=0x7f1a601567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.148+0000 7f1a5f400640 1 -- 172.21.15.6:0/4138904493 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a600ae760 con 0x7f1a600b1400 2024-08-17T02:30:01.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.148+0000 7f1a5f400640 1 -- 172.21.15.6:0/4138904493 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 191760825 0 0) 0x7f1a54001470 con 0x7f1a600b1400 2024-08-17T02:30:01.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.148+0000 7f1a5f400640 1 -- 172.21.15.6:0/4138904493 >> v1:172.21.15.6:6789/0 conn(0x7f1a600b1400 legacy=0x7f1a600b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.149+0000 7f1a5f400640 1 --2- 172.21.15.6:0/4138904493 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1a48003bb0 0x7f1a48003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.149+0000 7f1a5f400640 1 --2- 172.21.15.6:0/4138904493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a48004780 0x7f1a48004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.149+0000 7f1a5f400640 1 --2- 172.21.15.6:0/4138904493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a48005180 0x7f1a4800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.149+0000 7f1a5f400640 1 -- 172.21.15.6:0/4138904493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600ae480 con 0x7f1a48004780 2024-08-17T02:30:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.149+0000 7f1a5f400640 1 -- 172.21.15.6:0/4138904493 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4800c0a0 con 0x7f1a48005180 2024-08-17T02:30:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.149+0000 7f1a5f400640 1 -- 172.21.15.6:0/4138904493 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4800c230 con 0x7f1a48003bb0 2024-08-17T02:30:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.149+0000 7f1a5fe00640 1 --2- 172.21.15.6:0/4138904493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a48004780 0x7f1a48004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.149+0000 7f1a65000640 1 --2- 172.21.15.6:0/4138904493 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1a48003bb0 0x7f1a48003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.149+0000 7f1a65a00640 1 --2- 172.21.15.6:0/4138904493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a48005180 0x7f1a4800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.149+0000 7f1a5fe00640 1 -- 172.21.15.6:0/4138904493 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1a48003bb0 msgr2=0x7f1a48003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:01.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.149+0000 7f1a5fe00640 1 --2- 172.21.15.6:0/4138904493 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1a48003bb0 0x7f1a48003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.149+0000 7f1a5fe00640 1 -- 172.21.15.6:0/4138904493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a48005180 msgr2=0x7f1a4800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:01.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.149+0000 7f1a5fe00640 1 --2- 172.21.15.6:0/4138904493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a48005180 0x7f1a4800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.149+0000 7f1a5fe00640 1 -- 172.21.15.6:0/4138904493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a480034e0 con 0x7f1a48004780 2024-08-17T02:30:01.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.149+0000 7f1a65a00640 1 -- 172.21.15.6:0/4138904493 reap_dead start 2024-08-17T02:30:01.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.150+0000 7f1a5fe00640 1 --2- 172.21.15.6:0/4138904493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a48004780 0x7f1a48004bf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c001990 tx=0x7f1a4c007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f19068bcb96f09d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:01.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.151+0000 7f1a5f400640 1 -- 172.21.15.6:0/4138904493 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c02a9f0 con 0x7f1a48004780 2024-08-17T02:30:01.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.151+0000 7f1a5f400640 1 -- 172.21.15.6:0/4138904493 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c02ab50 con 0x7f1a48004780 2024-08-17T02:30:01.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.151+0000 7f1a5f400640 1 -- 172.21.15.6:0/4138904493 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0323f0 con 0x7f1a48004780 2024-08-17T02:30:01.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.151+0000 7f1a67a00640 1 -- 172.21.15.6:0/4138904493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a48004780 msgr2=0x7f1a48004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.151+0000 7f1a67a00640 1 --2- 172.21.15.6:0/4138904493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a48004780 0x7f1a48004bf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c001990 tx=0x7f1a4c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.151+0000 7f1a67a00640 1 -- 172.21.15.6:0/4138904493 shutdown_connections 2024-08-17T02:30:01.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.151+0000 7f1a67a00640 1 --2- 172.21.15.6:0/4138904493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a48004780 0x7f1a48004bf0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.151+0000 7f1a67a00640 1 -- 172.21.15.6:0/4138904493 >> 172.21.15.6:0/4138904493 conn(0x7f1a600ce5e0 msgr2=0x7f1a60095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:01.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.151+0000 7f1a67a00640 1 -- 172.21.15.6:0/4138904493 shutdown_connections 2024-08-17T02:30:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.151+0000 7f1a67a00640 1 -- 172.21.15.6:0/4138904493 wait complete. 2024-08-17T02:30:01.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.153+0000 7f1a67a00640 1 Processor -- start 2024-08-17T02:30:01.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.153+0000 7f1a67a00640 1 -- start start 2024-08-17T02:30:01.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.154+0000 7f1a67a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a48004780 0x7f1a60155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.154+0000 7f1a67a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a600c80a0 0x7f1a6009aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.154+0000 7f1a67a00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1a6009aff0 0x7f1a600ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.154+0000 7f1a67a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600c9490 con 0x7f1a600c80a0 2024-08-17T02:30:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.154+0000 7f1a67a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600c8880 con 0x7f1a48004780 2024-08-17T02:30:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.154+0000 7f1a67a00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600c8b60 con 0x7f1a6009aff0 2024-08-17T02:30:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.154+0000 7f1a5fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a600c80a0 0x7f1a6009aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.154+0000 7f1a5fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a600c80a0 0x7f1a6009aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52078/0 (socket says 172.21.15.6:52078) 2024-08-17T02:30:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.154+0000 7f1a5fe00640 1 -- 172.21.15.6:0/3604547849 learned_addr learned my addr 172.21.15.6:0/3604547849 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:30:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.154+0000 7f1a65000640 1 --2- 172.21.15.6:0/3604547849 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a48004780 0x7f1a60155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.154+0000 7f1a65a00640 1 --2- 172.21.15.6:0/3604547849 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1a6009aff0 0x7f1a600ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.155+0000 7f1a5fe00640 1 -- 172.21.15.6:0/3604547849 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1a6009aff0 msgr2=0x7f1a600ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.155+0000 7f1a5fe00640 1 --2- 172.21.15.6:0/3604547849 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1a6009aff0 0x7f1a600ac290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.155+0000 7f1a5fe00640 1 -- 172.21.15.6:0/3604547849 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a48004780 msgr2=0x7f1a60155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.155+0000 7f1a5fe00640 1 --2- 172.21.15.6:0/3604547849 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a48004780 0x7f1a60155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.155+0000 7f1a5fe00640 1 -- 172.21.15.6:0/3604547849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a600c8e40 con 0x7f1a600c80a0 2024-08-17T02:30:01.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.155+0000 7f1a5fe00640 1 --2- 172.21.15.6:0/3604547849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a600c80a0 0x7f1a6009aab0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c000c00 tx=0x7f1a4c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:01.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.155+0000 7f1a53e00640 1 -- 172.21.15.6:0/3604547849 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c033e80 con 0x7f1a600c80a0 2024-08-17T02:30:01.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.155+0000 7f1a53e00640 1 -- 172.21.15.6:0/3604547849 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c03d470 con 0x7f1a600c80a0 2024-08-17T02:30:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.155+0000 7f1a53e00640 1 -- 172.21.15.6:0/3604547849 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c03d830 con 0x7f1a600c80a0 2024-08-17T02:30:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.155+0000 7f1a67a00640 1 -- 172.21.15.6:0/3604547849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a600c9120 con 0x7f1a600c80a0 2024-08-17T02:30:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.156+0000 7f1a67a00640 1 -- 172.21.15.6:0/3604547849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a60142770 con 0x7f1a600c80a0 2024-08-17T02:30:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.156+0000 7f1a67a00640 1 -- 172.21.15.6:0/3604547849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a60142960 con 0x7f1a600c80a0 2024-08-17T02:30:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.157+0000 7f1a53e00640 1 -- 172.21.15.6:0/3604547849 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1a4c03dbe0 con 0x7f1a600c80a0 2024-08-17T02:30:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.158+0000 7f1a53e00640 1 --2- 172.21.15.6:0/3604547849 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1a40065150 0x7f1a40067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.158+0000 7f1a53e00640 1 -- 172.21.15.6:0/3604547849 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1a4c0a2a70 con 0x7f1a600c80a0 2024-08-17T02:30:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.158+0000 7f1a53e00640 1 --2- 172.21.15.6:0/3604547849 >> [v2:172.21.15.136:6816/37292,v1:172.21.15.136:6818/37292] conn(0x7f1a4006b040 0x7f1a4006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.158+0000 7f1a53e00640 1 -- 172.21.15.6:0/3604547849 --> [v2:172.21.15.136:6816/37292,v1:172.21.15.136:6818/37292] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a4006db00 con 0x7f1a4006b040 2024-08-17T02:30:01.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.158+0000 7f1a53e00640 1 -- 172.21.15.6:0/3604547849 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a4c0a7220 con 0x7f1a600c80a0 2024-08-17T02:30:01.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.158+0000 7f1a65000640 1 --2- 172.21.15.6:0/3604547849 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1a40065150 0x7f1a40067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.159+0000 7f1a65a00640 1 --2- 172.21.15.6:0/3604547849 >> [v2:172.21.15.136:6816/37292,v1:172.21.15.136:6818/37292] conn(0x7f1a4006b040 0x7f1a4006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.159+0000 7f1a65000640 1 --2- 172.21.15.6:0/3604547849 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1a40065150 0x7f1a40067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1a540015a0 tx=0x7f1a600aed20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:01.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.159+0000 7f1a65a00640 1 --2- 172.21.15.6:0/3604547849 >> [v2:172.21.15.136:6816/37292,v1:172.21.15.136:6818/37292] conn(0x7f1a4006b040 0x7f1a4006d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:01.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.160+0000 7f1a53e00640 1 -- 172.21.15.6:0/3604547849 <== osd.6 v2:172.21.15.136:6816/37292 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f1a4006db00 con 0x7f1a4006b040 2024-08-17T02:30:01.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.173+0000 7f1a67a00640 1 -- 172.21.15.6:0/3604547849 --> [v2:172.21.15.136:6816/37292,v1:172.21.15.136:6818/37292] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1a60142770 con 0x7f1a4006b040 2024-08-17T02:30:01.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.174+0000 7f1a53e00640 1 -- 172.21.15.6:0/3604547849 <== osd.6 v2:172.21.15.136:6816/37292 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1a60142770 con 0x7f1a4006b040 2024-08-17T02:30:01.175 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-08-17T02:30:01.175 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:01.175 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-08-17T02:30:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.174+0000 7f1a67a00640 1 -- 172.21.15.6:0/3604547849 >> [v2:172.21.15.136:6816/37292,v1:172.21.15.136:6818/37292] conn(0x7f1a4006b040 msgr2=0x7f1a4006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.174+0000 7f1a67a00640 1 --2- 172.21.15.6:0/3604547849 >> [v2:172.21.15.136:6816/37292,v1:172.21.15.136:6818/37292] conn(0x7f1a4006b040 0x7f1a4006d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.174+0000 7f1a67a00640 1 -- 172.21.15.6:0/3604547849 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1a40065150 msgr2=0x7f1a40067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.174+0000 7f1a67a00640 1 --2- 172.21.15.6:0/3604547849 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f1a40065150 0x7f1a40067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1a540015a0 tx=0x7f1a600aed20 comp rx=0 tx=0).stop 2024-08-17T02:30:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.174+0000 7f1a67a00640 1 -- 172.21.15.6:0/3604547849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a600c80a0 msgr2=0x7f1a6009aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.174+0000 7f1a67a00640 1 --2- 172.21.15.6:0/3604547849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a600c80a0 0x7f1a6009aab0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c000c00 tx=0x7f1a4c003000 comp rx=0 tx=0).stop 2024-08-17T02:30:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.175+0000 7f1a65a00640 1 -- 172.21.15.6:0/3604547849 reap_dead start 2024-08-17T02:30:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.175+0000 7f1a67a00640 1 -- 172.21.15.6:0/3604547849 shutdown_connections 2024-08-17T02:30:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.175+0000 7f1a67a00640 1 -- 172.21.15.6:0/3604547849 >> 172.21.15.6:0/3604547849 conn(0x7f1a600ce5e0 msgr2=0x7f1a600af280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.175+0000 7f1a67a00640 1 -- 172.21.15.6:0/3604547849 shutdown_connections 2024-08-17T02:30:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.175+0000 7f1a67a00640 1 -- 172.21.15.6:0/3604547849 wait complete. 2024-08-17T02:30:01.189 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:30:01.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.341+0000 7fdcb4400640 1 Processor -- start 2024-08-17T02:30:01.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.341+0000 7fdcb4400640 1 -- start start 2024-08-17T02:30:01.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.342+0000 7fdcb4400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdcac155040 0x7fdcac158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.342+0000 7fdcb4400640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdcac1591c0 0x7fdcac06e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.342+0000 7fdcb4400640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcac0aeeb0 con 0x7fdcac06e5a0 2024-08-17T02:30:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.342+0000 7fdcb4400640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac159610 con 0x7fdcac1591c0 2024-08-17T02:30:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.342+0000 7fdcb4400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac06dee0 con 0x7fdcac155040 2024-08-17T02:30:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.343+0000 7fdcb1000640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdcac1591c0 0x7fdcac06e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.343+0000 7fdcb2400640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdcac06e5a0 0x7fdcac06d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46394/0 (socket says 172.21.15.6:46394) 2024-08-17T02:30:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.343+0000 7fdcb2400640 1 -- 172.21.15.6:0/1997567940 learned_addr learned my addr 172.21.15.6:0/1997567940 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:30:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.343+0000 7fdcb1a00640 1 --2- 172.21.15.6:0/1997567940 >> v2:172.21.15.136:3300/0 conn(0x7fdcac155040 0x7fdcac158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.343+0000 7fdcb1000640 1 -- 172.21.15.6:0/1997567940 >> v2:172.21.15.136:3300/0 conn(0x7fdcac155040 msgr2=0x7fdcac158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.343+0000 7fdcb1000640 1 --2- 172.21.15.6:0/1997567940 >> v2:172.21.15.136:3300/0 conn(0x7fdcac155040 0x7fdcac158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.343+0000 7fdcb1000640 1 -- 172.21.15.6:0/1997567940 >> v1:172.21.15.6:6789/0 conn(0x7fdcac06e5a0 legacy=0x7fdcac06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.343+0000 7fdcb1000640 1 -- 172.21.15.6:0/1997567940 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac0aadd0 con 0x7fdcac1591c0 2024-08-17T02:30:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.344+0000 7fdcb1000640 1 --2- 172.21.15.6:0/1997567940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac1591c0 0x7fdcac06e060 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdcac06c660 tx=0x7fdc980090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721c79118e30b0da server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.344+0000 7fdcabe00640 1 -- 172.21.15.6:0/1997567940 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9802ac70 con 0x7fdcac1591c0 2024-08-17T02:30:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.344+0000 7fdcabe00640 1 -- 172.21.15.6:0/1997567940 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9802add0 con 0x7fdcac1591c0 2024-08-17T02:30:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.345+0000 7fdcabe00640 1 -- 172.21.15.6:0/1997567940 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98032670 con 0x7fdcac1591c0 2024-08-17T02:30:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.345+0000 7fdcb4400640 1 -- 172.21.15.6:0/1997567940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac1591c0 msgr2=0x7fdcac06e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.345+0000 7fdcb4400640 1 --2- 172.21.15.6:0/1997567940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac1591c0 0x7fdcac06e060 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdcac06c660 tx=0x7fdc980090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.345+0000 7fdcb4400640 1 -- 172.21.15.6:0/1997567940 shutdown_connections 2024-08-17T02:30:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.345+0000 7fdcb4400640 1 --2- 172.21.15.6:0/1997567940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac1591c0 0x7fdcac06e060 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.345+0000 7fdcb4400640 1 --2- 172.21.15.6:0/1997567940 >> v2:172.21.15.136:3300/0 conn(0x7fdcac155040 0x7fdcac158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.345+0000 7fdcb4400640 1 -- 172.21.15.6:0/1997567940 >> 172.21.15.6:0/1997567940 conn(0x7fdcac066e60 msgr2=0x7fdcac067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.345+0000 7fdcb4400640 1 -- 172.21.15.6:0/1997567940 shutdown_connections 2024-08-17T02:30:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.345+0000 7fdcb4400640 1 -- 172.21.15.6:0/1997567940 wait complete. 2024-08-17T02:30:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.346+0000 7fdcb4400640 1 Processor -- start 2024-08-17T02:30:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.347+0000 7fdcb4400640 1 -- start start 2024-08-17T02:30:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.347+0000 7fdcb4400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdcac06e5a0 0x7fdcac151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.347+0000 7fdcb4400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcac155040 0x7fdcac13db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.347+0000 7fdcb4400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac1591c0 0x7fdcac1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.347+0000 7fdcb4400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0a4830 con 0x7fdcac1591c0 2024-08-17T02:30:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.347+0000 7fdcb4400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac15d750 con 0x7fdcac155040 2024-08-17T02:30:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.348+0000 7fdcb4400640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac15cb40 con 0x7fdcac06e5a0 2024-08-17T02:30:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.348+0000 7fdcb2400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac1591c0 0x7fdcac1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.348+0000 7fdcb2400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac1591c0 0x7fdcac1579e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52096/0 (socket says 172.21.15.6:52096) 2024-08-17T02:30:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.348+0000 7fdcb2400640 1 -- 172.21.15.6:0/2593187746 learned_addr learned my addr 172.21.15.6:0/2593187746 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:30:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.348+0000 7fdcb1a00640 1 --2- 172.21.15.6:0/2593187746 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdcac06e5a0 0x7fdcac151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.348+0000 7fdcb1000640 1 --2- 172.21.15.6:0/2593187746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcac155040 0x7fdcac13db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.348+0000 7fdcb2400640 1 -- 172.21.15.6:0/2593187746 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdcac06e5a0 msgr2=0x7fdcac151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.348+0000 7fdcb2400640 1 --2- 172.21.15.6:0/2593187746 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdcac06e5a0 0x7fdcac151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.348+0000 7fdcb2400640 1 -- 172.21.15.6:0/2593187746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcac155040 msgr2=0x7fdcac13db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.348+0000 7fdcb2400640 1 --2- 172.21.15.6:0/2593187746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcac155040 0x7fdcac13db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.348+0000 7fdcb2400640 1 -- 172.21.15.6:0/2593187746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc98009390 con 0x7fdcac1591c0 2024-08-17T02:30:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.349+0000 7fdcb2400640 1 --2- 172.21.15.6:0/2593187746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac1591c0 0x7fdcac1579e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fdca400cbf0 tx=0x7fdca40019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:01.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.349+0000 7fdca8c00640 1 -- 172.21.15.6:0/2593187746 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca400ce10 con 0x7fdcac1591c0 2024-08-17T02:30:01.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.349+0000 7fdca8c00640 1 -- 172.21.15.6:0/2593187746 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca400a850 con 0x7fdcac1591c0 2024-08-17T02:30:01.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.349+0000 7fdca8c00640 1 -- 172.21.15.6:0/2593187746 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca400abd0 con 0x7fdcac1591c0 2024-08-17T02:30:01.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.349+0000 7fdcb4400640 1 -- 172.21.15.6:0/2593187746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcac15ce20 con 0x7fdcac1591c0 2024-08-17T02:30:01.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.349+0000 7fdcb4400640 1 -- 172.21.15.6:0/2593187746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcac15d3e0 con 0x7fdcac1591c0 2024-08-17T02:30:01.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.350+0000 7fdcb4400640 1 -- 172.21.15.6:0/2593187746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcac15d8e0 con 0x7fdcac1591c0 2024-08-17T02:30:01.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.351+0000 7fdca8c00640 1 -- 172.21.15.6:0/2593187746 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdca40070f0 con 0x7fdcac1591c0 2024-08-17T02:30:01.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.352+0000 7fdca8c00640 1 --2- 172.21.15.6:0/2593187746 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fdc8c065150 0x7fdc8c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.352+0000 7fdca8c00640 1 -- 172.21.15.6:0/2593187746 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fdca40822c0 con 0x7fdcac1591c0 2024-08-17T02:30:01.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.352+0000 7fdcb1a00640 1 --2- 172.21.15.6:0/2593187746 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fdc8c065150 0x7fdc8c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.353+0000 7fdcb1a00640 1 --2- 172.21.15.6:0/2593187746 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fdc8c065150 0x7fdc8c067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdca0007ba0 tx=0x7fdca0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.355+0000 7fdca8c00640 1 -- 172.21.15.6:0/2593187746 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdca40506e0 con 0x7fdcac1591c0 2024-08-17T02:30:01.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.537+0000 7fdcb4400640 1 -- 172.21.15.6:0/2593187746 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcac063fb0 con 0x7fdc8c065150 2024-08-17T02:30:01.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.538+0000 7fdca8c00640 1 -- 172.21.15.6:0/2593187746 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdcac063fb0 con 0x7fdc8c065150 2024-08-17T02:30:01.539 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:30:01.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.541+0000 7fdcb4400640 1 -- 172.21.15.6:0/2593187746 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fdc8c065150 msgr2=0x7fdc8c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.541+0000 7fdcb4400640 1 --2- 172.21.15.6:0/2593187746 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fdc8c065150 0x7fdc8c067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdca0007ba0 tx=0x7fdca0008040 comp rx=0 tx=0).stop 2024-08-17T02:30:01.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.541+0000 7fdcb4400640 1 -- 172.21.15.6:0/2593187746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac1591c0 msgr2=0x7fdcac1579e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.541+0000 7fdcb4400640 1 --2- 172.21.15.6:0/2593187746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac1591c0 0x7fdcac1579e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fdca400cbf0 tx=0x7fdca40019c0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.541+0000 7fdcb4400640 1 -- 172.21.15.6:0/2593187746 shutdown_connections 2024-08-17T02:30:01.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.541+0000 7fdcb4400640 1 --2- 172.21.15.6:0/2593187746 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fdc8c065150 0x7fdc8c067600 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.541+0000 7fdcb4400640 1 --2- 172.21.15.6:0/2593187746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac1591c0 0x7fdcac1579e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.541+0000 7fdcb4400640 1 --2- 172.21.15.6:0/2593187746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcac155040 0x7fdcac13db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.541+0000 7fdcb4400640 1 --2- 172.21.15.6:0/2593187746 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdcac06e5a0 0x7fdcac151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.541+0000 7fdcb4400640 1 -- 172.21.15.6:0/2593187746 >> 172.21.15.6:0/2593187746 conn(0x7fdcac066e60 msgr2=0x7fdcac0ab020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:01.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.541+0000 7fdcb4400640 1 -- 172.21.15.6:0/2593187746 shutdown_connections 2024-08-17T02:30:01.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.541+0000 7fdcb4400640 1 -- 172.21.15.6:0/2593187746 wait complete. 2024-08-17T02:30:01.557 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:30:01.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:01.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.711+0000 7f65ac600640 1 Processor -- start 2024-08-17T02:30:01.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.711+0000 7f65ac600640 1 -- start start 2024-08-17T02:30:01.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.712+0000 7f65ac600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f65a40ad020 0x7f65a4159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.712+0000 7f65ac600640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a4159ad0 con 0x7f65a40ac000 2024-08-17T02:30:01.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.712+0000 7f65ac600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a40ad590 con 0x7f65a40afa00 2024-08-17T02:30:01.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.712+0000 7f65ac600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a40ad870 con 0x7f65a40ad020 2024-08-17T02:30:01.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.712+0000 7f65a9200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f65a40ad020 0x7f65a4159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.712+0000 7f65a9c00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f65a40ac000 0x7f65a4156a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46410/0 (socket says 172.21.15.6:46410) 2024-08-17T02:30:01.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.713+0000 7f65a9c00640 1 -- 172.21.15.6:0/4075793923 learned_addr learned my addr 172.21.15.6:0/4075793923 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:30:01.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.713+0000 7f65a9200640 1 -- 172.21.15.6:0/4075793923 >> v1:172.21.15.136:6789/0 conn(0x7f65a40afa00 legacy=0x7f65a40afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:01.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.713+0000 7f65a9200640 1 -- 172.21.15.6:0/4075793923 >> v1:172.21.15.6:6789/0 conn(0x7f65a40ac000 legacy=0x7f65a4156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.713+0000 7f65a9200640 1 -- 172.21.15.6:0/4075793923 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a40adb50 con 0x7f65a40ad020 2024-08-17T02:30:01.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.713+0000 7f65a3e00640 1 -- 172.21.15.6:0/4075793923 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541577221 0 0) 0x7f65a4159ad0 con 0x7f65a40ac000 2024-08-17T02:30:01.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.714+0000 7f65a9200640 1 --2- 172.21.15.6:0/4075793923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65a40ad020 0x7f65a4159f60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6590009850 tx=0x7f65900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc5f81bff316171 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:01.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.714+0000 7f65a3e00640 1 -- 172.21.15.6:0/4075793923 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659002ad00 con 0x7f65a40ad020 2024-08-17T02:30:01.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.714+0000 7f65a3e00640 1 -- 172.21.15.6:0/4075793923 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659002ae60 con 0x7f65a40ad020 2024-08-17T02:30:01.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.714+0000 7f65a3e00640 1 -- 172.21.15.6:0/4075793923 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6590032670 con 0x7f65a40ad020 2024-08-17T02:30:01.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.715+0000 7f65ac600640 1 -- 172.21.15.6:0/4075793923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65a40ad020 msgr2=0x7f65a4159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.715+0000 7f65ac600640 1 --2- 172.21.15.6:0/4075793923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65a40ad020 0x7f65a4159f60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6590009850 tx=0x7f65900090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.715+0000 7f65ac600640 1 -- 172.21.15.6:0/4075793923 shutdown_connections 2024-08-17T02:30:01.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.715+0000 7f65ac600640 1 --2- 172.21.15.6:0/4075793923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65a40ad020 0x7f65a4159f60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.715+0000 7f65ac600640 1 -- 172.21.15.6:0/4075793923 >> 172.21.15.6:0/4075793923 conn(0x7f65a4066e60 msgr2=0x7f65a4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:01.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.715+0000 7f65ac600640 1 -- 172.21.15.6:0/4075793923 shutdown_connections 2024-08-17T02:30:01.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.715+0000 7f65ac600640 1 -- 172.21.15.6:0/4075793923 wait complete. 2024-08-17T02:30:01.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.716+0000 7f65ac600640 1 Processor -- start 2024-08-17T02:30:01.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.716+0000 7f65ac600640 1 -- start start 2024-08-17T02:30:01.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.717+0000 7f65ac600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65a40ac000 0x7f65a40cab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.717+0000 7f65ac600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65a40ad020 0x7f65a41691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.717+0000 7f65ac600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65a40afa00 0x7f65a4158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.717+0000 7f65ac600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a4169720 con 0x7f65a40ac000 2024-08-17T02:30:01.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.717+0000 7f65ac600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a41699f0 con 0x7f65a40ad020 2024-08-17T02:30:01.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.717+0000 7f65ac600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a4169cd0 con 0x7f65a40afa00 2024-08-17T02:30:01.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.718+0000 7f65a9c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65a40ac000 0x7f65a40cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.718+0000 7f65a9c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65a40ac000 0x7f65a40cab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52120/0 (socket says 172.21.15.6:52120) 2024-08-17T02:30:01.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.718+0000 7f65a9c00640 1 -- 172.21.15.6:0/3984315575 learned_addr learned my addr 172.21.15.6:0/3984315575 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:30:01.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.718+0000 7f65a9200640 1 --2- 172.21.15.6:0/3984315575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65a40ad020 0x7f65a41691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.718+0000 7f65aa600640 1 --2- 172.21.15.6:0/3984315575 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65a40afa00 0x7f65a4158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.718+0000 7f65a9c00640 1 -- 172.21.15.6:0/3984315575 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65a40afa00 msgr2=0x7f65a4158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.718+0000 7f65a9c00640 1 --2- 172.21.15.6:0/3984315575 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65a40afa00 0x7f65a4158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.718+0000 7f65a9c00640 1 -- 172.21.15.6:0/3984315575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65a40ad020 msgr2=0x7f65a41691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.718+0000 7f65a9c00640 1 --2- 172.21.15.6:0/3984315575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65a40ad020 0x7f65a41691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.718+0000 7f65a9c00640 1 -- 172.21.15.6:0/3984315575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6590009390 con 0x7f65a40ac000 2024-08-17T02:30:01.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.718+0000 7f65a9c00640 1 --2- 172.21.15.6:0/3984315575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65a40ac000 0x7f65a40cab50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f659800c510 tx=0x7f659800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:01.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.719+0000 7f65a0c00640 1 -- 172.21.15.6:0/3984315575 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6598005aa0 con 0x7f65a40ac000 2024-08-17T02:30:01.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.719+0000 7f65a0c00640 1 -- 172.21.15.6:0/3984315575 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6598005c00 con 0x7f65a40ac000 2024-08-17T02:30:01.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.719+0000 7f65a0c00640 1 -- 172.21.15.6:0/3984315575 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65980070d0 con 0x7f65a40ac000 2024-08-17T02:30:01.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.719+0000 7f65ac600640 1 -- 172.21.15.6:0/3984315575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a4169fb0 con 0x7f65a40ac000 2024-08-17T02:30:01.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.719+0000 7f65ac600640 1 -- 172.21.15.6:0/3984315575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a4158740 con 0x7f65a40ac000 2024-08-17T02:30:01.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.720+0000 7f65ac600640 1 -- 172.21.15.6:0/3984315575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f65a416a1f0 con 0x7f65a40ac000 2024-08-17T02:30:01.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.721+0000 7f65a0c00640 1 -- 172.21.15.6:0/3984315575 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6598007500 con 0x7f65a40ac000 2024-08-17T02:30:01.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.721+0000 7f65a0c00640 1 --2- 172.21.15.6:0/3984315575 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6584065150 0x7f6584067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.721+0000 7f65a0c00640 1 -- 172.21.15.6:0/3984315575 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6598081740 con 0x7f65a40ac000 2024-08-17T02:30:01.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.722+0000 7f65a0c00640 1 --2- 172.21.15.6:0/3984315575 >> [v2:172.21.15.136:6817/37309,v1:172.21.15.136:6819/37309] conn(0x7f658406b040 0x7f658406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.722+0000 7f65a0c00640 1 -- 172.21.15.6:0/3984315575 --> [v2:172.21.15.136:6817/37309,v1:172.21.15.136:6819/37309] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f658406db00 con 0x7f658406b040 2024-08-17T02:30:01.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.722+0000 7f65a0c00640 1 -- 172.21.15.6:0/3984315575 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6598083ca0 con 0x7f65a40ac000 2024-08-17T02:30:01.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.722+0000 7f65a9200640 1 --2- 172.21.15.6:0/3984315575 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6584065150 0x7f6584067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.722+0000 7f65aa600640 1 --2- 172.21.15.6:0/3984315575 >> [v2:172.21.15.136:6817/37309,v1:172.21.15.136:6819/37309] conn(0x7f658406b040 0x7f658406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.723+0000 7f65aa600640 1 --2- 172.21.15.6:0/3984315575 >> [v2:172.21.15.136:6817/37309,v1:172.21.15.136:6819/37309] conn(0x7f658406b040 0x7f658406d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:01.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.723+0000 7f65a9200640 1 --2- 172.21.15.6:0/3984315575 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6584065150 0x7f6584067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6590034000 tx=0x7f6590032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:01.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.724+0000 7f65a0c00640 1 -- 172.21.15.6:0/3984315575 <== osd.7 v2:172.21.15.136:6817/37309 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f658406db00 con 0x7f658406b040 2024-08-17T02:30:01.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.736+0000 7f65ac600640 1 -- 172.21.15.6:0/3984315575 --> [v2:172.21.15.136:6817/37309,v1:172.21.15.136:6819/37309] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f65a40c8e90 con 0x7f658406b040 2024-08-17T02:30:01.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.737+0000 7f65a0c00640 1 -- 172.21.15.6:0/3984315575 <== osd.7 v2:172.21.15.136:6817/37309 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f65a40c8e90 con 0x7f658406b040 2024-08-17T02:30:01.738 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-08-17T02:30:01.738 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:01.738 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-08-17T02:30:01.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.737+0000 7f65ac600640 1 -- 172.21.15.6:0/3984315575 >> [v2:172.21.15.136:6817/37309,v1:172.21.15.136:6819/37309] conn(0x7f658406b040 msgr2=0x7f658406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.737+0000 7f65ac600640 1 --2- 172.21.15.6:0/3984315575 >> [v2:172.21.15.136:6817/37309,v1:172.21.15.136:6819/37309] conn(0x7f658406b040 0x7f658406d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.738+0000 7f65ac600640 1 -- 172.21.15.6:0/3984315575 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6584065150 msgr2=0x7f6584067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.738+0000 7f65ac600640 1 --2- 172.21.15.6:0/3984315575 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f6584065150 0x7f6584067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6590034000 tx=0x7f6590032000 comp rx=0 tx=0).stop 2024-08-17T02:30:01.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.738+0000 7f65ac600640 1 -- 172.21.15.6:0/3984315575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65a40ac000 msgr2=0x7f65a40cab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.738+0000 7f65ac600640 1 --2- 172.21.15.6:0/3984315575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65a40ac000 0x7f65a40cab50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f659800c510 tx=0x7f659800c910 comp rx=0 tx=0).stop 2024-08-17T02:30:01.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.738+0000 7f65aa600640 1 -- 172.21.15.6:0/3984315575 reap_dead start 2024-08-17T02:30:01.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.738+0000 7f65ac600640 1 -- 172.21.15.6:0/3984315575 shutdown_connections 2024-08-17T02:30:01.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.738+0000 7f65ac600640 1 -- 172.21.15.6:0/3984315575 >> 172.21.15.6:0/3984315575 conn(0x7f65a4066e60 msgr2=0x7f65a4155fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:01.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.738+0000 7f65ac600640 1 -- 172.21.15.6:0/3984315575 shutdown_connections 2024-08-17T02:30:01.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.738+0000 7f65ac600640 1 -- 172.21.15.6:0/3984315575 wait complete. 2024-08-17T02:30:01.752 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:30:01.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.905+0000 7f9be0600640 1 Processor -- start 2024-08-17T02:30:01.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.905+0000 7f9be0600640 1 -- start start 2024-08-17T02:30:01.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.906+0000 7f9be0600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9bd80ad960 0x7f9bd815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.906+0000 7f9be0600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9bd80ca050 0x7f9bd8156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.906+0000 7f9be0600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd815b5e0 con 0x7f9bd80add30 2024-08-17T02:30:01.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.906+0000 7f9be0600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd80cb160 con 0x7f9bd80ca050 2024-08-17T02:30:01.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.906+0000 7f9be0600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd80b0d10 con 0x7f9bd80ad960 2024-08-17T02:30:01.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.906+0000 7f9bdd200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9bd80ca050 0x7f9bd8156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.907+0000 7f9bdd200640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9bd80ca050 0x7f9bd8156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52136/0 (socket says 172.21.15.6:52136) 2024-08-17T02:30:01.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.907+0000 7f9bdd200640 1 -- 172.21.15.6:0/1546389058 learned_addr learned my addr 172.21.15.6:0/1546389058 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:30:01.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.907+0000 7f9bddc00640 1 --2- 172.21.15.6:0/1546389058 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9bd80ad960 0x7f9bd815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.907+0000 7f9bdd200640 1 -- 172.21.15.6:0/1546389058 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9bd80ad960 msgr2=0x7f9bd815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:01.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.907+0000 7f9bdd200640 1 --2- 172.21.15.6:0/1546389058 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9bd80ad960 0x7f9bd815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.907+0000 7f9bdd200640 1 -- 172.21.15.6:0/1546389058 >> v1:172.21.15.136:6789/0 conn(0x7f9bd80add30 legacy=0x7f9bd8156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.907+0000 7f9bdd200640 1 -- 172.21.15.6:0/1546389058 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd80ca550 con 0x7f9bd80ca050 2024-08-17T02:30:01.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.908+0000 7f9bdd200640 1 --2- 172.21.15.6:0/1546389058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bd80ca050 0x7f9bd8156420 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009910 tx=0x7f9bc40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a464f1592cb3951 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:01.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.908+0000 7f9bd7e00640 1 -- 172.21.15.6:0/1546389058 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4032440 con 0x7f9bd80ca050 2024-08-17T02:30:01.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.908+0000 7f9bd7e00640 1 -- 172.21.15.6:0/1546389058 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc40325a0 con 0x7f9bd80ca050 2024-08-17T02:30:01.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.908+0000 7f9bd7e00640 1 -- 172.21.15.6:0/1546389058 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4032980 con 0x7f9bd80ca050 2024-08-17T02:30:01.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.909+0000 7f9be0600640 1 -- 172.21.15.6:0/1546389058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bd80ca050 msgr2=0x7f9bd8156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.909+0000 7f9be0600640 1 --2- 172.21.15.6:0/1546389058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bd80ca050 0x7f9bd8156420 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009910 tx=0x7f9bc40091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.909+0000 7f9be0600640 1 -- 172.21.15.6:0/1546389058 shutdown_connections 2024-08-17T02:30:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.909+0000 7f9be0600640 1 --2- 172.21.15.6:0/1546389058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bd80ca050 0x7f9bd8156420 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.909+0000 7f9be0600640 1 --2- 172.21.15.6:0/1546389058 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9bd80ad960 0x7f9bd815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.909+0000 7f9be0600640 1 -- 172.21.15.6:0/1546389058 >> 172.21.15.6:0/1546389058 conn(0x7f9bd8066e60 msgr2=0x7f9bd8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.909+0000 7f9be0600640 1 -- 172.21.15.6:0/1546389058 shutdown_connections 2024-08-17T02:30:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.909+0000 7f9be0600640 1 -- 172.21.15.6:0/1546389058 wait complete. 2024-08-17T02:30:01.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.910+0000 7f9be0600640 1 Processor -- start 2024-08-17T02:30:01.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.911+0000 7f9be0600640 1 -- start start 2024-08-17T02:30:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.911+0000 7f9be0600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bd80ad960 0x7f9bd8150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.911+0000 7f9be0600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bd80add30 0x7f9bd80acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.911+0000 7f9be0600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9bd80ca050 0x7f9bd8154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.911+0000 7f9be0600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd80ab4c0 con 0x7f9bd80ad960 2024-08-17T02:30:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.911+0000 7f9be0600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd80abd60 con 0x7f9bd80add30 2024-08-17T02:30:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.911+0000 7f9be0600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd8150b40 con 0x7f9bd80ca050 2024-08-17T02:30:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.912+0000 7f9bddc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bd80ad960 0x7f9bd8150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.912+0000 7f9bddc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bd80ad960 0x7f9bd8150600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52140/0 (socket says 172.21.15.6:52140) 2024-08-17T02:30:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.912+0000 7f9bddc00640 1 -- 172.21.15.6:0/4075394143 learned_addr learned my addr 172.21.15.6:0/4075394143 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:30:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.912+0000 7f9bdd200640 1 --2- 172.21.15.6:0/4075394143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bd80add30 0x7f9bd80acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.912+0000 7f9bde600640 1 --2- 172.21.15.6:0/4075394143 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9bd80ca050 0x7f9bd8154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.912+0000 7f9bddc00640 1 -- 172.21.15.6:0/4075394143 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9bd80ca050 msgr2=0x7f9bd8154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.912+0000 7f9bddc00640 1 --2- 172.21.15.6:0/4075394143 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9bd80ca050 0x7f9bd8154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.912+0000 7f9bddc00640 1 -- 172.21.15.6:0/4075394143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bd80add30 msgr2=0x7f9bd80acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.912+0000 7f9bddc00640 1 --2- 172.21.15.6:0/4075394143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bd80add30 0x7f9bd80acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.912+0000 7f9bddc00640 1 -- 172.21.15.6:0/4075394143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc4009450 con 0x7f9bd80ad960 2024-08-17T02:30:01.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.912+0000 7f9bde600640 1 --2- 172.21.15.6:0/4075394143 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9bd80ca050 0x7f9bd8154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:01.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.912+0000 7f9bddc00640 1 --2- 172.21.15.6:0/4075394143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bd80ad960 0x7f9bd8150600 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc00d8c0 tx=0x7f9bcc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:01.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.913+0000 7f9bd4c00640 1 -- 172.21.15.6:0/4075394143 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc00de50 con 0x7f9bd80ad960 2024-08-17T02:30:01.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.913+0000 7f9bd4c00640 1 -- 172.21.15.6:0/4075394143 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bcc00b8d0 con 0x7f9bd80ad960 2024-08-17T02:30:01.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.913+0000 7f9be0600640 1 -- 172.21.15.6:0/4075394143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd80a8e50 con 0x7f9bd80ad960 2024-08-17T02:30:01.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.913+0000 7f9bd4c00640 1 -- 172.21.15.6:0/4075394143 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc00bc90 con 0x7f9bd80ad960 2024-08-17T02:30:01.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.913+0000 7f9be0600640 1 -- 172.21.15.6:0/4075394143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd80ab9f0 con 0x7f9bd80ad960 2024-08-17T02:30:01.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.914+0000 7f9be0600640 1 -- 172.21.15.6:0/4075394143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd8063fb0 con 0x7f9bd80ad960 2024-08-17T02:30:01.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.915+0000 7f9bd4c00640 1 -- 172.21.15.6:0/4075394143 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9bcc01e460 con 0x7f9bd80ad960 2024-08-17T02:30:01.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.915+0000 7f9bd4c00640 1 --2- 172.21.15.6:0/4075394143 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9bb8065150 0x7f9bb8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.915+0000 7f9bd4c00640 1 -- 172.21.15.6:0/4075394143 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9bcc082860 con 0x7f9bd80ad960 2024-08-17T02:30:01.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.916+0000 7f9bdd200640 1 --2- 172.21.15.6:0/4075394143 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9bb8065150 0x7f9bb8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.917+0000 7f9bdd200640 1 --2- 172.21.15.6:0/4075394143 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9bb8065150 0x7f9bb8067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4034000 tx=0x7f9bc4032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:01.919+0000 7f9bd4c00640 1 -- 172.21.15.6:0/4075394143 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9bcc050b20 con 0x7f9bd80ad960 2024-08-17T02:30:02.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.105+0000 7f9be0600640 1 -- 172.21.15.6:0/4075394143 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bd80cc700 con 0x7f9bb8065150 2024-08-17T02:30:02.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.106+0000 7f9bd4c00640 1 -- 172.21.15.6:0/4075394143 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9bd80cc700 con 0x7f9bb8065150 2024-08-17T02:30:02.107 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:30:02.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.108+0000 7f9be0600640 1 -- 172.21.15.6:0/4075394143 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9bb8065150 msgr2=0x7f9bb8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.108+0000 7f9be0600640 1 --2- 172.21.15.6:0/4075394143 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9bb8065150 0x7f9bb8067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4034000 tx=0x7f9bc4032000 comp rx=0 tx=0).stop 2024-08-17T02:30:02.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.108+0000 7f9be0600640 1 -- 172.21.15.6:0/4075394143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bd80ad960 msgr2=0x7f9bd8150600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.108+0000 7f9be0600640 1 --2- 172.21.15.6:0/4075394143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bd80ad960 0x7f9bd8150600 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc00d8c0 tx=0x7f9bcc008040 comp rx=0 tx=0).stop 2024-08-17T02:30:02.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.108+0000 7f9be0600640 1 -- 172.21.15.6:0/4075394143 shutdown_connections 2024-08-17T02:30:02.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.108+0000 7f9be0600640 1 --2- 172.21.15.6:0/4075394143 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f9bb8065150 0x7f9bb8067600 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.108+0000 7f9be0600640 1 --2- 172.21.15.6:0/4075394143 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9bd80ca050 0x7f9bd8154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.108+0000 7f9be0600640 1 --2- 172.21.15.6:0/4075394143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bd80add30 0x7f9bd80acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.108+0000 7f9be0600640 1 --2- 172.21.15.6:0/4075394143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bd80ad960 0x7f9bd8150600 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.108+0000 7f9be0600640 1 -- 172.21.15.6:0/4075394143 >> 172.21.15.6:0/4075394143 conn(0x7f9bd8066e60 msgr2=0x7f9bd806de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:02.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.108+0000 7f9be0600640 1 -- 172.21.15.6:0/4075394143 shutdown_connections 2024-08-17T02:30:02.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.108+0000 7f9be0600640 1 -- 172.21.15.6:0/4075394143 wait complete. 2024-08-17T02:30:02.124 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:30:02.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.274+0000 7f08e1600640 1 Processor -- start 2024-08-17T02:30:02.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.274+0000 7f08e1600640 1 -- start start 2024-08-17T02:30:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.275+0000 7f08e1600640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f08dc0ad960 0x7f08dc15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.275+0000 7f08e1600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f08dc0add30 0x7f08dc156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.275+0000 7f08e1600640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08dc15b5e0 con 0x7f08dc0ca050 2024-08-17T02:30:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.275+0000 7f08e1600640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08dc0cb160 con 0x7f08dc0ad960 2024-08-17T02:30:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.275+0000 7f08e1600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08dc0b0d10 con 0x7f08dc0add30 2024-08-17T02:30:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.275+0000 7f08d3e00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f08dc0ca050 0x7f08dc156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46412/0 (socket says 172.21.15.6:46412) 2024-08-17T02:30:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.275+0000 7f08d3e00640 1 -- 172.21.15.6:0/3314521134 learned_addr learned my addr 172.21.15.6:0/3314521134 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:30:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.275+0000 7f08daa00640 1 --2- 172.21.15.6:0/3314521134 >> v2:172.21.15.6:3300/0 conn(0x7f08dc0ad960 0x7f08dc15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.276+0000 7f08db400640 1 --2- 172.21.15.6:0/3314521134 >> v2:172.21.15.136:3300/0 conn(0x7f08dc0add30 0x7f08dc156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.276+0000 7f08daa00640 1 -- 172.21.15.6:0/3314521134 >> v2:172.21.15.136:3300/0 conn(0x7f08dc0add30 msgr2=0x7f08dc156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.276+0000 7f08daa00640 1 --2- 172.21.15.6:0/3314521134 >> v2:172.21.15.136:3300/0 conn(0x7f08dc0add30 0x7f08dc156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.276+0000 7f08daa00640 1 -- 172.21.15.6:0/3314521134 >> v1:172.21.15.6:6789/0 conn(0x7f08dc0ca050 legacy=0x7f08dc156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.276+0000 7f08daa00640 1 -- 172.21.15.6:0/3314521134 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc0ca550 con 0x7f08dc0ad960 2024-08-17T02:30:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.276+0000 7f08da000640 1 -- 172.21.15.6:0/3314521134 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771901702 0 0) 0x7f08c4001110 con 0x7f08dc0ca050 2024-08-17T02:30:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.277+0000 7f08daa00640 1 --2- 172.21.15.6:0/3314521134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08dc0ad960 0x7f08dc15b0a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0cb0d0 tx=0x7f08cc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cee03d828c54569 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.277+0000 7f08da000640 1 -- 172.21.15.6:0/3314521134 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc02ae40 con 0x7f08dc0ad960 2024-08-17T02:30:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.277+0000 7f08da000640 1 -- 172.21.15.6:0/3314521134 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc032440 con 0x7f08dc0ad960 2024-08-17T02:30:02.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.277+0000 7f08da000640 1 -- 172.21.15.6:0/3314521134 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc0327e0 con 0x7f08dc0ad960 2024-08-17T02:30:02.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.278+0000 7f08e1600640 1 -- 172.21.15.6:0/3314521134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08dc0ad960 msgr2=0x7f08dc15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.278+0000 7f08e1600640 1 --2- 172.21.15.6:0/3314521134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08dc0ad960 0x7f08dc15b0a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0cb0d0 tx=0x7f08cc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.278+0000 7f08e1600640 1 -- 172.21.15.6:0/3314521134 shutdown_connections 2024-08-17T02:30:02.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.278+0000 7f08e1600640 1 --2- 172.21.15.6:0/3314521134 >> v2:172.21.15.136:3300/0 conn(0x7f08dc0add30 0x7f08dc156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.278+0000 7f08e1600640 1 --2- 172.21.15.6:0/3314521134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08dc0ad960 0x7f08dc15b0a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.278+0000 7f08e1600640 1 -- 172.21.15.6:0/3314521134 >> 172.21.15.6:0/3314521134 conn(0x7f08dc066e60 msgr2=0x7f08dc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:02.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.278+0000 7f08e1600640 1 -- 172.21.15.6:0/3314521134 shutdown_connections 2024-08-17T02:30:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.278+0000 7f08e1600640 1 -- 172.21.15.6:0/3314521134 wait complete. 2024-08-17T02:30:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.279+0000 7f08e1600640 1 Processor -- start 2024-08-17T02:30:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.279+0000 7f08e1600640 1 -- start start 2024-08-17T02:30:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.280+0000 7f08e1600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08dc0ad960 0x7f08dc13e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.280+0000 7f08e1600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f08dc0add30 0x7f08dc16c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.280+0000 7f08e1600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08dc0ca050 0x7f08dc06af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.280+0000 7f08e1600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc06a510 con 0x7f08dc0ca050 2024-08-17T02:30:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.280+0000 7f08e1600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc16cfa0 con 0x7f08dc0ad960 2024-08-17T02:30:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.280+0000 7f08e1600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc16d280 con 0x7f08dc0add30 2024-08-17T02:30:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.281+0000 7f08db400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08dc0ca050 0x7f08dc06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.281+0000 7f08db400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08dc0ca050 0x7f08dc06af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52170/0 (socket says 172.21.15.6:52170) 2024-08-17T02:30:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.281+0000 7f08db400640 1 -- 172.21.15.6:0/1813947158 learned_addr learned my addr 172.21.15.6:0/1813947158 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:30:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.281+0000 7f08d3e00640 1 --2- 172.21.15.6:0/1813947158 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f08dc0add30 0x7f08dc16c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.281+0000 7f08daa00640 1 --2- 172.21.15.6:0/1813947158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08dc0ad960 0x7f08dc13e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.281+0000 7f08db400640 1 -- 172.21.15.6:0/1813947158 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f08dc0add30 msgr2=0x7f08dc16c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.281+0000 7f08db400640 1 --2- 172.21.15.6:0/1813947158 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f08dc0add30 0x7f08dc16c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.281+0000 7f08db400640 1 -- 172.21.15.6:0/1813947158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08dc0ad960 msgr2=0x7f08dc13e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.281+0000 7f08db400640 1 --2- 172.21.15.6:0/1813947158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08dc0ad960 0x7f08dc13e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.281+0000 7f08db400640 1 -- 172.21.15.6:0/1813947158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc009390 con 0x7f08dc0ca050 2024-08-17T02:30:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.281+0000 7f08db400640 1 --2- 172.21.15.6:0/1813947158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08dc0ca050 0x7f08dc06af60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f08d4009fa0 tx=0x7f08d4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.282+0000 7f08d2000640 1 -- 172.21.15.6:0/1813947158 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d400ee60 con 0x7f08dc0ca050 2024-08-17T02:30:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.282+0000 7f08d2000640 1 -- 172.21.15.6:0/1813947158 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d4014420 con 0x7f08dc0ca050 2024-08-17T02:30:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.282+0000 7f08d2000640 1 -- 172.21.15.6:0/1813947158 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d40147e0 con 0x7f08dc0ca050 2024-08-17T02:30:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.282+0000 7f08e1600640 1 -- 172.21.15.6:0/1813947158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08dc06a760 con 0x7f08dc0ca050 2024-08-17T02:30:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.282+0000 7f08e1600640 1 -- 172.21.15.6:0/1813947158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08dc13ed40 con 0x7f08dc0ca050 2024-08-17T02:30:02.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.283+0000 7f08e1600640 1 -- 172.21.15.6:0/1813947158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08dc063fb0 con 0x7f08dc0ca050 2024-08-17T02:30:02.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.283+0000 7f08d2000640 1 -- 172.21.15.6:0/1813947158 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f08d4014b50 con 0x7f08dc0ca050 2024-08-17T02:30:02.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.284+0000 7f08d2000640 1 --2- 172.21.15.6:0/1813947158 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f08b8065150 0x7f08b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.284+0000 7f08d2000640 1 -- 172.21.15.6:0/1813947158 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f08d4082a40 con 0x7f08dc0ca050 2024-08-17T02:30:02.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.285+0000 7f08daa00640 1 --2- 172.21.15.6:0/1813947158 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f08b8065150 0x7f08b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.285+0000 7f08daa00640 1 --2- 172.21.15.6:0/1813947158 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f08b8065150 0x7f08b8067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f08cc034000 tx=0x7f08cc032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.288+0000 7f08d2000640 1 -- 172.21.15.6:0/1813947158 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f08d4050d00 con 0x7f08dc0ca050 2024-08-17T02:30:02.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.466+0000 7f08e1600640 1 -- 172.21.15.6:0/1813947158 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08dc0af9c0 con 0x7f08b8065150 2024-08-17T02:30:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.469+0000 7f08d2000640 1 -- 172.21.15.6:0/1813947158 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50845 (secure 0 0 0) 0x7f08dc0af9c0 con 0x7f08b8065150 2024-08-17T02:30:02.470 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:30:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-08-17T02:30:02.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.471+0000 7f08e1600640 1 -- 172.21.15.6:0/1813947158 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f08b8065150 msgr2=0x7f08b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.471+0000 7f08e1600640 1 --2- 172.21.15.6:0/1813947158 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f08b8065150 0x7f08b8067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f08cc034000 tx=0x7f08cc032000 comp rx=0 tx=0).stop 2024-08-17T02:30:02.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.471+0000 7f08e1600640 1 -- 172.21.15.6:0/1813947158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08dc0ca050 msgr2=0x7f08dc06af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.471+0000 7f08e1600640 1 --2- 172.21.15.6:0/1813947158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08dc0ca050 0x7f08dc06af60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f08d4009fa0 tx=0x7f08d4009900 comp rx=0 tx=0).stop 2024-08-17T02:30:02.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.471+0000 7f08e1600640 1 -- 172.21.15.6:0/1813947158 shutdown_connections 2024-08-17T02:30:02.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.471+0000 7f08e1600640 1 --2- 172.21.15.6:0/1813947158 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f08b8065150 0x7f08b8067600 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.471+0000 7f08e1600640 1 --2- 172.21.15.6:0/1813947158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08dc0ca050 0x7f08dc06af60 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.471+0000 7f08e1600640 1 --2- 172.21.15.6:0/1813947158 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f08dc0add30 0x7f08dc16c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.471+0000 7f08e1600640 1 --2- 172.21.15.6:0/1813947158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08dc0ad960 0x7f08dc13e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.471+0000 7f08e1600640 1 -- 172.21.15.6:0/1813947158 >> 172.21.15.6:0/1813947158 conn(0x7f08dc066e60 msgr2=0x7f08dc0b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:02.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.471+0000 7f08e1600640 1 -- 172.21.15.6:0/1813947158 shutdown_connections 2024-08-17T02:30:02.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:02.471+0000 7f08e1600640 1 -- 172.21.15.6:0/1813947158 wait complete. 2024-08-17T02:30:02.486 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-08-17T02:30:01.466064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2392356,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752582364,"statfs":{"total":773094113280,"available":770644340736,"internally_reserved":0,"allocated":5283840,"data_stored":2880488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002837"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":185,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:29:50.752485+0000","last_change":"2024-08-17T02:26:27.275086+0000","last_active":"2024-08-17T02:29:50.752485+0000","last_peered":"2024-08-17T02:29:50.752485+0000","last_clean":"2024-08-17T02:29:50.752485+0000","last_became_active":"2024-08-17T02:26:27.274075+0000","last_became_peered":"2024-08-17T02:26:27.274075+0000","last_unstale":"2024-08-17T02:29:50.752485+0000","last_undegraded":"2024-08-17T02:29:50.752485+0000","last_fullsized":"2024-08-17T02:29:50.752485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:26.139133+0000","last_clean_scrub_stamp":"2024-08-17T02:26:26.139133+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:52.161982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302596,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069244,"statfs":{"total":96636764160,"available":96326905856,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94899999999999995,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.51400000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93300000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.80000000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.69399999999999995,"15min":0.67800000000000005},"min":{"1min":0.64000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98399999999999999,"5min":1.034,"15min":1.034},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73399999999999999,"15min":0.71699999999999997},"min":{"1min":0.64200000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.753}]},{"osd":2,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68100000000000005,"15min":0.65500000000000003},"min":{"1min":0.55700000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.64700000000000002,"15min":0.63100000000000001},"min":{"1min":0.57299999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.69299999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.60499999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73699999999999999,"15min":0.73299999999999998},"min":{"1min":0.52400000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.59399999999999997,"15min":0.61799999999999999},"min":{"1min":0.42699999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69599999999999995,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.63100000000000001,"15min":0.66700000000000004},"min":{"1min":0.46100000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78900000000000003,"5min":1.226,"15min":1.226},"last":0.60199999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82799999999999996,"5min":1.075,"15min":1.075},"last":0.628},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71599999999999997,"15min":0.73499999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84599999999999997,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.48399999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.68500000000000005,"15min":0.70499999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.81299999999999994,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.71299999999999997,"15min":0.75600000000000001},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99099999999999999,"5min":1.855,"15min":1.855},"last":0.66900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64800000000000002,"15min":0.626},"min":{"1min":0.52200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63900000000000001,"15min":0.61599999999999999},"min":{"1min":0.55600000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92400000000000004,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.61799999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.51100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":0.999,"15min":0.999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.50800000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93100000000000005,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.64200000000000002,"15min":0.60999999999999999},"min":{"1min":0.53200000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.624,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.73799999999999999},"min":{"1min":0.61299999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.97499999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70899999999999996,"15min":0.68500000000000005},"min":{"1min":0.626,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88800000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.71799999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.627,"15min":0.64300000000000002},"min":{"1min":0.47599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.73899999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.44,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76700000000000002,"5min":0.871,"15min":0.871},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71499999999999997,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90300000000000002,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.64100000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70399999999999996,"15min":0.70899999999999996},"min":{"1min":0.49199999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85599999999999998,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.66100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.76500000000000001},"min":{"1min":0.53600000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92200000000000004,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.52600000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94199999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.80000000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.68899999999999995},"min":{"1min":0.56299999999999994,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91400000000000003,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.81699999999999995,"15min":0.871},"min":{"1min":0.47699999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82499999999999996,"5min":4.0670000000000002,"15min":4.0670000000000002},"last":0.67500000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70499999999999996,"15min":0.68899999999999995},"min":{"1min":0.63200000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.85299999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68100000000000005,"15min":0.66600000000000004},"min":{"1min":0.59299999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.78200000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.57299999999999995,"5min":0.433,"15min":0.433},"max":{"1min":0.91700000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.754},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.58399999999999996,"5min":0.504,"15min":0.504},"max":{"1min":0.89300000000000002,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.76900000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.57199999999999995,"15min":0.59399999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69999999999999996,"5min":0.879,"15min":0.879},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63,"15min":0.65000000000000002},"min":{"1min":0.44400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84499999999999997,"5min":0.877,"15min":0.877},"last":0.52200000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86499999999999999,"5min":0.879,"15min":0.879},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.79600000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.63}]},{"osd":7,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69999999999999996,"15min":0.71499999999999997},"min":{"1min":0.50600000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.55800000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86699999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.72199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.64700000000000002,"15min":0.61699999999999999},"min":{"1min":0.47599999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71799999999999997,"15min":0.70099999999999996},"min":{"1min":0.51100000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89800000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.72199999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72899999999999998,"15min":0.72399999999999998},"min":{"1min":0.502,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93999999999999995,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.71499999999999997,"15min":0.69299999999999995},"min":{"1min":0.54200000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0009999999999999,"5min":1.234,"15min":1.234},"last":0.63}]},{"osd":2,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.56000000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0209999999999999,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.80800000000000005,"15min":0.80600000000000005},"min":{"1min":0.73599999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.98099999999999998,"5min":1.645,"15min":1.645},"last":0.78200000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.56200000000000006,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.72999999999999998,"15min":0.71799999999999997},"min":{"1min":0.63300000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.026,"5min":1.605,"15min":1.605},"last":0.61099999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64800000000000002,"15min":0.67000000000000004},"min":{"1min":0.45000000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.76900000000000002,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67700000000000005,"15min":0.68999999999999995},"min":{"1min":0.51900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.82999999999999996,"5min":1.429,"15min":1.429},"last":0.57299999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.51500000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83899999999999997,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.498,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.85599999999999998,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.68899999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.755,"15min":0.77800000000000002},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.95599999999999996,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94799999999999995,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.66400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.50700000000000001,"15min":0.52400000000000002},"min":{"1min":0.36099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68500000000000005,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.312},{"interface":"front","average":{"1min":0.498,"5min":0.45800000000000002,"15min":0.437},"min":{"1min":0.38200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70999999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.36899999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.35899999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69799999999999995,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.628,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.442}]},{"osd":2,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.439,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67200000000000004,"5min":1.375,"15min":1.375},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71099999999999997,"5min":1.347,"15min":1.347},"last":0.5}]},{"osd":4,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.63200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0289999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.96999999999999997,"5min":1.321,"15min":1.321},"last":0.59999999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79200000000000004,"15min":0.78500000000000003},"min":{"1min":0.65500000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0669999999999999,"5min":1.421,"15min":1.421},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78200000000000003,"15min":0.77800000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.98899999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.63100000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79300000000000004,"15min":0.78700000000000003},"min":{"1min":0.59999999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.103,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.70299999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.94899999999999995,"5min":1.389,"15min":1.389},"last":0.68100000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.78100000000000003,"15min":0.76700000000000002},"min":{"1min":0.58199999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.085,"5min":1.091,"15min":1.091},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.84499999999999997,"15min":0.85099999999999998},"min":{"1min":0.68000000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.014,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.52700000000000002,"15min":0.56299999999999994},"min":{"1min":0.32500000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.70599999999999996,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57299999999999995,"15min":0.59099999999999997},"min":{"1min":0.44400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.61599999999999999,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.45500000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60699999999999998,"15min":0.63500000000000001},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64600000000000002,"5min":3.827,"15min":3.827},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58899999999999997,"15min":0.59699999999999998},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71499999999999997,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.41099999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52600000000000002,"15min":0.54500000000000004},"min":{"1min":0.34300000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.747,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.46400000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75900000000000001,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.51600000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.85499999999999998,"15min":0.879},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1739999999999999,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81200000000000006,"15min":0.81999999999999995},"min":{"1min":0.60799999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.073,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.498}]},{"osd":5,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.63900000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4259999999999999,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.61899999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3129999999999999,"5min":3.54,"15min":3.54},"last":0.57499999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79900000000000004,"15min":0.80900000000000005},"min":{"1min":0.66800000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.216,"5min":1.274,"15min":1.274},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4690000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85999999999999999,"15min":0.872},"min":{"1min":0.60899999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.88200000000000001,"15min":0.89000000000000001},"min":{"1min":0.66800000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.264,"5min":2.302,"15min":2.302},"last":0.60399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.55100000000000005,"15min":0.59999999999999998},"min":{"1min":0.316,"5min":0.311,"15min":0.311},"max":{"1min":0.55700000000000005,"5min":2.871,"15min":2.871},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.625,"15min":0.67100000000000004},"min":{"1min":0.44700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65000000000000002,"5min":2.96,"15min":2.96},"last":0.45000000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.505,"15min":0.53800000000000003},"min":{"1min":0.35099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59799999999999998,"5min":2.371,"15min":2.371},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.71299999999999997,"15min":0.80900000000000005},"min":{"1min":0.375,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.54300000000000004,"5min":5.468,"15min":5.468},"last":0.503}]},{"osd":3,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72399999999999998,"15min":0.77300000000000002},"min":{"1min":0.51200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.745,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.65500000000000003,"15min":0.70999999999999996},"min":{"1min":0.39200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83099999999999996,"15min":0.84799999999999998},"min":{"1min":0.61799999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.98999999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.92200000000000004,"15min":0.96699999999999997},"min":{"1min":0.69199999999999995,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.96999999999999997,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.90000000000000002,"15min":0.94999999999999996},"min":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98299999999999998,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.86899999999999999,"15min":0.90700000000000003},"min":{"1min":0.66900000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.042,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":0.69499999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.91400000000000003,"15min":0.97599999999999998},"min":{"1min":0.61299999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.97799999999999998,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83299999999999996,"15min":0.85099999999999998},"min":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.95599999999999996,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.55900000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.98199999999999998,"15min":1.0740000000000001},"min":{"1min":0.66300000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.86899999999999999,"5min":5.5190000000000001,"15min":5.5190000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.97999999999999998,"15min":1.0660000000000001},"min":{"1min":0.59699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94799999999999995,"5min":4.5970000000000004,"15min":4.5970000000000004},"last":0.59299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42099999999999999,"15min":0.40699999999999997},"min":{"1min":0.33100000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60499999999999998,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.47499999999999998,"15min":0.45800000000000002},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.54400000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.38300000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.40000000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.503}]},{"osd":3,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.47299999999999998},"min":{"1min":0.39400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.46100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81999999999999995,"5min":0.873,"15min":0.873},"last":0.628}]},{"osd":4,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.78300000000000003,"15min":0.76800000000000002},"min":{"1min":0.66700000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.58199999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0529999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.77600000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.78800000000000003,"15min":0.77500000000000002},"min":{"1min":0.63900000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79300000000000004,"15min":0.78700000000000003},"min":{"1min":0.67500000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0169999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.86499999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.82899999999999996,"15min":0.81699999999999995},"min":{"1min":0.73099999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1040000000000001,"5min":1.109,"15min":1.109},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.82099999999999995,"15min":0.80500000000000005},"min":{"1min":0.66800000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.66700000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.86199999999999999,"15min":0.85499999999999998},"min":{"1min":0.70699999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.83099999999999996,"15min":0.82099999999999995},"min":{"1min":0.68700000000000006,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0800000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.81899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:30:02.491 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:26:26.139133+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=26, tm_sec=26, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=29, tm_sec=56, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:30:02.491 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:30:04.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:04.664 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:22.493 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:30:22.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.655+0000 7fd766600640 1 Processor -- start 2024-08-17T02:30:22.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.655+0000 7fd766600640 1 -- start start 2024-08-17T02:30:22.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.656+0000 7fd766600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd7600ad960 0x7fd76015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:22.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.656+0000 7fd766600640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76015b5e0 con 0x7fd7600add30 2024-08-17T02:30:22.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.656+0000 7fd766600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7600cb160 con 0x7fd7600ca050 2024-08-17T02:30:22.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.656+0000 7fd766600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7600b0d10 con 0x7fd7600ad960 2024-08-17T02:30:22.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.656+0000 7fd75fe00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd7600add30 0x7fd7600aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37564/0 (socket says 172.21.15.6:37564) 2024-08-17T02:30:22.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.656+0000 7fd75fe00640 1 -- 172.21.15.6:0/3311711899 learned_addr learned my addr 172.21.15.6:0/3311711899 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:30:22.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.657+0000 7fd75f400640 1 --2- 172.21.15.6:0/3311711899 >> v2:172.21.15.136:3300/0 conn(0x7fd7600ad960 0x7fd76015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:22.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.657+0000 7fd75ea00640 1 -- 172.21.15.6:0/3311711899 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337354062 0 0) 0x7fd758001490 con 0x7fd7600add30 2024-08-17T02:30:22.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.657+0000 7fd75ea00640 1 -- 172.21.15.6:0/3311711899 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7440034e0 con 0x7fd7600add30 2024-08-17T02:30:22.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.657+0000 7fd75f400640 1 -- 172.21.15.6:0/3311711899 >> v1:172.21.15.136:6789/0 conn(0x7fd7600ca050 legacy=0x7fd760156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:22.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.657+0000 7fd75ea00640 1 -- 172.21.15.6:0/3311711899 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629654421 0 0) 0x7fd7600cb160 con 0x7fd7600ca050 2024-08-17T02:30:22.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.657+0000 7fd75f400640 1 -- 172.21.15.6:0/3311711899 >> v1:172.21.15.6:6789/0 conn(0x7fd7600add30 legacy=0x7fd7600aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:22.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.657+0000 7fd75f400640 1 -- 172.21.15.6:0/3311711899 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7600ca550 con 0x7fd7600ad960 2024-08-17T02:30:22.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.658+0000 7fd75f400640 1 --2- 172.21.15.6:0/3311711899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7600ad960 0x7fd76015b0a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd750009850 tx=0x7fd7500090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbf41d1b3f795107 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:22.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.659+0000 7fd75ea00640 1 -- 172.21.15.6:0/3311711899 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750032440 con 0x7fd7600ad960 2024-08-17T02:30:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.659+0000 7fd75ea00640 1 -- 172.21.15.6:0/3311711899 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7500325a0 con 0x7fd7600ad960 2024-08-17T02:30:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.659+0000 7fd75ea00640 1 -- 172.21.15.6:0/3311711899 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750032940 con 0x7fd7600ad960 2024-08-17T02:30:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.659+0000 7fd766600640 1 -- 172.21.15.6:0/3311711899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7600ad960 msgr2=0x7fd76015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.659+0000 7fd766600640 1 --2- 172.21.15.6:0/3311711899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7600ad960 0x7fd76015b0a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd750009850 tx=0x7fd7500090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.659+0000 7fd766600640 1 -- 172.21.15.6:0/3311711899 shutdown_connections 2024-08-17T02:30:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.659+0000 7fd766600640 1 --2- 172.21.15.6:0/3311711899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7600ad960 0x7fd76015b0a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.659+0000 7fd766600640 1 -- 172.21.15.6:0/3311711899 >> 172.21.15.6:0/3311711899 conn(0x7fd760066e60 msgr2=0x7fd760067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:22.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.659+0000 7fd766600640 1 -- 172.21.15.6:0/3311711899 shutdown_connections 2024-08-17T02:30:22.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.659+0000 7fd766600640 1 -- 172.21.15.6:0/3311711899 wait complete. 2024-08-17T02:30:22.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.661+0000 7fd766600640 1 Processor -- start 2024-08-17T02:30:22.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.661+0000 7fd766600640 1 -- start start 2024-08-17T02:30:22.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.662+0000 7fd766600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7600ad960 0x7fd760151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:22.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.662+0000 7fd766600640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7600add30 0x7fd760159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:22.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.662+0000 7fd766600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7600ca050 0x7fd7600aca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:22.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.662+0000 7fd766600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600ac600 con 0x7fd7600ca050 2024-08-17T02:30:22.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.662+0000 7fd766600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7601520f0 con 0x7fd7600ad960 2024-08-17T02:30:22.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.662+0000 7fd766600640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600ab9f0 con 0x7fd7600add30 2024-08-17T02:30:22.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.662+0000 7fd75fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7600ca050 0x7fd7600aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:22.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.662+0000 7fd75fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7600ca050 0x7fd7600aca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60604/0 (socket says 172.21.15.6:60604) 2024-08-17T02:30:22.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.662+0000 7fd75fe00640 1 -- 172.21.15.6:0/4090885740 learned_addr learned my addr 172.21.15.6:0/4090885740 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:30:22.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.662+0000 7fd75f400640 1 --2- 172.21.15.6:0/4090885740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7600ad960 0x7fd760151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:22.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.662+0000 7fd756a00640 1 --2- 172.21.15.6:0/4090885740 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7600add30 0x7fd760159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:22.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.663+0000 7fd75fe00640 1 -- 172.21.15.6:0/4090885740 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7600add30 msgr2=0x7fd760159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:22.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.663+0000 7fd75fe00640 1 --2- 172.21.15.6:0/4090885740 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7600add30 0x7fd760159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:22.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.663+0000 7fd75fe00640 1 -- 172.21.15.6:0/4090885740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7600ad960 msgr2=0x7fd760151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:22.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.663+0000 7fd75fe00640 1 --2- 172.21.15.6:0/4090885740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7600ad960 0x7fd760151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:22.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.663+0000 7fd75fe00640 1 -- 172.21.15.6:0/4090885740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd750009390 con 0x7fd7600ca050 2024-08-17T02:30:22.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.663+0000 7fd75f400640 1 --2- 172.21.15.6:0/4090885740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7600ad960 0x7fd760151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:22.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.663+0000 7fd75fe00640 1 --2- 172.21.15.6:0/4090885740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7600ca050 0x7fd7600aca90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd75800cd00 tx=0x7fd758001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:22.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.663+0000 7fd757400640 1 -- 172.21.15.6:0/4090885740 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75800a850 con 0x7fd7600ca050 2024-08-17T02:30:22.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.663+0000 7fd757400640 1 -- 172.21.15.6:0/4090885740 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75800a9b0 con 0x7fd7600ca050 2024-08-17T02:30:22.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.663+0000 7fd757400640 1 -- 172.21.15.6:0/4090885740 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75800ad70 con 0x7fd7600ca050 2024-08-17T02:30:22.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.663+0000 7fd766600640 1 -- 172.21.15.6:0/4090885740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7600abcd0 con 0x7fd7600ca050 2024-08-17T02:30:22.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.663+0000 7fd766600640 1 -- 172.21.15.6:0/4090885740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7600ac290 con 0x7fd7600ca050 2024-08-17T02:30:22.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.664+0000 7fd766600640 1 -- 172.21.15.6:0/4090885740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7600ac770 con 0x7fd7600ca050 2024-08-17T02:30:22.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.665+0000 7fd757400640 1 -- 172.21.15.6:0/4090885740 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd758007300 con 0x7fd7600ca050 2024-08-17T02:30:22.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.666+0000 7fd757400640 1 --2- 172.21.15.6:0/4090885740 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd73c065150 0x7fd73c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:22.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.666+0000 7fd757400640 1 -- 172.21.15.6:0/4090885740 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd7580822e0 con 0x7fd7600ca050 2024-08-17T02:30:22.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.666+0000 7fd75f400640 1 --2- 172.21.15.6:0/4090885740 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd73c065150 0x7fd73c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:22.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.667+0000 7fd75f400640 1 --2- 172.21.15.6:0/4090885740 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd73c065150 0x7fd73c067600 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd750034000 tx=0x7fd750032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.670+0000 7fd757400640 1 -- 172.21.15.6:0/4090885740 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd758050590 con 0x7fd7600ca050 2024-08-17T02:30:22.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.849+0000 7fd766600640 1 -- 172.21.15.6:0/4090885740 --> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd76015b5e0 con 0x7fd73c065150 2024-08-17T02:30:22.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.852+0000 7fd757400640 1 -- 172.21.15.6:0/4090885740 <== mgr.4103 v2:172.21.15.136:6832/36709 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50878 (secure 0 0 0) 0x7fd76015b5e0 con 0x7fd73c065150 2024-08-17T02:30:22.853 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:30:22.853 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-08-17T02:30:22.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.854+0000 7fd766600640 1 -- 172.21.15.6:0/4090885740 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd73c065150 msgr2=0x7fd73c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:22.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.854+0000 7fd766600640 1 --2- 172.21.15.6:0/4090885740 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd73c065150 0x7fd73c067600 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd750034000 tx=0x7fd750032000 comp rx=0 tx=0).stop 2024-08-17T02:30:22.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.854+0000 7fd766600640 1 -- 172.21.15.6:0/4090885740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7600ca050 msgr2=0x7fd7600aca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:22.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.854+0000 7fd766600640 1 --2- 172.21.15.6:0/4090885740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7600ca050 0x7fd7600aca90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd75800cd00 tx=0x7fd758001ad0 comp rx=0 tx=0).stop 2024-08-17T02:30:22.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.854+0000 7fd766600640 1 -- 172.21.15.6:0/4090885740 shutdown_connections 2024-08-17T02:30:22.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.854+0000 7fd766600640 1 --2- 172.21.15.6:0/4090885740 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7fd73c065150 0x7fd73c067600 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.854+0000 7fd766600640 1 --2- 172.21.15.6:0/4090885740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7600ca050 0x7fd7600aca90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.854+0000 7fd766600640 1 --2- 172.21.15.6:0/4090885740 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7600add30 0x7fd760159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.854+0000 7fd766600640 1 --2- 172.21.15.6:0/4090885740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7600ad960 0x7fd760151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.854+0000 7fd766600640 1 -- 172.21.15.6:0/4090885740 >> 172.21.15.6:0/4090885740 conn(0x7fd760066e60 msgr2=0x7fd760152930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.854+0000 7fd766600640 1 -- 172.21.15.6:0/4090885740 shutdown_connections 2024-08-17T02:30:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:22.854+0000 7fd766600640 1 -- 172.21.15.6:0/4090885740 wait complete. 2024-08-17T02:30:22.871 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-08-17T02:30:21.470265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2392344,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752582376,"statfs":{"total":773094113280,"available":770644353024,"internally_reserved":0,"allocated":5283840,"data_stored":2880488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002403"},"pg_stats":[{"pgid":"1.0","version":"43'119","reported_seq":198,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-17T02:30:04.257261+0000","last_change":"2024-08-17T02:30:04.257226+0000","last_active":"2024-08-17T02:30:04.257261+0000","last_peered":"2024-08-17T02:30:04.257261+0000","last_clean":"2024-08-17T02:30:04.257261+0000","last_became_active":"2024-08-17T02:26:27.274075+0000","last_became_peered":"2024-08-17T02:26:27.274075+0000","last_unstale":"2024-08-17T02:30:04.257261+0000","last_undegraded":"2024-08-17T02:30:04.257261+0000","last_fullsized":"2024-08-17T02:30:04.257261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2024-08-17T02:30:04.257130+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2024-08-17T02:30:04.257130+0000","last_clean_scrub_stamp":"2024-08-17T02:30:04.257130+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:18:39.389896+0000","scrub_duration":0.006584978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302592,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069248,"statfs":{"total":96636764160,"available":96326909952,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94899999999999995,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.51400000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93300000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.63100000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.69399999999999995,"15min":0.67800000000000005},"min":{"1min":0.64000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98399999999999999,"5min":1.034,"15min":1.034},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73399999999999999,"15min":0.71699999999999997},"min":{"1min":0.64200000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.59199999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68100000000000005,"15min":0.65500000000000003},"min":{"1min":0.55700000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.746},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.64700000000000002,"15min":0.63100000000000001},"min":{"1min":0.57299999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.57499999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.60499999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73699999999999999,"15min":0.73299999999999998},"min":{"1min":0.52400000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.77300000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.59399999999999997,"15min":0.61799999999999999},"min":{"1min":0.42699999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69599999999999995,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.63100000000000001,"15min":0.66700000000000004},"min":{"1min":0.46100000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78900000000000003,"5min":1.226,"15min":1.226},"last":0.53400000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82799999999999996,"5min":1.075,"15min":1.075},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71599999999999997,"15min":0.73499999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84599999999999997,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.64800000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:29:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.68500000000000005,"15min":0.70499999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.81299999999999994,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.71299999999999997,"15min":0.75600000000000001},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99099999999999999,"5min":1.855,"15min":1.855},"last":0.66300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64800000000000002,"15min":0.626},"min":{"1min":0.52200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63900000000000001,"15min":0.61599999999999999},"min":{"1min":0.55600000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92400000000000004,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.66100000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.51100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":0.999,"15min":0.999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.50800000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93100000000000005,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.70799999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.64200000000000002,"15min":0.60999999999999999},"min":{"1min":0.53200000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.624,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.83199999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.73799999999999999},"min":{"1min":0.61299999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.97499999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70899999999999996,"15min":0.68500000000000005},"min":{"1min":0.626,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88800000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.77800000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.505},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.627,"15min":0.64300000000000002},"min":{"1min":0.47599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.44,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76700000000000002,"5min":0.871,"15min":0.871},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71499999999999997,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90300000000000002,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70399999999999996,"15min":0.70899999999999996},"min":{"1min":0.49199999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85599999999999998,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.69499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.76500000000000001},"min":{"1min":0.53600000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92200000000000004,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.52600000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94199999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65500000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.68899999999999995},"min":{"1min":0.56299999999999994,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91400000000000003,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.81699999999999995,"15min":0.871},"min":{"1min":0.47699999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82499999999999996,"5min":4.0670000000000002,"15min":4.0670000000000002},"last":0.626}]},{"osd":2,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70499999999999996,"15min":0.68899999999999995},"min":{"1min":0.63200000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.85299999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68100000000000005,"15min":0.66600000000000004},"min":{"1min":0.59299999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.69499999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.57299999999999995,"5min":0.433,"15min":0.433},"max":{"1min":0.91700000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.58399999999999996,"5min":0.504,"15min":0.504},"max":{"1min":0.89300000000000002,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.67600000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.57199999999999995,"15min":0.59399999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69999999999999996,"5min":0.879,"15min":0.879},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63,"15min":0.65000000000000002},"min":{"1min":0.44400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84499999999999997,"5min":0.877,"15min":0.877},"last":0.47999999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86499999999999999,"5min":0.879,"15min":0.879},"last":0.502},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.79600000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.63900000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69999999999999996,"15min":0.71499999999999997},"min":{"1min":0.50600000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.55800000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86699999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.77500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.64700000000000002,"15min":0.61699999999999999},"min":{"1min":0.47599999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.629},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71799999999999997,"15min":0.70099999999999996},"min":{"1min":0.51100000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89800000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.752}]},{"osd":1,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72899999999999998,"15min":0.72399999999999998},"min":{"1min":0.502,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93999999999999995,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.71499999999999997,"15min":0.69299999999999995},"min":{"1min":0.54200000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0009999999999999,"5min":1.234,"15min":1.234},"last":0.69799999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.56000000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0209999999999999,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.80800000000000005,"15min":0.80600000000000005},"min":{"1min":0.73599999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.98099999999999998,"5min":1.645,"15min":1.645},"last":0.71599999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.56200000000000006,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.72999999999999998,"15min":0.71799999999999997},"min":{"1min":0.63300000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.026,"5min":1.605,"15min":1.605},"last":0.65900000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64800000000000002,"15min":0.67000000000000004},"min":{"1min":0.45000000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.76900000000000002,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67700000000000005,"15min":0.68999999999999995},"min":{"1min":0.51900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.82999999999999996,"5min":1.429,"15min":1.429},"last":0.53700000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.51500000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83899999999999997,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.498,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.85599999999999998,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.755,"15min":0.77800000000000002},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.95599999999999996,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94799999999999995,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.55800000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.50700000000000001,"15min":0.52400000000000002},"min":{"1min":0.36099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68500000000000005,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.62},{"interface":"front","average":{"1min":0.498,"5min":0.45800000000000002,"15min":0.437},"min":{"1min":0.38200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70999999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35799999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.35899999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69799999999999995,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.375},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.628,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.58499999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.439,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67200000000000004,"5min":1.375,"15min":1.375},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71099999999999997,"5min":1.347,"15min":1.347},"last":0.53400000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.63200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0289999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.96999999999999997,"5min":1.321,"15min":1.321},"last":0.84199999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79200000000000004,"15min":0.78500000000000003},"min":{"1min":0.65500000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0669999999999999,"5min":1.421,"15min":1.421},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78200000000000003,"15min":0.77800000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.98899999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.76300000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79300000000000004,"15min":0.78700000000000003},"min":{"1min":0.59999999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.103,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.70299999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.94899999999999995,"5min":1.389,"15min":1.389},"last":0.79800000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.78100000000000003,"15min":0.76700000000000002},"min":{"1min":0.58199999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.085,"5min":1.091,"15min":1.091},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.84499999999999997,"15min":0.85099999999999998},"min":{"1min":0.68000000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.014,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.77600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.52700000000000002,"15min":0.56299999999999994},"min":{"1min":0.32500000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.70599999999999996,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57299999999999995,"15min":0.59099999999999997},"min":{"1min":0.44400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.61599999999999999,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.67000000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60699999999999998,"15min":0.63500000000000001},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64600000000000002,"5min":3.827,"15min":3.827},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58899999999999997,"15min":0.59699999999999998},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71499999999999997,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.82199999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52600000000000002,"15min":0.54500000000000004},"min":{"1min":0.34300000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.747,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.46400000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75900000000000001,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.72199999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.85499999999999998,"15min":0.879},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1739999999999999,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81200000000000006,"15min":0.81999999999999995},"min":{"1min":0.60799999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.073,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.76700000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.63900000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4259999999999999,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.61899999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3129999999999999,"5min":3.54,"15min":3.54},"last":0.88100000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79900000000000004,"15min":0.80900000000000005},"min":{"1min":0.66800000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.216,"5min":1.274,"15min":1.274},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4690000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.85599999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85999999999999999,"15min":0.872},"min":{"1min":0.60899999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.88200000000000001,"15min":0.89000000000000001},"min":{"1min":0.66800000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.264,"5min":2.302,"15min":2.302},"last":0.97399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.55100000000000005,"15min":0.59999999999999998},"min":{"1min":0.316,"5min":0.311,"15min":0.311},"max":{"1min":0.55700000000000005,"5min":2.871,"15min":2.871},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.625,"15min":0.67100000000000004},"min":{"1min":0.44700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65000000000000002,"5min":2.96,"15min":2.96},"last":0.52900000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.505,"15min":0.53800000000000003},"min":{"1min":0.35099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59799999999999998,"5min":2.371,"15min":2.371},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.71299999999999997,"15min":0.80900000000000005},"min":{"1min":0.375,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.54300000000000004,"5min":5.468,"15min":5.468},"last":0.45000000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72399999999999998,"15min":0.77300000000000002},"min":{"1min":0.51200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.745,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.65500000000000003,"15min":0.70999999999999996},"min":{"1min":0.39200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":0.499}]},{"osd":4,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83099999999999996,"15min":0.84799999999999998},"min":{"1min":0.61799999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.98999999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.92200000000000004,"15min":0.96699999999999997},"min":{"1min":0.69199999999999995,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.96999999999999997,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.71999999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.90000000000000002,"15min":0.94999999999999996},"min":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98299999999999998,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.754},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.86899999999999999,"15min":0.90700000000000003},"min":{"1min":0.66900000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.042,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":0.77500000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.91400000000000003,"15min":0.97599999999999998},"min":{"1min":0.61299999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.97799999999999998,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83299999999999996,"15min":0.85099999999999998},"min":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.95599999999999996,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.67200000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:29:30 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.98199999999999998,"15min":1.0740000000000001},"min":{"1min":0.66300000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.86899999999999999,"5min":5.5190000000000001,"15min":5.5190000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.97999999999999998,"15min":1.0660000000000001},"min":{"1min":0.59699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94799999999999995,"5min":4.5970000000000004,"15min":4.5970000000000004},"last":0.69899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302592,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069248,"statfs":{"total":96636764160,"available":96326909952,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42099999999999999,"15min":0.40699999999999997},"min":{"1min":0.33100000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60499999999999998,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.47499999999999998,"15min":0.45800000000000002},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.55600000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.38300000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.40000000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.47299999999999998},"min":{"1min":0.39400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.46100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81999999999999995,"5min":0.873,"15min":0.873},"last":0.59099999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.78300000000000003,"15min":0.76800000000000002},"min":{"1min":0.66700000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.751},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.58199999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0529999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.86799999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.78800000000000003,"15min":0.77500000000000002},"min":{"1min":0.63900000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79300000000000004,"15min":0.78700000000000003},"min":{"1min":0.67500000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0169999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.82899999999999996,"15min":0.81699999999999995},"min":{"1min":0.73099999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1040000000000001,"5min":1.109,"15min":1.109},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.82099999999999995,"15min":0.80500000000000005},"min":{"1min":0.66800000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.80200000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.86199999999999999,"15min":0.85499999999999998},"min":{"1min":0.70699999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.83099999999999996,"15min":0.82099999999999995},"min":{"1min":0.68700000000000006,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0800000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.80900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:30:22.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:30:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.020+0000 7f47efe00640 1 Processor -- start 2024-08-17T02:30:23.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.021+0000 7f47efe00640 1 -- start start 2024-08-17T02:30:23.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.022+0000 7f47efe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f47e80ad960 0x7f47e815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:23.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.022+0000 7f47efe00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47e80ca050 0x7f47e8156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:23.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.022+0000 7f47efe00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e815b5e0 con 0x7f47e80add30 2024-08-17T02:30:23.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.022+0000 7f47efe00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e80cb160 con 0x7f47e80ca050 2024-08-17T02:30:23.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.022+0000 7f47efe00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e80b0d10 con 0x7f47e80ad960 2024-08-17T02:30:23.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.022+0000 7f47eca00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47e80ca050 0x7f47e8156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:23.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.022+0000 7f47ede00640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f47e80add30 0x7f47e8156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37578/0 (socket says 172.21.15.6:37578) 2024-08-17T02:30:23.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.022+0000 7f47ede00640 1 -- 172.21.15.6:0/1034999834 learned_addr learned my addr 172.21.15.6:0/1034999834 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-08-17T02:30:23.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.022+0000 7f47ed400640 1 --2- 172.21.15.6:0/1034999834 >> v2:172.21.15.136:3300/0 conn(0x7f47e80ad960 0x7f47e815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:23.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.023+0000 7f47eca00640 1 -- 172.21.15.6:0/1034999834 >> v2:172.21.15.136:3300/0 conn(0x7f47e80ad960 msgr2=0x7f47e815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:23.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.023+0000 7f47eca00640 1 --2- 172.21.15.6:0/1034999834 >> v2:172.21.15.136:3300/0 conn(0x7f47e80ad960 0x7f47e815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.023+0000 7f47eca00640 1 -- 172.21.15.6:0/1034999834 >> v1:172.21.15.6:6789/0 conn(0x7f47e80add30 legacy=0x7f47e8156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.023+0000 7f47eca00640 1 -- 172.21.15.6:0/1034999834 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e80ca550 con 0x7f47e80ca050 2024-08-17T02:30:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.023+0000 7f47e7e00640 1 -- 172.21.15.6:0/1034999834 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486599588 0 0) 0x7f47e0001490 con 0x7f47e80add30 2024-08-17T02:30:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.024+0000 7f47eca00640 1 --2- 172.21.15.6:0/1034999834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80ca050 0x7f47e8156420 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f47e80cc910 tx=0x7f47d40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fcd2d4b6f7e85a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:23.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.024+0000 7f47e7e00640 1 -- 172.21.15.6:0/1034999834 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d402ae40 con 0x7f47e80ca050 2024-08-17T02:30:23.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.024+0000 7f47e7e00640 1 -- 172.21.15.6:0/1034999834 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d4032440 con 0x7f47e80ca050 2024-08-17T02:30:23.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.024+0000 7f47e7e00640 1 -- 172.21.15.6:0/1034999834 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d40327e0 con 0x7f47e80ca050 2024-08-17T02:30:23.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.025+0000 7f47efe00640 1 -- 172.21.15.6:0/1034999834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80ca050 msgr2=0x7f47e8156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:23.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.025+0000 7f47efe00640 1 --2- 172.21.15.6:0/1034999834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80ca050 0x7f47e8156420 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f47e80cc910 tx=0x7f47d40090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.025+0000 7f47efe00640 1 -- 172.21.15.6:0/1034999834 shutdown_connections 2024-08-17T02:30:23.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.025+0000 7f47efe00640 1 --2- 172.21.15.6:0/1034999834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80ca050 0x7f47e8156420 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.025+0000 7f47efe00640 1 --2- 172.21.15.6:0/1034999834 >> v2:172.21.15.136:3300/0 conn(0x7f47e80ad960 0x7f47e815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.025+0000 7f47efe00640 1 -- 172.21.15.6:0/1034999834 >> 172.21.15.6:0/1034999834 conn(0x7f47e8066e60 msgr2=0x7f47e8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:23.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.025+0000 7f47efe00640 1 -- 172.21.15.6:0/1034999834 shutdown_connections 2024-08-17T02:30:23.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.025+0000 7f47efe00640 1 -- 172.21.15.6:0/1034999834 wait complete. 2024-08-17T02:30:23.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.026+0000 7f47efe00640 1 Processor -- start 2024-08-17T02:30:23.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.026+0000 7f47efe00640 1 -- start start 2024-08-17T02:30:23.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.027+0000 7f47efe00640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47e80ad960 0x7f47e8157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:23.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.027+0000 7f47efe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80add30 0x7f47e8159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:23.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.027+0000 7f47efe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47e80ca050 0x7f47e80a9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:23.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.027+0000 7f47efe00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e815bab0 con 0x7f47e80add30 2024-08-17T02:30:23.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.027+0000 7f47efe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e81577b0 con 0x7f47e80ca050 2024-08-17T02:30:23.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.027+0000 7f47efe00640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e81571a0 con 0x7f47e80ad960 2024-08-17T02:30:23.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.028+0000 7f47eca00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80add30 0x7f47e8159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:23.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.028+0000 7f47eca00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80add30 0x7f47e8159940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60616/0 (socket says 172.21.15.6:60616) 2024-08-17T02:30:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.028+0000 7f47eca00640 1 -- 172.21.15.6:0/2761171318 learned_addr learned my addr 172.21.15.6:0/2761171318 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:30:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.028+0000 7f47ed400640 1 --2- 172.21.15.6:0/2761171318 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47e80ad960 0x7f47e8157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.028+0000 7f47ede00640 1 --2- 172.21.15.6:0/2761171318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47e80ca050 0x7f47e80a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.028+0000 7f47eca00640 1 -- 172.21.15.6:0/2761171318 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47e80ad960 msgr2=0x7f47e8157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.028+0000 7f47eca00640 1 --2- 172.21.15.6:0/2761171318 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47e80ad960 0x7f47e8157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.028+0000 7f47eca00640 1 -- 172.21.15.6:0/2761171318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47e80ca050 msgr2=0x7f47e80a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.028+0000 7f47eca00640 1 --2- 172.21.15.6:0/2761171318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47e80ca050 0x7f47e80a9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.028+0000 7f47eca00640 1 -- 172.21.15.6:0/2761171318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d4009390 con 0x7f47e80add30 2024-08-17T02:30:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.029+0000 7f47eca00640 1 --2- 172.21.15.6:0/2761171318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80add30 0x7f47e8159940 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f47d4035040 tx=0x7f47d4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.029+0000 7f47e4c00640 1 -- 172.21.15.6:0/2761171318 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4031de0 con 0x7f47e80add30 2024-08-17T02:30:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.029+0000 7f47e4c00640 1 -- 172.21.15.6:0/2761171318 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d403e450 con 0x7f47e80add30 2024-08-17T02:30:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.029+0000 7f47e4c00640 1 -- 172.21.15.6:0/2761171318 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d403e850 con 0x7f47e80add30 2024-08-17T02:30:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.029+0000 7f47efe00640 1 -- 172.21.15.6:0/2761171318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e8158180 con 0x7f47e80add30 2024-08-17T02:30:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.029+0000 7f47efe00640 1 -- 172.21.15.6:0/2761171318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e81574c0 con 0x7f47e80add30 2024-08-17T02:30:23.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.030+0000 7f47efe00640 1 -- 172.21.15.6:0/2761171318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e816a280 con 0x7f47e80add30 2024-08-17T02:30:23.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.031+0000 7f47e4c00640 1 -- 172.21.15.6:0/2761171318 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f47d403c400 con 0x7f47e80add30 2024-08-17T02:30:23.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.032+0000 7f47e4c00640 1 --2- 172.21.15.6:0/2761171318 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f47c8065150 0x7f47c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:23.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.032+0000 7f47e4c00640 1 -- 172.21.15.6:0/2761171318 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f47d402ae40 con 0x7f47e80add30 2024-08-17T02:30:23.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.033+0000 7f47ed400640 1 --2- 172.21.15.6:0/2761171318 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f47c8065150 0x7f47c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:23.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.033+0000 7f47ed400640 1 --2- 172.21.15.6:0/2761171318 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f47c8065150 0x7f47c8067600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00bd40 tx=0x7f47dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:23.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.036+0000 7f47e4c00640 1 -- 172.21.15.6:0/2761171318 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f47d4070e10 con 0x7f47e80add30 2024-08-17T02:30:23.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.220+0000 7f47efe00640 1 -- 172.21.15.6:0/2761171318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f47e8157920 con 0x7f47e80add30 2024-08-17T02:30:23.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.225+0000 7f47e4c00640 1 -- 172.21.15.6:0/2761171318 <== mon.0 v2:172.21.15.6:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f47d4070e10 con 0x7f47e80add30 2024-08-17T02:30:23.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.226+0000 7f47e4c00640 1 -- 172.21.15.6:0/2761171318 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f47d40370c0 con 0x7f47e80add30 2024-08-17T02:30:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.228+0000 7f47efe00640 1 -- 172.21.15.6:0/2761171318 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f47c8065150 msgr2=0x7f47c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.228+0000 7f47efe00640 1 --2- 172.21.15.6:0/2761171318 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f47c8065150 0x7f47c8067600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00bd40 tx=0x7f47dc008040 comp rx=0 tx=0).stop 2024-08-17T02:30:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.228+0000 7f47efe00640 1 -- 172.21.15.6:0/2761171318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80add30 msgr2=0x7f47e8159940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.228+0000 7f47efe00640 1 --2- 172.21.15.6:0/2761171318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80add30 0x7f47e8159940 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f47d4035040 tx=0x7f47d4032000 comp rx=0 tx=0).stop 2024-08-17T02:30:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.228+0000 7f47efe00640 1 -- 172.21.15.6:0/2761171318 shutdown_connections 2024-08-17T02:30:23.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.228+0000 7f47efe00640 1 --2- 172.21.15.6:0/2761171318 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f47c8065150 0x7f47c8067600 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.228+0000 7f47efe00640 1 --2- 172.21.15.6:0/2761171318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47e80ca050 0x7f47e80a9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.228+0000 7f47efe00640 1 --2- 172.21.15.6:0/2761171318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80add30 0x7f47e8159940 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.228+0000 7f47efe00640 1 --2- 172.21.15.6:0/2761171318 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47e80ad960 0x7f47e8157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.228+0000 7f47efe00640 1 -- 172.21.15.6:0/2761171318 >> 172.21.15.6:0/2761171318 conn(0x7f47e8066e60 msgr2=0x7f47e806e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:23.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.228+0000 7f47efe00640 1 -- 172.21.15.6:0/2761171318 shutdown_connections 2024-08-17T02:30:23.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.228+0000 7f47efe00640 1 -- 172.21.15.6:0/2761171318 wait complete. 2024-08-17T02:30:23.243 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:30:23.244 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:23.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.400+0000 7f4733200640 1 Processor -- start 2024-08-17T02:30:23.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.400+0000 7f4733200640 1 -- start start 2024-08-17T02:30:23.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.402+0000 7f4733200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f47340ad790 0x7f47340adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:23.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.403+0000 7f4733200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47340c9d20 0x7f47340ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:23.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.403+0000 7f4733200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47340ca6b0 con 0x7f47341552d0 2024-08-17T02:30:23.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.403+0000 7f4733200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47340cb180 con 0x7f47340ad790 2024-08-17T02:30:23.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.403+0000 7f4733200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47340af530 con 0x7f47340c9d20 2024-08-17T02:30:23.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.403+0000 7f4731400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47340c9d20 0x7f47340ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:23.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.403+0000 7f4731e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f47340ad790 0x7f47340adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:23.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.403+0000 7f4731e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f47340ad790 0x7f47340adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.6:37560/0 (socket says 172.21.15.6:37560) 2024-08-17T02:30:23.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.403+0000 7f4731e00640 1 -- 172.21.15.6:0/735322586 learned_addr learned my addr 172.21.15.6:0/735322586 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:30:23.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.403+0000 7f4731400640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47340c9d20 0x7f47340ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.6:48146/0 (socket says 172.21.15.6:48146) 2024-08-17T02:30:23.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.403+0000 7f4732800640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f47341552d0 0x7f4734155750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.6:45402/0 (socket says 172.21.15.6:45402) 2024-08-17T02:30:23.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.404+0000 7f4731400640 1 -- 172.21.15.6:0/735322586 >> v2:172.21.15.136:3300/0 conn(0x7f47340ad790 msgr2=0x7f47340adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:23.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.404+0000 7f4731400640 1 --2- 172.21.15.6:0/735322586 >> v2:172.21.15.136:3300/0 conn(0x7f47340ad790 0x7f47340adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.404+0000 7f4731400640 1 -- 172.21.15.6:0/735322586 >> v1:172.21.15.136:6789/0 conn(0x7f47341552d0 legacy=0x7f4734155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:23.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.404+0000 7f4731400640 1 -- 172.21.15.6:0/735322586 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47340ca8e0 con 0x7f47340c9d20 2024-08-17T02:30:23.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.404+0000 7f4731e00640 1 --2- 172.21.15.6:0/735322586 >> v2:172.21.15.136:3300/0 conn(0x7f47340ad790 0x7f47340adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:23.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.405+0000 7f4731400640 1 --2- 172.21.15.6:0/735322586 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47340c9d20 0x7f47340ca170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4720009850 tx=0x7f47200090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd73d2a9284ac315 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:23.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.405+0000 7f4730a00640 1 -- 172.21.15.6:0/735322586 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472002ad00 con 0x7f47340c9d20 2024-08-17T02:30:23.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.405+0000 7f4730a00640 1 -- 172.21.15.6:0/735322586 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f472002ae60 con 0x7f47340c9d20 2024-08-17T02:30:23.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.405+0000 7f4730a00640 1 -- 172.21.15.6:0/735322586 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720032690 con 0x7f47340c9d20 2024-08-17T02:30:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.406+0000 7f4733200640 1 -- 172.21.15.6:0/735322586 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47340c9d20 msgr2=0x7f47340ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.406+0000 7f4733200640 1 --2- 172.21.15.6:0/735322586 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47340c9d20 0x7f47340ca170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4720009850 tx=0x7f47200090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.406+0000 7f4733200640 1 -- 172.21.15.6:0/735322586 shutdown_connections 2024-08-17T02:30:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.406+0000 7f4733200640 1 --2- 172.21.15.6:0/735322586 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47340c9d20 0x7f47340ca170 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.406+0000 7f4733200640 1 --2- 172.21.15.6:0/735322586 >> v2:172.21.15.136:3300/0 conn(0x7f47340ad790 0x7f47340adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.406+0000 7f4733200640 1 -- 172.21.15.6:0/735322586 >> 172.21.15.6:0/735322586 conn(0x7f4734062af0 msgr2=0x7f4734062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.406+0000 7f4733200640 1 -- 172.21.15.6:0/735322586 shutdown_connections 2024-08-17T02:30:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.406+0000 7f4733200640 1 -- 172.21.15.6:0/735322586 wait complete. 2024-08-17T02:30:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.408+0000 7f4733200640 1 Processor -- start 2024-08-17T02:30:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.409+0000 7f4733200640 1 -- start start 2024-08-17T02:30:23.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.410+0000 7f4733200640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47340ad790 0x7f4734158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:23.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.410+0000 7f4733200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47340c9d20 0x7f47340ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:23.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.410+0000 7f4733200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47341552d0 0x7f47340a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.410+0000 7f4733200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4734166e60 con 0x7f47341552d0 2024-08-17T02:30:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.410+0000 7f4733200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4734167140 con 0x7f47340c9d20 2024-08-17T02:30:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.410+0000 7f4733200640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4734167420 con 0x7f47340ad790 2024-08-17T02:30:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.410+0000 7f4732800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47341552d0 0x7f47340a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.411+0000 7f4732800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47341552d0 0x7f47340a4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60622/0 (socket says 172.21.15.6:60622) 2024-08-17T02:30:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.411+0000 7f4732800640 1 -- 172.21.15.6:0/3675132935 learned_addr learned my addr 172.21.15.6:0/3675132935 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-08-17T02:30:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.411+0000 7f4731400640 1 --2- 172.21.15.6:0/3675132935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47340c9d20 0x7f47340ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.411+0000 7f4731e00640 1 --2- 172.21.15.6:0/3675132935 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47340ad790 0x7f4734158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:23.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.411+0000 7f4732800640 1 -- 172.21.15.6:0/3675132935 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47340ad790 msgr2=0x7f4734158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:23.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.411+0000 7f4732800640 1 --2- 172.21.15.6:0/3675132935 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47340ad790 0x7f4734158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.411+0000 7f4732800640 1 -- 172.21.15.6:0/3675132935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47340c9d20 msgr2=0x7f47340ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:23.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.411+0000 7f4732800640 1 --2- 172.21.15.6:0/3675132935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47340c9d20 0x7f47340ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.411+0000 7f4732800640 1 -- 172.21.15.6:0/3675132935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472400b700 con 0x7f47341552d0 2024-08-17T02:30:23.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.411+0000 7f4732800640 1 --2- 172.21.15.6:0/3675132935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47341552d0 0x7f47340a4e00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f472c00c910 tx=0x7f472c001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:23.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.412+0000 7f4729600640 1 -- 172.21.15.6:0/3675132935 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c00cea0 con 0x7f47341552d0 2024-08-17T02:30:23.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.412+0000 7f4729600640 1 -- 172.21.15.6:0/3675132935 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f472c005d60 con 0x7f47341552d0 2024-08-17T02:30:23.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.412+0000 7f4729600640 1 -- 172.21.15.6:0/3675132935 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c00a890 con 0x7f47341552d0 2024-08-17T02:30:23.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.412+0000 7f4733200640 1 -- 172.21.15.6:0/3675132935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4720009390 con 0x7f47341552d0 2024-08-17T02:30:23.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.412+0000 7f4733200640 1 -- 172.21.15.6:0/3675132935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4734167a60 con 0x7f47341552d0 2024-08-17T02:30:23.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.413+0000 7f4733200640 1 -- 172.21.15.6:0/3675132935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4734158d10 con 0x7f47341552d0 2024-08-17T02:30:23.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.414+0000 7f4729600640 1 -- 172.21.15.6:0/3675132935 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f472c00acc0 con 0x7f47341552d0 2024-08-17T02:30:23.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.414+0000 7f4729600640 1 --2- 172.21.15.6:0/3675132935 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4714065150 0x7f4714067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:23.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.415+0000 7f4729600640 1 -- 172.21.15.6:0/3675132935 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f472c081df0 con 0x7f47341552d0 2024-08-17T02:30:23.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.415+0000 7f4731e00640 1 --2- 172.21.15.6:0/3675132935 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4714065150 0x7f4714067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:23.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.416+0000 7f4731e00640 1 --2- 172.21.15.6:0/3675132935 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4714065150 0x7f4714067600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4724006c90 tx=0x7f472400b460 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:23.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.423+0000 7f4729600640 1 -- 172.21.15.6:0/3675132935 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f472c050320 con 0x7f47341552d0 2024-08-17T02:30:23.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.644+0000 7f4733200640 1 -- 172.21.15.6:0/3675132935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4734070720 con 0x7f47341552d0 2024-08-17T02:30:23.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.645+0000 7f4729600640 1 -- 172.21.15.6:0/3675132935 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f472c053940 con 0x7f47341552d0 2024-08-17T02:30:23.646 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-08-17T02:30:23.646 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4712,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/4280185456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":4280185456},{"type":"v1","addr":"172.21.15.136:6836","nonce":4280185456}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2517061869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":2517061869},{"type":"v1","addr":"172.21.15.136:6837","nonce":2517061869}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2625056728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2625056728},{"type":"v1","addr":"172.21.15.6:6835","nonce":2625056728}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5385,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2517651184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2517651184},{"type":"v1","addr":"172.21.15.6:6834","nonce":2517651184}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[]} 2024-08-17T02:30:23.647 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 23 2024-08-17T02:30:23.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.647+0000 7f4733200640 1 -- 172.21.15.6:0/3675132935 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4714065150 msgr2=0x7f4714067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:23.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.647+0000 7f4733200640 1 --2- 172.21.15.6:0/3675132935 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4714065150 0x7f4714067600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4724006c90 tx=0x7f472400b460 comp rx=0 tx=0).stop 2024-08-17T02:30:23.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.647+0000 7f4733200640 1 -- 172.21.15.6:0/3675132935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47341552d0 msgr2=0x7f47340a4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:23.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.647+0000 7f4733200640 1 --2- 172.21.15.6:0/3675132935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47341552d0 0x7f47340a4e00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f472c00c910 tx=0x7f472c001690 comp rx=0 tx=0).stop 2024-08-17T02:30:23.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.647+0000 7f4733200640 1 -- 172.21.15.6:0/3675132935 shutdown_connections 2024-08-17T02:30:23.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.647+0000 7f4733200640 1 --2- 172.21.15.6:0/3675132935 >> [v2:172.21.15.136:6832/36709,v1:172.21.15.136:6833/36709] conn(0x7f4714065150 0x7f4714067600 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.647+0000 7f4733200640 1 --2- 172.21.15.6:0/3675132935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47341552d0 0x7f47340a4e00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.647+0000 7f4733200640 1 --2- 172.21.15.6:0/3675132935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47340c9d20 0x7f47340ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.647+0000 7f4733200640 1 --2- 172.21.15.6:0/3675132935 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47340ad790 0x7f4734158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:23.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.647+0000 7f4733200640 1 -- 172.21.15.6:0/3675132935 >> 172.21.15.6:0/3675132935 conn(0x7f4734062af0 msgr2=0x7f4734151270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:23.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.647+0000 7f4733200640 1 -- 172.21.15.6:0/3675132935 shutdown_connections 2024-08-17T02:30:23.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-08-17T02:30:23.647+0000 7f4733200640 1 -- 172.21.15.6:0/3675132935 wait complete. 2024-08-17T02:30:23.663 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:30:23.663 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:30:23.663 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:30:23.663 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:23.676 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:30:23.677 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:30:23.677 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:23.733 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:30:23.733 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:30:23.733 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:23.750 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:30:23.750 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:30:23.750 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:23.806 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:30:23.806 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:30:23.807 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:30:23.807 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:23.856 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:30:23.856 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:30:23.857 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:23.908 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:30:23.909 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:30:23.909 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:23.955 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:30:23.955 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:30:23.955 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:24.000 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:30:24.001 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:30:24.001 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:24.042 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:30:24.042 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:30:24.042 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:24.097 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:30:24.097 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:30:24.098 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:24.136 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:30:24.136 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:30:24.136 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:24.223 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:30:24.223 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:30:24.223 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:30:24.223 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:24.281 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:30:24.282 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:30:24.282 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:24.343 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:30:24.343 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:30:24.343 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:30:24.343 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:24.362 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:30:24.363 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:30:24.363 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:24.380 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:30:24.381 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:30:24.381 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:24.439 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:30:24.440 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:30:24.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:30:24.520 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com 2024-08-17T02:30:24.520 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:30:24.722 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi006.front.sepia.ceph.com 2024-08-17T02:30:24.722 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:30:24.836 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi006.front.sepia.ceph.com 2024-08-17T02:30:24.836 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:30:24.934 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi006.front.sepia.ceph.com 2024-08-17T02:30:24.935 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:30:25.033 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi136.front.sepia.ceph.com 2024-08-17T02:30:25.034 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:30:25.242 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi136.front.sepia.ceph.com 2024-08-17T02:30:25.242 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:30:25.343 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi136.front.sepia.ceph.com 2024-08-17T02:30:25.343 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:30:25.449 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi136.front.sepia.ceph.com 2024-08-17T02:30:25.450 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:30:25.550 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:30:25.551 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858270/data/mon.a.tgz 2024-08-17T02:30:25.551 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-08-17T02:30:25.588 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.8RYqMLGdQq 2024-08-17T02:30:25.588 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.8RYqMLGdQq 2024-08-17T02:30:25.765 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.8RYqMLGdQq 2024-08-17T02:30:25.859 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.8RYqMLGdQq is 310KB 2024-08-17T02:30:25.948 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.8RYqMLGdQq 2024-08-17T02:30:25.983 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858270/data/mon.b.tgz 2024-08-17T02:30:25.983 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-08-17T02:30:26.019 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.zoXPDQxw08 2024-08-17T02:30:26.019 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.zoXPDQxw08 2024-08-17T02:30:26.207 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.zoXPDQxw08 2024-08-17T02:30:26.302 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.zoXPDQxw08 is 412KB 2024-08-17T02:30:26.391 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.zoXPDQxw08 2024-08-17T02:30:26.426 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858270/data/mon.c.tgz 2024-08-17T02:30:26.426 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-08-17T02:30:26.501 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.cSH4I9KJnl 2024-08-17T02:30:26.502 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.cSH4I9KJnl 2024-08-17T02:30:26.682 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.cSH4I9KJnl 2024-08-17T02:30:26.777 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.cSH4I9KJnl is 412KB 2024-08-17T02:30:26.865 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.cSH4I9KJnl 2024-08-17T02:30:26.900 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:30:26.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:30:26.904 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:30:26.995 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:30:26.995 DEBUG:teuthology.orchestra.run.smithi006:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:30:26.999 DEBUG:teuthology.orchestra.run.smithi136:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:30:27.059 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:30:27.061 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:30:27.071 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:30:27.073 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858270/remote/smithi006/crash 2024-08-17T02:30:27.074 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:30:27.128 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858270/remote/smithi136/crash 2024-08-17T02:30:27.129 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:30:27.183 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:30:27.184 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:27.188 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:27.278 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:27.333 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:27.389 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:30:27.389 DEBUG:teuthology.orchestra.run.smithi006:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:30:27.394 DEBUG:teuthology.orchestra.run.smithi136:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:30:27.444 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49852.log 2024-08-17T02:30:27.444 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42050.log 2024-08-17T02:30:27.445 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42418.log 2024-08-17T02:30:27.446 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49852.log.gz 2024-08-17T02:30:27.446 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48695.log 2024-08-17T02:30:27.446 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42050.log.gz 2024-08-17T02:30:27.447 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43227.log 2024-08-17T02:30:27.448 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36940.log 2024-08-17T02:30:27.448 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42418.log.gz 2024-08-17T02:30:27.448 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48695.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48695.log.gz 2024-08-17T02:30:27.449 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48031.log 2024-08-17T02:30:27.454 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44392.log 2024-08-17T02:30:27.454 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43227.log.gz 2024-08-17T02:30:27.454 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50533.log 2024-08-17T02:30:27.454 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48031.log.gz 2024-08-17T02:30:27.454 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49161.log 2024-08-17T02:30:27.454 INFO:teuthology.orchestra.run.smithi006.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44392.log.gz 2024-08-17T02:30:27.454 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47429.log 2024-08-17T02:30:27.455 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50533.log.gz 2024-08-17T02:30:27.455 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50081.log 2024-08-17T02:30:27.455 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49161.log.gz 2024-08-17T02:30:27.455 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50701.log 2024-08-17T02:30:27.455 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47429.log.gz 2024-08-17T02:30:27.456 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37031.log 2024-08-17T02:30:27.456 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.36940.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:30:27.456 INFO:teuthology.orchestra.run.smithi136.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36940.log.gz 2024-08-17T02:30:27.457 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37031.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:30:27.457 INFO:teuthology.orchestra.run.smithi136.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37031.log.gz 2024-08-17T02:30:27.457 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36991.log 2024-08-17T02:30:27.457 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42247.log 2024-08-17T02:30:27.457 INFO:teuthology.orchestra.run.smithi136.stderr: 91.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:30:27.457 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.36991.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:30:27.457 INFO:teuthology.orchestra.run.smithi136.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36991.log.gz 2024-08-17T02:30:27.457 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.3.42247.log: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:30:27.457 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42247.log.gz 2024-08-17T02:30:27.458 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:30:27.458 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:30:27.458 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37111.log 2024-08-17T02:30:27.458 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:30:27.460 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37111.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37111.log.gz 2024-08-17T02:30:27.461 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41923.log 2024-08-17T02:30:27.461 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36900.log 2024-08-17T02:30:27.461 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.1.41923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41923.log.gz 2024-08-17T02:30:27.461 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:30:27.461 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.36900.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:30:27.464 INFO:teuthology.orchestra.run.smithi136.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36900.log.gz 2024-08-17T02:30:27.465 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:30:27.465 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42643.log 2024-08-17T02:30:27.467 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48909.log 2024-08-17T02:30:27.467 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50081.log.gz 2024-08-17T02:30:27.467 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46805.log 2024-08-17T02:30:27.467 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50701.log.gz 2024-08-17T02:30:27.467 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49768.log 2024-08-17T02:30:27.468 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48909.log.gz 2024-08-17T02:30:27.468 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48611.log 2024-08-17T02:30:27.468 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46805.log.gz 2024-08-17T02:30:27.468 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48455.log 2024-08-17T02:30:27.468 INFO:teuthology.orchestra.run.smithi006.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49768.log.gz 2024-08-17T02:30:27.468 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44140.log 2024-08-17T02:30:27.468 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48611.log.gz 2024-08-17T02:30:27.468 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48371.log 2024-08-17T02:30:27.468 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48455.log.gz 2024-08-17T02:30:27.469 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49413.log 2024-08-17T02:30:27.469 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44140.log.gz 2024-08-17T02:30:27.469 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49558.log 2024-08-17T02:30:27.469 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48371.log.gz 2024-08-17T02:30:27.469 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42502.log 2024-08-17T02:30:27.469 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49413.log.gz 2024-08-17T02:30:27.469 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50996.log 2024-08-17T02:30:27.469 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49558.log.gz 2024-08-17T02:30:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43556.log 2024-08-17T02:30:27.470 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42502.log.gz 2024-08-17T02:30:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46763.log 2024-08-17T02:30:27.470 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50996.log.gz 2024-08-17T02:30:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51349.log 2024-08-17T02:30:27.470 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43556.log.gz 2024-08-17T02:30:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50911.log 2024-08-17T02:30:27.471 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46763.log.gz 2024-08-17T02:30:27.471 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51349.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:30:27.471 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51349.log.gz 2024-08-17T02:30:27.475 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.1.42643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42643.log.gz 2024-08-17T02:30:27.475 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37151.log 2024-08-17T02:30:27.475 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37151.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37151.log.gz 2024-08-17T02:30:27.475 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37071.log 2024-08-17T02:30:27.475 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37071.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:30:27.476 INFO:teuthology.orchestra.run.smithi136.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:30:27.479 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mds.d.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37071.log.gz 2024-08-17T02:30:27.479 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:30:27.479 INFO:teuthology.orchestra.run.smithi136.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:30:27.479 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37191.log 2024-08-17T02:30:27.481 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43222.log 2024-08-17T02:30:27.481 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50911.log.gz 2024-08-17T02:30:27.481 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43566.log 2024-08-17T02:30:27.481 INFO:teuthology.orchestra.run.smithi006.stderr: 84.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:30:27.481 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46721.log 2024-08-17T02:30:27.481 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43222.log.gz 2024-08-17T02:30:27.482 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44308.log 2024-08-17T02:30:27.482 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43566.log.gz 2024-08-17T02:30:27.482 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46065.log 2024-08-17T02:30:27.482 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46721.log.gz 2024-08-17T02:30:27.482 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44923.log 2024-08-17T02:30:27.482 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44308.log.gz 2024-08-17T02:30:27.482 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46065.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:30:27.482 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46065.log.gz 2024-08-17T02:30:27.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49473.log 2024-08-17T02:30:27.483 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44923.log.gz 2024-08-17T02:30:27.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44014.log 2024-08-17T02:30:27.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36881.log 2024-08-17T02:30:27.483 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49473.log.gz 2024-08-17T02:30:27.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47471.log 2024-08-17T02:30:27.483 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44014.log.gz 2024-08-17T02:30:27.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43762.log 2024-08-17T02:30:27.483 INFO:teuthology.orchestra.run.smithi006.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36881.log.gz 2024-08-17T02:30:27.484 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47471.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47471.log.gz 2024-08-17T02:30:27.484 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44224.log 2024-08-17T02:30:27.484 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43488.log 2024-08-17T02:30:27.484 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43762.log.gz 2024-08-17T02:30:27.484 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43930.log 2024-08-17T02:30:27.484 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44224.log.gz 2024-08-17T02:30:27.484 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46847.log 2024-08-17T02:30:27.484 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43488.log.gz 2024-08-17T02:30:27.485 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.37191.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37191.log.gz 2024-08-17T02:30:27.488 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43930.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43930.log.gz 2024-08-17T02:30:27.488 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49245.log 2024-08-17T02:30:27.488 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45393.log 2024-08-17T02:30:27.488 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46847.log.gz 2024-08-17T02:30:27.489 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48951.log 2024-08-17T02:30:27.489 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49245.log.gz 2024-08-17T02:30:27.489 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47779.log 2024-08-17T02:30:27.489 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45393.log.gz 2024-08-17T02:30:27.489 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42879.log 2024-08-17T02:30:27.489 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48951.log.gz 2024-08-17T02:30:27.489 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47693.log 2024-08-17T02:30:27.489 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47779.log.gz 2024-08-17T02:30:27.489 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45477.log 2024-08-17T02:30:27.490 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42879.log.gz 2024-08-17T02:30:27.490 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50123.log 2024-08-17T02:30:27.490 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47693.log.gz 2024-08-17T02:30:27.491 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42894.log 2024-08-17T02:30:27.491 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45477.log.gz 2024-08-17T02:30:27.492 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50123.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:30:27.492 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50123.log.gz 2024-08-17T02:30:27.492 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50827.log 2024-08-17T02:30:27.492 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42894.log.gz 2024-08-17T02:30:27.492 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45351.log 2024-08-17T02:30:27.493 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50827.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50827.log.gz 2024-08-17T02:30:27.493 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44350.log 2024-08-17T02:30:27.493 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:30:27.493 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45351.log: gzip -5 --verbose 88.6% -- /var/log/ceph/ceph-client.admin.43230.log -- replaced with /var/log/ceph/ceph-client.admin.45351.log.gz 2024-08-17T02:30:27.493 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-08-17T02:30:27.494 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44098.log 2024-08-17T02:30:27.494 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44350.log.gz 2024-08-17T02:30:27.495 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42891.log 2024-08-17T02:30:27.495 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43230.log.gz 2024-08-17T02:30:27.496 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42712.log 2024-08-17T02:30:27.496 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44098.log.gz 2024-08-17T02:30:27.497 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42891.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42891.log.gz 2024-08-17T02:30:27.497 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45435.log 2024-08-17T02:30:27.497 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46167.log 2024-08-17T02:30:27.498 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42712.log.gz 2024-08-17T02:30:27.498 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42232.log 2024-08-17T02:30:27.499 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45435.log.gz 2024-08-17T02:30:27.499 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45981.log 2024-08-17T02:30:27.500 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46167.log.gz 2024-08-17T02:30:27.500 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42232.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42232.log.gz 2024-08-17T02:30:27.500 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49810.log 2024-08-17T02:30:27.501 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45981.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:30:27.501 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45981.log.gz 2024-08-17T02:30:27.502 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47601.log 2024-08-17T02:30:27.502 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49810.log.gz 2024-08-17T02:30:27.503 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42893.log 2024-08-17T02:30:27.504 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47601.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47601.log.gzgzip 2024-08-17T02:30:27.504 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49119.log 2024-08-17T02:30:27.505 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42274.log 2024-08-17T02:30:27.505 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42893.log.gz 2024-08-17T02:30:27.506 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50575.log 2024-08-17T02:30:27.506 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49119.log.gz 2024-08-17T02:30:27.507 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49203.log 2024-08-17T02:30:27.507 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42274.log.gz 2024-08-17T02:30:27.507 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50659.log 2024-08-17T02:30:27.508 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50575.log.gz 2024-08-17T02:30:27.508 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48739.log 2024-08-17T02:30:27.508 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49203.log.gz 2024-08-17T02:30:27.509 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44266.log 2024-08-17T02:30:27.509 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50659.log.gz 2024-08-17T02:30:27.510 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48739.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.48739.log.gz 2024-08-17T02:30:27.510 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46931.log 2024-08-17T02:30:27.511 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44266.log: gzip -5 87.8% --verbose -- replaced with /var/log/ceph/ceph-client.admin.44266.log.gz -- 2024-08-17T02:30:27.511 INFO:teuthology.orchestra.run.smithi006.stderr: /var/log/ceph/ceph-client.admin.46469.log 2024-08-17T02:30:27.512 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46931.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-mds.c.log -- replaced with /var/log/ceph/ceph-client.admin.46931.log.gz 2024-08-17T02:30:27.512 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-08-17T02:30:27.513 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46469.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46469.log.gz 2024-08-17T02:30:27.513 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47735.log 2024-08-17T02:30:27.514 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42586.log 2024-08-17T02:30:27.515 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48653.log 2024-08-17T02:30:27.516 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47735.log.gz 2024-08-17T02:30:27.516 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42586.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42586.log.gz 2024-08-17T02:30:27.518 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49978.log 2024-08-17T02:30:27.518 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48653.log.gz 2024-08-17T02:30:27.519 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45771.log 2024-08-17T02:30:27.520 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47821.log 2024-08-17T02:30:27.520 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49978.log.gz 2024-08-17T02:30:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45771.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45771.log.gz 2024-08-17T02:30:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45855.log 2024-08-17T02:30:27.522 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51164.log 2024-08-17T02:30:27.523 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47821.log.gz 2024-08-17T02:30:27.523 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45855.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:30:27.523 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45855.log.gz 2024-08-17T02:30:27.524 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51164.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51164.log.gz 2024-08-17T02:30:27.525 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:30:27.526 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41810.log 2024-08-17T02:30:27.526 INFO:teuthology.orchestra.run.smithi136.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:30:27.527 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49287.log 2024-08-17T02:30:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49642.log 2024-08-17T02:30:27.528 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41810.log.gz 2024-08-17T02:30:27.530 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42882.log 2024-08-17T02:30:27.530 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49287.log.gz 2024-08-17T02:30:27.531 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46209.log 2024-08-17T02:30:27.531 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49642.log.gz 2024-08-17T02:30:27.532 INFO:teuthology.orchestra.run.smithi006.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:30:27.532 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42882.log: 93.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:30:27.532 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:30:27.533 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42882.log.gz 2024-08-17T02:30:27.533 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47303.log 2024-08-17T02:30:27.533 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46209.log.gz 2024-08-17T02:30:27.534 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46023.log 2024-08-17T02:30:27.535 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42889.log 2024-08-17T02:30:27.536 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47303.log.gz 2024-08-17T02:30:27.537 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50449.log 2024-08-17T02:30:27.537 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46023.log.gz 2024-08-17T02:30:27.538 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47947.log 2024-08-17T02:30:27.538 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42889.log.gz 2024-08-17T02:30:27.539 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45309.log 2024-08-17T02:30:27.539 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50449.log.gz 2024-08-17T02:30:27.540 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41714.log 2024-08-17T02:30:27.540 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47947.log.gz 2024-08-17T02:30:27.542 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50785.log 2024-08-17T02:30:27.542 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45309.log.gz 2024-08-17T02:30:27.543 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47011.log 2024-08-17T02:30:27.543 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41714.log.gz 2024-08-17T02:30:27.544 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43220.log 2024-08-17T02:30:27.544 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50785.log.gz 2024-08-17T02:30:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43888.log 2024-08-17T02:30:27.546 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47011.log.gz 2024-08-17T02:30:27.547 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42670.log 2024-08-17T02:30:27.547 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43220.log.gz 2024-08-17T02:30:27.548 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44530.log 2024-08-17T02:30:27.548 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43888.log.gz 2024-08-17T02:30:27.549 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45687.log 2024-08-17T02:30:27.550 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42670.log.gz 2024-08-17T02:30:27.551 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41891.log 2024-08-17T02:30:27.551 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44530.log.gz 2024-08-17T02:30:27.552 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45897.log 2024-08-17T02:30:27.552 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45687.log.gz 2024-08-17T02:30:27.553 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47905.log 2024-08-17T02:30:27.553 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41891.log.gz 2024-08-17T02:30:27.554 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36615.log 2024-08-17T02:30:27.554 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45897.log.gz 2024-08-17T02:30:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50491.log 2024-08-17T02:30:27.555 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47905.log.gz 2024-08-17T02:30:27.557 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46511.log 2024-08-17T02:30:27.557 INFO:teuthology.orchestra.run.smithi006.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.36615.log.gz 2024-08-17T02:30:27.558 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47091.log 2024-08-17T02:30:27.558 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50491.log.gz 2024-08-17T02:30:27.559 INFO:teuthology.orchestra.run.smithi136.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:30:27.559 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45939.log 2024-08-17T02:30:27.559 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46511.log.gz 2024-08-17T02:30:27.560 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45729.log 2024-08-17T02:30:27.560 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47091.log.gz 2024-08-17T02:30:27.561 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50407.log 2024-08-17T02:30:27.562 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45939.log.gz 2024-08-17T02:30:27.563 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48539.log 2024-08-17T02:30:27.563 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45729.log.gz 2024-08-17T02:30:27.564 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50407.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:30:27.564 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50407.log.gz 2024-08-17T02:30:27.565 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46889.log 2024-08-17T02:30:27.565 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48539.log.gz 2024-08-17T02:30:27.567 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43476.log 2024-08-17T02:30:27.568 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46595.log 2024-08-17T02:30:27.568 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46889.log.gz 2024-08-17T02:30:27.569 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47175.log 2024-08-17T02:30:27.569 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43476.log.gz 2024-08-17T02:30:27.570 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46595.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46595.log.gz 2024-08-17T02:30:27.571 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46107.log 2024-08-17T02:30:27.572 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49035.log 2024-08-17T02:30:27.572 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47175.log.gz 2024-08-17T02:30:27.573 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43565.log 2024-08-17T02:30:27.573 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46107.log.gz 2024-08-17T02:30:27.574 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49035.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49035.log.gz 2024-08-17T02:30:27.575 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45561.log 2024-08-17T02:30:27.575 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43565.log.gz 2024-08-17T02:30:27.577 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49600.log 2024-08-17T02:30:27.578 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47863.log 2024-08-17T02:30:27.578 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45561.log.gz 2024-08-17T02:30:27.579 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45519.log 2024-08-17T02:30:27.579 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49600.log.gz 2024-08-17T02:30:27.580 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46679.log 2024-08-17T02:30:27.580 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47863.log.gz 2024-08-17T02:30:27.582 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46637.log 2024-08-17T02:30:27.582 INFO:teuthology.orchestra.run.smithi006.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45519.log.gz 2024-08-17T02:30:27.583 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47989.log 2024-08-17T02:30:27.584 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46679.log.gz 2024-08-17T02:30:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51308.log 2024-08-17T02:30:27.584 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46637.log.gz 2024-08-17T02:30:27.586 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42188.log 2024-08-17T02:30:27.586 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47989.log.gz 2024-08-17T02:30:27.587 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51308.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51308.log.gz 2024-08-17T02:30:27.587 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51122.log 2024-08-17T02:30:27.588 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50165.log 2024-08-17T02:30:27.589 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42188.log.gz 2024-08-17T02:30:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51122.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51122.log.gz 2024-08-17T02:30:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50038.log 2024-08-17T02:30:27.591 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48497.log 2024-08-17T02:30:27.591 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50165.log.gz 2024-08-17T02:30:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42094.log 2024-08-17T02:30:27.593 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50038.log.gz 2024-08-17T02:30:27.594 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48497.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48497.log.gz 2024-08-17T02:30:27.594 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51392.log 2024-08-17T02:30:27.595 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42094.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42094.log.gz 2024-08-17T02:30:27.595 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45267.log 2024-08-17T02:30:27.597 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42890.log 2024-08-17T02:30:27.597 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51392.log.gz 2024-08-17T02:30:27.598 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45267.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45267.log.gz 2024-08-17T02:30:27.599 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51206.log 2024-08-17T02:30:27.599 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42890.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42890.log.gz 2024-08-17T02:30:27.600 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30549.log 2024-08-17T02:30:27.601 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49936.log 2024-08-17T02:30:27.602 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51206.log.gz 2024-08-17T02:30:27.602 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.tmp-client.admin.30549.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30549.log.gz 2024-08-17T02:30:27.603 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43561.log/var/log/ceph/ceph-client.admin.49936.log: 2024-08-17T02:30:27.604 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49936.log.gz 2024-08-17T02:30:27.605 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43229.log 2024-08-17T02:30:27.606 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50207.log 2024-08-17T02:30:27.606 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43561.log.gz 2024-08-17T02:30:27.607 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46251.log 2024-08-17T02:30:27.607 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43229.log.gz 2024-08-17T02:30:27.608 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43804.log 2024-08-17T02:30:27.609 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50207.log.gz 2024-08-17T02:30:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49894.log 2024-08-17T02:30:27.610 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46251.log.gz 2024-08-17T02:30:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50365.log 2024-08-17T02:30:27.611 INFO:teuthology.orchestra.run.smithi006.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43804.log.gz 2024-08-17T02:30:27.612 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49894.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49894.log.gz 2024-08-17T02:30:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50365.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50365.log.gz 2024-08-17T02:30:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46385.log 2024-08-17T02:30:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50954.log 2024-08-17T02:30:27.617 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44182.log 2024-08-17T02:30:27.617 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46385.log.gz 2024-08-17T02:30:27.618 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50954.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50954.log.gz 2024-08-17T02:30:27.618 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43563.log 2024-08-17T02:30:27.620 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47133.log 2024-08-17T02:30:27.620 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44182.log.gz 2024-08-17T02:30:27.620 INFO:teuthology.orchestra.run.smithi006.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:30:27.621 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50869.log 2024-08-17T02:30:27.621 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43563.log.gz 2024-08-17T02:30:27.622 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49371.log/var/log/ceph/ceph-client.admin.47133.log: 2024-08-17T02:30:27.622 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47133.log.gz 2024-08-17T02:30:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47345.log 2024-08-17T02:30:27.623 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50869.log.gz 2024-08-17T02:30:27.624 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43846.log 2024-08-17T02:30:27.624 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49371.log.gz 2024-08-17T02:30:27.625 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51248.log 2024-08-17T02:30:27.625 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47345.log.gz 2024-08-17T02:30:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46553.log 2024-08-17T02:30:27.626 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43846.log.gz 2024-08-17T02:30:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43228.log 2024-08-17T02:30:27.628 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51248.log.gz 2024-08-17T02:30:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37000.log 2024-08-17T02:30:27.629 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46553.log.gz 2024-08-17T02:30:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43228.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43228.log.gz 2024-08-17T02:30:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42144.log 2024-08-17T02:30:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48139.log 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi006.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37000.log.gz 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42885.log 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42144.log.gz 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43226.log 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48139.log.gz 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42885.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42885.log.gz 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49516.log 2024-08-17T02:30:27.637 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43217.log 2024-08-17T02:30:27.637 INFO:teuthology.orchestra.run.smithi136.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:30:27.638 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43226.log.gz 2024-08-17T02:30:27.638 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47557.log 2024-08-17T02:30:27.638 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49516.log.gz 2024-08-17T02:30:27.638 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41936.log 2024-08-17T02:30:27.638 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43217.log.gz 2024-08-17T02:30:27.639 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47261.log 2024-08-17T02:30:27.640 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47557.log.gz 2024-08-17T02:30:27.640 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42628.log 2024-08-17T02:30:27.641 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41936.log.gz 2024-08-17T02:30:27.641 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47261.log: gzip -5 --verbose 88.1% -- /var/log/ceph/ceph-client.admin.45813.log -- replaced with /var/log/ceph/ceph-client.admin.47261.log.gz 2024-08-17T02:30:27.641 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-08-17T02:30:27.642 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44056.log 2024-08-17T02:30:27.643 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42628.log.gz 2024-08-17T02:30:27.643 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42544.log 2024-08-17T02:30:27.644 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45813.log.gz 2024-08-17T02:30:27.645 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43972.log 2024-08-17T02:30:27.645 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44056.log.gz 2024-08-17T02:30:27.646 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48993.log 2024-08-17T02:30:27.646 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42544.log.gz 2024-08-17T02:30:27.647 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46427.log 2024-08-17T02:30:27.647 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43972.log.gz 2024-08-17T02:30:27.648 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48993.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48993.log.gz 2024-08-17T02:30:27.648 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45223.log 2024-08-17T02:30:27.649 INFO:teuthology.orchestra.run.smithi136.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:30:27.649 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47387.log 2024-08-17T02:30:27.650 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46427.log.gz 2024-08-17T02:30:27.650 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.2.45223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45223.log.gz 2024-08-17T02:30:27.651 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49329.log 2024-08-17T02:30:27.652 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47387.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:30:27.652 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47387.log.gz 2024-08-17T02:30:27.653 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49329.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42460.log -- replaced with /var/log/ceph/ceph-client.admin.49329.log.gz 2024-08-17T02:30:27.653 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-08-17T02:30:27.654 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47651.log 2024-08-17T02:30:27.655 INFO:teuthology.orchestra.run.smithi136.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:30:27.655 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41990.log 2024-08-17T02:30:27.656 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42460.log.gz 2024-08-17T02:30:27.657 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47651.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47651.log.gz 2024-08-17T02:30:27.657 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49726.log 2024-08-17T02:30:27.658 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48413.log 2024-08-17T02:30:27.658 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41990.log.gz 2024-08-17T02:30:27.659 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51038.log 2024-08-17T02:30:27.659 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49726.log.gz 2024-08-17T02:30:27.661 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43564.log 2024-08-17T02:30:27.661 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48413.log.gz 2024-08-17T02:30:27.662 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48326.log 2024-08-17T02:30:27.662 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51038.log.gz 2024-08-17T02:30:27.663 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43564.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43564.log.gz 2024-08-17T02:30:27.663 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47513.log 2024-08-17T02:30:27.664 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.48326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48326.log.gz 2024-08-17T02:30:27.664 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51080.log 2024-08-17T02:30:27.666 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47513.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49684.log 2024-08-17T02:30:27.666 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47513.log.gz 2024-08-17T02:30:27.667 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47219.log 2024-08-17T02:30:27.668 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51080.log.gz 2024-08-17T02:30:27.668 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42358.log 2024-08-17T02:30:27.668 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49684.log.gz 2024-08-17T02:30:27.669 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47219.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47219.log.gz 2024-08-17T02:30:27.669 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50617.log 2024-08-17T02:30:27.671 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42316.log 2024-08-17T02:30:27.671 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42358.log.gz 2024-08-17T02:30:27.672 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48073.log 2024-08-17T02:30:27.672 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50617.log.gz 2024-08-17T02:30:27.673 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45603.log 2024-08-17T02:30:27.673 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42316.log.gz 2024-08-17T02:30:27.674 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44860.log 2024-08-17T02:30:27.675 INFO:teuthology.orchestra.run.smithi006.stderr: 91.1%/var/log/ceph/ceph-client.admin.45603.log: -- replaced with /var/log/ceph/ceph-client.admin.48073.log.gz 2024-08-17T02:30:27.675 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45603.log.gz 2024-08-17T02:30:27.676 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50743.log 2024-08-17T02:30:27.677 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.44860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44860.log.gz 2024-08-17T02:30:27.677 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49077.log 2024-08-17T02:30:27.679 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45645.log 2024-08-17T02:30:27.679 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50743.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50743.log.gz 2024-08-17T02:30:27.680 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49077.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49077.log.gz 2024-08-17T02:30:27.680 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45645.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45645.log.gz 2024-08-17T02:30:27.683 INFO:teuthology.orchestra.run.smithi136.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:30:27.686 INFO:teuthology.orchestra.run.smithi136.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:30:27.689 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-08-17T02:30:27.689 INFO:teuthology.orchestra.run.smithi136.stderr:real 0m0.263s 2024-08-17T02:30:27.689 INFO:teuthology.orchestra.run.smithi136.stderr:user 0m1.088s 2024-08-17T02:30:27.689 INFO:teuthology.orchestra.run.smithi136.stderr:sys 0m0.188s 2024-08-17T02:30:27.699 INFO:teuthology.orchestra.run.smithi006.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:30:27.726 INFO:teuthology.orchestra.run.smithi006.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:30:27.737 INFO:teuthology.orchestra.run.smithi006.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:30:27.744 INFO:teuthology.orchestra.run.smithi006.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:30:27.836 INFO:teuthology.orchestra.run.smithi006.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:30:27.839 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-08-17T02:30:27.839 INFO:teuthology.orchestra.run.smithi006.stderr:real 0m0.417s 2024-08-17T02:30:27.839 INFO:teuthology.orchestra.run.smithi006.stderr:user 0m1.121s 2024-08-17T02:30:27.839 INFO:teuthology.orchestra.run.smithi006.stderr:sys 0m0.610s 2024-08-17T02:30:27.840 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:30:27.840 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858270/remote/smithi006/log 2024-08-17T02:30:27.841 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:30:28.175 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858270/remote/smithi136/log 2024-08-17T02:30:28.176 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:30:28.365 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:30:28.389 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:30:28.389 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:30:28.393 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:30:28.506 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:30:28.516 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:30:28.516 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:30:28.520 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:30:28.549 INFO:teuthology.orchestra.run.smithi006.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:30:28.553 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:30:28.556 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:30:28.556 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2024-08-17T02:30:28.556 INFO:teuthology.orchestra.run.smithi006.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 -49us[ -12us] +/- 59ms 2024-08-17T02:30:28.557 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 -68us[ -68us] +/- 62ms 2024-08-17T02:30:28.557 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +245us[ +245us] +/- 61ms 2024-08-17T02:30:28.557 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:30:28.560 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:30:28.560 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-08-17T02:30:28.560 INFO:teuthology.orchestra.run.smithi136.stdout:^* hv01.front.sepia.ceph.com 3 6 377 4 -26us[+5024ns] +/- 59ms 2024-08-17T02:30:28.560 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -51us[ -19us] +/- 62ms 2024-08-17T02:30:28.561 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +219us[ +219us] +/- 61ms 2024-08-17T02:30:28.561 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:30:28.562 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:30:28.570 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:30:28.570 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:30:28.579 DEBUG:teuthology.orchestra.run.smithi006:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:30:28.718 DEBUG:teuthology.orchestra.run.smithi136:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:30:28.831 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:30:28.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:30:28.891 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:30:28.951 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:30:28.952 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:30:28.961 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:30:28.970 INFO:teuthology.task.internal:Duration was 737.631099 seconds 2024-08-17T02:30:28.970 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:30:28.979 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:30:28.980 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:30:28.984 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:30:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:30:29.071 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:30:29.429 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:30:29.429 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2024-08-17T02:30:29.429 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:30:29.478 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2024-08-17T02:30:29.479 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:30:29.528 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:30:29.529 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:30:29.533 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:30:29.592 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:30:29.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:30:29.597 DEBUG:teuthology.orchestra.run.smithi136:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:30:29.740 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:30:29.750 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:30:29.750 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:30:29.806 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:30:29.862 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:30:29.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:30:29.876 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:30:29.943 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2024-08-17T02:30:29.947 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2024-08-17T02:30:29.977 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:30:30.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:30:30.010 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:30:30.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:30:30.044 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:30:30.054 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:30:30.055 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858270/remote/smithi006 2024-08-17T02:30:30.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:30:30.119 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858270/remote/smithi136 2024-08-17T02:30:30.119 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:30:30.182 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:30:30.182 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:30:30.186 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:30:30.221 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:30:30.232 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:30:30.232 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:30:30.241 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:30:30.241 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:30:30.262 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:30:30.293 INFO:teuthology.orchestra.run.smithi006.stdout: 395180 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:30 /home/ubuntu/cephtest 2024-08-17T02:30:30.296 INFO:teuthology.orchestra.run.smithi136.stdout: 395408 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:30 /home/ubuntu/cephtest 2024-08-17T02:30:30.298 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:30:30.308 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:30:30.332 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 client.1-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 737.631098985672 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=97e8629d1ae14df1ad4d0496f4225ef3 status: fail success: false 2024-08-17T02:30:30.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:30:30.408 INFO:teuthology.run:FAIL